2024-08-17T02:33:25.918 INFO:root:teuthology version: 1.2.0 2024-08-17T02:33:25.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:33:26.031 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858292' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsyC7Ohz4uikJ9N5Yd35Dqhfxj7kTlg7+oUxdkBPO3tg/vkxIcAeWAxX0DIoDX6AXhlEiwPgYaNMYz9sOaKruo= smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPkwOwDzdQyIaJZOHwSLK1zks4Fhz0Z98dwqBPr/trE2qRxk1wxP1R7JHqK5L7FaWjfAx82LxNOv5ZqCDu0tlw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:10:27 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:33:26.031 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:33:26.032 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:33:26.032 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:33:26.033 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:33:26.053 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:33:26.054 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:33:26.054 INFO:teuthology.packaging:ref: None 2024-08-17T02:33:26.054 INFO:teuthology.packaging:tag: None 2024-08-17T02:33:26.054 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:33:26.054 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:33:26.054 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:33:26.202 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:33:26.203 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:33:26.211 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:33:26.211 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:33:26.230 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:33:26.246 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:33:26.253 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:33:26.278 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:28:48.616415', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsyC7Ohz4uikJ9N5Yd35Dqhfxj7kTlg7+oUxdkBPO3tg/vkxIcAeWAxX0DIoDX6AXhlEiwPgYaNMYz9sOaKruo='} 2024-08-17T02:33:26.301 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:28:48.618319', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPkwOwDzdQyIaJZOHwSLK1zks4Fhz0Z98dwqBPr/trE2qRxk1wxP1R7JHqK5L7FaWjfAx82LxNOv5ZqCDu0tlw='} 2024-08-17T02:33:26.301 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:33:26.309 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:33:26.309 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:33:26.310 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:33:26.375 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efec3067ac0>, signals=[15]) 2024-08-17T02:33:26.375 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:33:26.383 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:33:26.384 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:33:26.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:33:26.463 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:33:26.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:33:26.537 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:33:26.546 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-08-17T02:33:26.564 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-08-17T02:33:26.564 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-08-17T02:33:26.622 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-08-17T02:33:26.622 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-08-17T02:33:26.622 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-08-17T02:33:26.622 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:33:26.622 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-08-17T02:33:26.622 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:33:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:33:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-08-17T02:33:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:33:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:33:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:33:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:33:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:33:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:33:26.624 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-08-17T02:33:26.645 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-08-17T02:33:26.663 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-08-17T02:33:26.663 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-08-17T02:33:26.720 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:33:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:33:26.722 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-08-17T02:33:26.744 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:33:26.756 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:33:26.776 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:33:26.776 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:33:26.781 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:33:26.798 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:33:26.806 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:33:26.806 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:33:26.836 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:33:26.859 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:33:26.919 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:33:26.935 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:33:26.935 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:33:26.935 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:33:26.935 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:33:26.936 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:33:26.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:33:26.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:33:26.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:33:26.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:33:27.097 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:27.098 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:33:27.098 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-08-17T02:33:27.116 INFO:teuthology.orchestra.run.smithi026.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:33:27.116 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:27.116 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:33:27.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum upgrade -y linux-firmware 2024-08-17T02:33:27.117 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:27.117 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:33:27.118 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-08-17T02:33:27.135 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:33:27.135 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:33:27.136 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:33:27.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum upgrade -y linux-firmware 2024-08-17T02:33:30.134 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-08-17T02:33:30.717 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:01 2024-08-17T02:33:33.260 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-08-17T02:33:35.867 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 20 MB 00:03 2024-08-17T02:33:38.877 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.6 MB 00:01 2024-08-17T02:33:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.6 MB 00:00 2024-08-17T02:33:40.644 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 18 kB 00:00 2024-08-17T02:33:41.656 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 25 MB/s | 22 MB 00:00 2024-08-17T02:33:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 94 kB/s | 18 kB 00:00 2024-08-17T02:33:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-17T02:33:47.271 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-17T02:33:48.536 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-08-17T02:33:49.428 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-08-17T02:33:49.433 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-08-17T02:33:49.433 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-08-17T02:33:49.433 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-08-17T02:33:49.433 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2024-08-17T02:33:49.433 INFO:teuthology.orchestra.run.smithi026.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:33:49.433 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:33:49.433 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-08-17T02:33:49.434 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-08-17T02:33:49.434 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 1 Package 2024-08-17T02:33:49.434 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:33:49.434 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 383 M 2024-08-17T02:33:49.434 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-08-17T02:33:50.667 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-17T02:33:50.672 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-17T02:33:50.672 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-08-17T02:33:50.672 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-17T02:33:50.672 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-08-17T02:33:50.672 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:33:50.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:33:50.673 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-08-17T02:33:50.673 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-08-17T02:33:50.673 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 1 Package 2024-08-17T02:33:50.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:33:50.673 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 383 M 2024-08-17T02:33:50.673 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-08-17T02:33:55.854 INFO:teuthology.orchestra.run.smithi002.stdout:linux-firmware-20240716-145.el9.noarch.rpm 76 MB/s | 383 MB 00:05 2024-08-17T02:33:55.854 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:33:55.854 INFO:teuthology.orchestra.run.smithi002.stdout:Total 74 MB/s | 383 MB 00:05 2024-08-17T02:33:59.090 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-08-17T02:33:59.159 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-08-17T02:33:59.159 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-08-17T02:34:02.379 INFO:teuthology.orchestra.run.smithi026.stdout:linux-firmware-20240716-145.el9.noarch.rpm 30 MB/s | 383 MB 00:12 2024-08-17T02:34:02.379 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:34:02.379 INFO:teuthology.orchestra.run.smithi026.stdout:Total 30 MB/s | 383 MB 00:12 2024-08-17T02:34:02.545 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-08-17T02:34:02.545 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-08-17T02:34:05.612 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-08-17T02:34:05.700 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-08-17T02:34:05.700 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-08-17T02:34:09.101 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-08-17T02:34:09.101 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-08-17T02:34:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-08-17T02:34:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:34:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:13.622 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:34:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:34:14.312 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-08-17T02:34:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:34:14.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:34:14.312 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-17T02:34:14.623 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:34:14.623 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:34:14.774 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:34:14.774 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:34:14.777 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi002.front.sepia.ceph.com to complete... 2024-08-17T02:34:18.878 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-08-17T02:34:19.279 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:34:19.370 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:19.934 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:19.935 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:34:20.661 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:34:20.661 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:34:20.661 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2024-08-17T02:34:20.661 INFO:teuthology.orchestra.run.smithi026.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:34:20.661 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:34:20.661 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-08-17T02:34:20.956 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:34:20.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:34:21.097 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:34:21.097 DEBUG:teuthology.orchestra.run.smithi026:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:34:21.100 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi026.front.sepia.ceph.com to complete... 2024-08-17T02:34:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17 02:34:26 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:34:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:FINISHED --2024-08-17 02:34:26-- 2024-08-17T02:34:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:Total wall clock time: 12s 2024-08-17T02:34:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:Downloaded: 1 files, 344M in 12s (29.7 MB/s) 2024-08-17T02:34:26.830 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:34:26.830 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:34:29.002 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying... ######################################## 2024-08-17T02:34:29.047 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing... ######################################## 2024-08-17T02:34:29.100 INFO:teuthology.orchestra.run.smithi002.stdout:Updating / installing... 2024-08-17T02:34:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17 02:34:34 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:34:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:FINISHED --2024-08-17 02:34:34-- 2024-08-17T02:34:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:Total wall clock time: 14s 2024-08-17T02:34:34.639 INFO:teuthology.orchestra.run.smithi026.stderr:Downloaded: 1 files, 344M in 13s (26.3 MB/s) 2024-08-17T02:34:34.642 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:34:34.642 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:34:36.812 INFO:teuthology.orchestra.run.smithi026.stdout:Verifying... ######################################## 2024-08-17T02:34:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing... ######################################## 2024-08-17T02:34:36.911 INFO:teuthology.orchestra.run.smithi026.stdout:Updating / installing... 2024-08-17T02:34:37.445 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:34:45.267 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:35:17.990 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:35:17.990 DEBUG:teuthology.orchestra.run.smithi002:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:18.071 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:35:18.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:35:18.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:35:18.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:35:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:35:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:35:18.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:35:18.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:35:18.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:35:18.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:35:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:35:18.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:35:18.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:35:18.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:35:18.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:35:18.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:35:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:35:18.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:35:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:35:18.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:35:18.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:35:18.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:35:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:35:18.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:35:18.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:35:18.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:35:18.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:35:18.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:35:18.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:35:18.100 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:35:18.101 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:35:18.102 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:35:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:35:18.104 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:35:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:35:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:35:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:35:18.108 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:35:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:35:18.110 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:35:18.111 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:35:18.112 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:35:18.113 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:35:18.114 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:35:18.115 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:35:18.116 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:35:18.117 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:35:18.118 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:35:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:35:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:35:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:35:18.122 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:35:18.123 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:35:18.124 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:35:18.125 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:35:18.126 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:35:18.127 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:35:18.128 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:35:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:35:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:35:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:35:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:35:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:35:18.134 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:35:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:35:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:35:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:35:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:35:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:35:18.140 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:35:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:35:18.142 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:35:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:35:18.144 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:35:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:35:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:35:18.147 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:35:18.148 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:35:18.149 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:35:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:35:18.151 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:35:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:35:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:35:18.154 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:35:18.155 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:35:18.156 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:35:18.157 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:35:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:35:18.159 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:35:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:35:18.161 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:35:18.162 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:35:18.163 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:35:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:35:18.165 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:35:18.166 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:35:18.167 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:35:18.168 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:35:18.169 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:35:18.170 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:35:18.171 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:35:18.172 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:35:18.173 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:35:18.174 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:35:18.175 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:35:18.176 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:35:18.177 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:35:18.178 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:35:18.179 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:35:18.180 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:35:18.181 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:35:18.182 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:35:18.183 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:35:18.184 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:35:18.185 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:35:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:35:18.187 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:35:18.188 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:35:18.189 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:35:18.190 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:35:18.191 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:35:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:35:18.193 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:35:18.194 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:35:18.195 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:35:18.196 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:35:18.197 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:35:18.198 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:35:18.199 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:35:18.200 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:35:18.201 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:35:18.202 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:35:18.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:35:18.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:35:18.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:35:18.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:35:18.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:35:18.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:35:18.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:35:18.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:35:18.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:35:18.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:35:18.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:35:18.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:18.215 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:18.215 DEBUG:teuthology.orchestra.run.smithi002:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:18.240 INFO:teuthology.orchestra.run.smithi002.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:35:18.240 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:18.240 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:18.240 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-08-17T02:35:18.240 INFO:teuthology.orchestra.run.smithi002.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout: fi 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout:done 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-08-17T02:35:18.241 INFO:teuthology.orchestra.run.smithi002.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:35:18.242 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:18.242 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:18.242 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-08-17T02:35:18.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-08-17T02:35:18.321 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 68.el9 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8264254 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:35:18.322 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:35:18.323 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:35:18.324 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:35:18.324 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:18.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:35:18.924 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-08-17T02:35:20.325 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:35:20.349 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-08-17T02:35:20.351 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-08-17T02:35:20.373 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.qZIe7J1U4O 2024-08-17T02:35:20.373 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qZIe7J1U4O 2024-08-17T02:35:20.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.qZIe7J1U4O 2024-08-17T02:35:20.575 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.qZIe7J1U4O is 6KB 2024-08-17T02:35:20.624 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.qZIe7J1U4O 2024-08-17T02:35:20.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:35:20.700 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:35:20.700 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:35:20.700 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:35:20.700 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:35:20.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:20.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-08-17T02:35:25.989 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:35:25.990 DEBUG:teuthology.orchestra.run.smithi026:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:35:26.062 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:35:26.063 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:35:26.064 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:35:26.065 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:35:26.066 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:35:26.067 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:35:26.068 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:35:26.069 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:35:26.070 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:35:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:35:26.072 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:35:26.073 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:35:26.074 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:35:26.075 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:35:26.076 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:35:26.077 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:35:26.078 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:35:26.079 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:35:26.080 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:35:26.081 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:35:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:35:26.083 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:35:26.084 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:35:26.085 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:35:26.086 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:35:26.087 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:35:26.088 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:35:26.089 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:35:26.090 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:35:26.091 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:35:26.092 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:35:26.093 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:35:26.094 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:35:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:35:26.096 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:35:26.097 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:35:26.098 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:35:26.099 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:35:26.100 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:35:26.101 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:35:26.102 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:35:26.103 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:35:26.104 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:35:26.105 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:35:26.106 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:35:26.107 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:35:26.108 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:35:26.109 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:35:26.110 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:35:26.111 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:35:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:35:26.113 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:35:26.114 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:35:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:35:26.116 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:35:26.117 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:35:26.118 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:35:26.119 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:35:26.120 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:35:26.121 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:35:26.122 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:35:26.123 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:35:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:35:26.125 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:35:26.126 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:35:26.127 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:35:26.128 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:35:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:35:26.130 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:35:26.131 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:35:26.132 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:35:26.133 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:35:26.134 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:35:26.135 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:35:26.136 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:35:26.137 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:35:26.138 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:35:26.139 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:35:26.140 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:35:26.141 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:35:26.142 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:35:26.143 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:35:26.144 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:35:26.145 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:35:26.146 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:35:26.147 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:35:26.148 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:35:26.149 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:35:26.150 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:35:26.151 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:35:26.152 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:35:26.153 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:35:26.154 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:35:26.155 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:35:26.156 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:35:26.157 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:35:26.158 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:35:26.159 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:35:26.160 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:35:26.161 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:35:26.162 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:35:26.163 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:35:26.164 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:35:26.165 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:35:26.166 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:35:26.167 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:35:26.168 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:35:26.169 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:35:26.170 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:35:26.171 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:35:26.172 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:35:26.173 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:35:26.174 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:35:26.175 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:35:26.176 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:35:26.177 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:35:26.178 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:35:26.179 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:35:26.180 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:35:26.181 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:35:26.182 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:35:26.183 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:35:26.184 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:35:26.185 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:35:26.186 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:35:26.187 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:35:26.188 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:35:26.189 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:35:26.190 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:35:26.191 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:35:26.192 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:35:26.193 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:35:26.194 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:35:26.195 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:35:26.196 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:35:26.197 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:35:26.198 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:35:26.199 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:35:26.200 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:35:26.201 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:35:26.202 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:35:26.203 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:35:26.204 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:35:26.205 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:35:26.206 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:35:26.207 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:35:26.208 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:35:26.209 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:35:26.210 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:35:26.211 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:35:26.211 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:35:26.211 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:35:26.211 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:35:26.211 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:35:26.211 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:35:26.211 INFO:teuthology.orchestra.run.smithi026.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:26.214 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:26.215 DEBUG:teuthology.orchestra.run.smithi026:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout:fi 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout: fi 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout:done 2024-08-17T02:35:26.241 INFO:teuthology.orchestra.run.smithi026.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout:fi 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout:fi 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:26.242 INFO:teuthology.orchestra.run.smithi026.stdout:fi 2024-08-17T02:35:26.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -qi grub2-tools 2024-08-17T02:35:26.319 INFO:teuthology.orchestra.run.smithi026.stdout:Name : grub2-tools 2024-08-17T02:35:26.319 INFO:teuthology.orchestra.run.smithi026.stdout:Epoch : 1 2024-08-17T02:35:26.319 INFO:teuthology.orchestra.run.smithi026.stdout:Version : 2.06 2024-08-17T02:35:26.319 INFO:teuthology.orchestra.run.smithi026.stdout:Release : 68.el9 2024-08-17T02:35:26.319 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: x86_64 2024-08-17T02:35:26.319 INFO:teuthology.orchestra.run.smithi026.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Group : Unspecified 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Size : 8264254 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:License : GPLv3+ 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Packager : builder@centos.org 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Vendor : CentOS 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Summary : Support tools for GRUB. 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout:Description : 2024-08-17T02:35:26.320 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:35:26.321 INFO:teuthology.orchestra.run.smithi026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:35:26.321 INFO:teuthology.orchestra.run.smithi026.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:35:26.321 INFO:teuthology.orchestra.run.smithi026.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:35:26.321 INFO:teuthology.orchestra.run.smithi026.stdout:hardware devices. 2024-08-17T02:35:26.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:35:26.321 INFO:teuthology.orchestra.run.smithi026.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:35:26.322 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:35:26.322 INFO:teuthology.task.kernel:Updating grub on smithi026 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:26.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:35:26.973 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2024-08-17T02:35:28.264 INFO:teuthology.orchestra.run.smithi026.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:35:28.291 INFO:teuthology.orchestra.run.smithi026.stderr:done 2024-08-17T02:35:28.293 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-08-17T02:35:28.308 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.IXiLtqQCiV 2024-08-17T02:35:28.308 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IXiLtqQCiV 2024-08-17T02:35:28.388 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.IXiLtqQCiV 2024-08-17T02:35:28.531 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.IXiLtqQCiV is 6KB 2024-08-17T02:35:28.579 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.IXiLtqQCiV 2024-08-17T02:35:28.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:35:28.656 INFO:teuthology.orchestra.run.smithi026.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:35:28.657 INFO:teuthology.orchestra.run.smithi026.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:35:28.657 INFO:teuthology.orchestra.run.smithi026.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:35:28.657 INFO:teuthology.orchestra.run.smithi026.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:35:28.658 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:35:28.808 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2024-08-17T02:35:50.867 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:35:50.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:35:50.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:35:58.818 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:35:58.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-08-17T02:35:58.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:09.311 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-08-17T02:36:17.247 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-08-17T02:36:18.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:36:18.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:26.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-08-17T02:36:26.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:44.643 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-08-17T02:36:56.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-08-17T02:36:56.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:36:58.029 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-08-17T02:36:58.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-08-17T02:36:58.576 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:36:58.576 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-08-17T02:36:58.610 INFO:teuthology.orchestra.run.smithi026.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:58.611 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:36:58.611 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:36:58.611 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:36:59.612 DEBUG:teuthology.parallel:result is None 2024-08-17T02:37:18.317 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:37:30.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:37:30.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:37:30.748 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-08-17T02:37:31.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:37:31.228 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:37:31.228 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-08-17T02:37:31.262 INFO:teuthology.orchestra.run.smithi002.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:37:31.262 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:37:31.262 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:37:31.262 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:37:32.265 DEBUG:teuthology.parallel:result is None 2024-08-17T02:37:32.265 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:37:32.274 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:37:32.274 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:37:32.278 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:37:32.320 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:37:32.331 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:37:32.346 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:37:32.346 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:37:32.357 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:37:32.411 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:37:32.422 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:37:32.423 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:37:32.427 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:37:32.515 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:37:32.612 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:37:32.612 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:37:32.613 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:37:32.613 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:37:32.624 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:37:32.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:37:32.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:37:32.685 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:37:32.696 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:37:32.696 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:37:32.700 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:37:32.734 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:37:32.838 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:37:32.911 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:37:32.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:37:33.044 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:37:33.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:37:33.099 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:37:33.166 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:37:33.240 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:37:33.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:37:33.373 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:37:33.373 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:37:33.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-08-17T02:37:33.432 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-08-17T02:37:33.503 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:37:33.554 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:37:33.963 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:37:33.969 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:37:33.969 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:37:34.006 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:37:34.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-08-17T02:37:34.101 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-08-17T02:37:34.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2024-08-17T02:37:34.187 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2024-08-17T02:37:34.191 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:37:34.191 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-08-17T02:37:34.230 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-08-17T02:37:34.230 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2024-08-17T02:37:34.274 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2024-08-17T02:37:34.274 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi026.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:37:34.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:37:34.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:37:34.332 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:37:34.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:37:34.391 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:37:34.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:37:34.446 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:37:34.502 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:37:34.512 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:37:34.523 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:37:34.523 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi026.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:43:20.926 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi026.front.sepia.ceph.com')] 2024-08-17T02:43:20.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:43:20.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:43:21.024 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-08-17T02:43:21.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-08-17T02:43:21.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-08-17T02:43:21.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:43:21.244 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-08-17T02:43:21.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-08-17T02:43:21.361 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:43:21.374 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:43:21.374 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:43:21.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:43:21.378 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:43:21.379 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:43:21.437 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:43:21.463 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:43:21.467 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:43:21.496 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:43:21.519 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-08-17T02:43:21.543 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-08-17T02:43:21.544 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2024-08-17T02:43:21.568 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2024-08-17T02:43:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:43:21.597 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:43:21.602 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:43:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:43:21.709 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:43:21.714 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:43:21.714 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-08-17T02:43:21.714 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:21.714 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:21.714 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:21.714 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:21.732 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:43:21.738 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:43:21.738 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-08-17T02:43:21.738 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:21.738 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:21.738 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:21.738 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:43:21.739 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:43:21.748 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:43:21.748 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:43:21.748 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:43:21.748 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:43:21.754 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:43:21.754 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:43:21.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:43:21.756 DEBUG:teuthology.orchestra.run.smithi026:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:43:22.479 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:16 ago on Sat 17 Aug 2024 02:42:06 AM UTC. 2024-08-17T02:43:22.483 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:25 ago on Sat 17 Aug 2024 02:41:57 AM UTC. 2024-08-17T02:43:22.569 INFO:teuthology.orchestra.run.smithi026.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:43:22.574 INFO:teuthology.orchestra.run.smithi002.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:43:22.615 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-08-17T02:43:22.616 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-08-17T02:43:22.616 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-08-17T02:43:22.618 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-17T02:43:22.619 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-08-17T02:43:22.620 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-17T02:43:22.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:43:22.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:43:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:43:22.943 INFO:teuthology.orchestra.run.smithi002.stderr:of the main distribution, and quality may vary. 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:, 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:and packages are not held to any quality or security level. 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi002.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi026.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi026.stderr:of the main distribution, and quality may vary. 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-08-17T02:43:22.944 INFO:teuthology.orchestra.run.smithi026.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:43:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:43:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:, 2024-08-17T02:43:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:and packages are not held to any quality or security level. 2024-08-17T02:43:22.945 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-08-17T02:43:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:43:22.945 INFO:teuthology.orchestra.run.smithi026.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:43:23.022 INFO:teuthology.orchestra.run.smithi026.stdout:Repository successfully enabled. 2024-08-17T02:43:23.023 INFO:teuthology.orchestra.run.smithi002.stdout:Repository successfully enabled. 2024-08-17T02:43:23.069 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:43:23.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:43:23.076 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:43:23.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:43:23.226 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:43:23.226 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:43:23.232 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:43:23.232 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:43:23.425 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:43:23.425 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:43:23.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:43:23.426 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:43:23.426 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:43:23.427 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:43:23.483 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:43:23.483 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:43:23.484 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:43:23.484 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:43:23.580 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:43:23.582 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:43:23.659 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:43:23.661 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:43:23.719 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2024-08-17T02:43:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-08-17T02:43:23.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-08-17T02:43:23.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2024-08-17T02:43:24.001 INFO:teuthology.orchestra.run.smithi026.stdout:45 files removed 2024-08-17T02:43:24.003 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-08-17T02:43:24.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:43:24.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:43:24.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 231 kB/s | 77 kB 00:00 2024-08-17T02:43:24.762 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 222 kB/s | 77 kB 00:00 2024-08-17T02:43:25.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-08-17T02:43:25.129 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-08-17T02:43:25.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 5.7 kB/s | 1.8 kB 00:00 2024-08-17T02:43:25.455 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 6.2 kB/s | 1.8 kB 00:00 2024-08-17T02:43:25.710 INFO:teuthology.orchestra.run.smithi002.stdout:Copr repo for el9 owned by ceph 34 kB/s | 7.6 kB 00:00 2024-08-17T02:43:25.747 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for el9 owned by ceph 30 kB/s | 7.6 kB 00:00 2024-08-17T02:43:26.260 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-08-17T02:43:27.639 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-08-17T02:43:29.740 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-08-17T02:43:29.778 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 20 MB 00:02 2024-08-17T02:43:34.354 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.6 MB 00:00 2024-08-17T02:43:35.682 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.6 MB 00:01 2024-08-17T02:43:35.938 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 18 kB 00:00 2024-08-17T02:43:36.917 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:43:37.700 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 18 kB 00:00 2024-08-17T02:43:38.663 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:43:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-08-17T02:43:45.293 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-08-17T02:43:46.120 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:43:46.121 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:43:46.132 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:43:46.133 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:43:46.133 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:43:46.134 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:43:46.136 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:43:46.139 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:43:46.139 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:43:46.203 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-08-17T02:43:46.225 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-17T02:43:46.225 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-08-17T02:43:46.225 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-17T02:43:46.225 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-08-17T02:43:46.225 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:43:46.225 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:43:46.225 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:43:46.226 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:43:46.227 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:43:46.228 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:43:46.228 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:43:46.228 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:43:46.228 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:43:46.228 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:43:46.228 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:43:46.228 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-08-17T02:43:46.228 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:43:46.229 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:43:46.230 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:43:46.231 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:43:46.232 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:43:46.233 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:43:46.234 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:43:46.235 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:43:46.236 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-08-17T02:43:46.237 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:43:46.237 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:43:46.237 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-08-17T02:43:46.237 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-08-17T02:43:46.237 INFO:teuthology.orchestra.run.smithi002.stdout:Install 121 Packages 2024-08-17T02:43:46.237 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 12 Packages 2024-08-17T02:43:46.237 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:43:46.238 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 206 M 2024-08-17T02:43:46.238 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-08-17T02:43:47.049 INFO:teuthology.orchestra.run.smithi002.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 33 kB/s | 6.5 kB 00:00 2024-08-17T02:43:47.210 INFO:teuthology.orchestra.run.smithi002.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 5.0 MB/s | 813 kB 00:00 2024-08-17T02:43:47.283 INFO:teuthology.orchestra.run.smithi002.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.8 MB/s | 137 kB 00:00 2024-08-17T02:43:47.375 INFO:teuthology.orchestra.run.smithi002.stdout:(4/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.5 MB/s | 5.0 MB 00:00 2024-08-17T02:43:47.459 INFO:teuthology.orchestra.run.smithi002.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 17 MB/s | 1.4 MB 00:00 2024-08-17T02:43:47.509 INFO:teuthology.orchestra.run.smithi002.stdout:(6/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 9.2 MB/s | 2.1 MB 00:00 2024-08-17T02:43:47.660 INFO:teuthology.orchestra.run.smithi002.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 20 MB/s | 3.9 MB 00:00 2024-08-17T02:43:47.916 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:43:47.916 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:43:47.928 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:43:47.928 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:43:47.929 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:43:47.930 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:43:47.932 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:43:47.934 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:43:47.935 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:43:48.002 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-08-17T02:43:48.024 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-08-17T02:43:48.024 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-08-17T02:43:48.024 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-08-17T02:43:48.024 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-08-17T02:43:48.024 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:43:48.024 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:43:48.024 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:43:48.024 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:43:48.025 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:43:48.026 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:43:48.027 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:43:48.028 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:43:48.029 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:43:48.030 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:43:48.031 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:43:48.032 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:43:48.032 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:43:48.033 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:43:48.033 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:43:48.033 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:43:48.033 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:43:48.034 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:43:48.035 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:43:48.036 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-08-17T02:43:48.037 INFO:teuthology.orchestra.run.smithi026.stdout:Install 121 Packages 2024-08-17T02:43:48.038 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 12 Packages 2024-08-17T02:43:48.038 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:43:48.038 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 206 M 2024-08-17T02:43:48.038 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-08-17T02:43:48.393 INFO:teuthology.orchestra.run.smithi002.stdout:(8/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 19 MB/s | 14 MB 00:00 2024-08-17T02:43:48.635 INFO:teuthology.orchestra.run.smithi002.stdout:(9/133): ceph-common-17.2.7-1375.g2577e813.el9. 13 MB/s | 22 MB 00:01 2024-08-17T02:43:48.653 INFO:teuthology.orchestra.run.smithi026.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 35 kB/s | 6.5 kB 00:00 2024-08-17T02:43:48.677 INFO:teuthology.orchestra.run.smithi002.stdout:(10/133): ceph-selinux-17.2.7-1375.g2577e813.el 89 kB/s | 25 kB 00:00 2024-08-17T02:43:48.719 INFO:teuthology.orchestra.run.smithi002.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 5.1 MB/s | 215 kB 00:00 2024-08-17T02:43:48.844 INFO:teuthology.orchestra.run.smithi026.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.1 MB/s | 813 kB 00:00 2024-08-17T02:43:48.911 INFO:teuthology.orchestra.run.smithi002.stdout:(12/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 11 MB/s | 15 MB 00:01 2024-08-17T02:43:48.928 INFO:teuthology.orchestra.run.smithi026.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.6 MB/s | 137 kB 00:00 2024-08-17T02:43:48.953 INFO:teuthology.orchestra.run.smithi002.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 107 kB/s | 25 kB 00:00 2024-08-17T02:43:49.030 INFO:teuthology.orchestra.run.smithi026.stdout:(4/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 8.9 MB/s | 5.0 MB 00:00 2024-08-17T02:43:49.053 INFO:teuthology.orchestra.run.smithi002.stdout:(14/133): libcephsqlite-17.2.7-1375.g2577e813.e 1.6 MB/s | 163 kB 00:00 2024-08-17T02:43:49.086 INFO:teuthology.orchestra.run.smithi002.stdout:(15/133): libcephfs2-17.2.7-1375.g2577e813.el9. 3.6 MB/s | 636 kB 00:00 2024-08-17T02:43:49.170 INFO:teuthology.orchestra.run.smithi026.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 8.6 MB/s | 2.1 MB 00:00 2024-08-17T02:43:49.195 INFO:teuthology.orchestra.run.smithi002.stdout:(16/133): libradosstriper1-17.2.7-1375.g2577e81 4.1 MB/s | 458 kB 00:00 2024-08-17T02:43:49.488 INFO:teuthology.orchestra.run.smithi026.stdout:(6/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 12 MB/s | 3.9 MB 00:00 2024-08-17T02:43:49.563 INFO:teuthology.orchestra.run.smithi026.stdout:(7/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 2.6 MB/s | 1.4 MB 00:00 2024-08-17T02:43:49.679 INFO:teuthology.orchestra.run.smithi002.stdout:(17/133): librgw2-17.2.7-1375.g2577e813.el9.x86 10 MB/s | 4.9 MB 00:00 2024-08-17T02:43:49.746 INFO:teuthology.orchestra.run.smithi002.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 680 kB/s | 45 kB 00:00 2024-08-17T02:43:49.804 INFO:teuthology.orchestra.run.smithi002.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 2.0 MB/s | 120 kB 00:00 2024-08-17T02:43:49.829 INFO:teuthology.orchestra.run.smithi002.stdout:(20/133): librados-devel-17.2.7-1375.g2577e813. 163 kB/s | 126 kB 00:00 2024-08-17T02:43:49.871 INFO:teuthology.orchestra.run.smithi002.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 2.7 MB/s | 182 kB 00:00 2024-08-17T02:43:49.913 INFO:teuthology.orchestra.run.smithi026.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 16 MB/s | 22 MB 00:01 2024-08-17T02:43:49.922 INFO:teuthology.orchestra.run.smithi002.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 3.9 MB/s | 369 kB 00:00 2024-08-17T02:43:49.947 INFO:teuthology.orchestra.run.smithi026.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 762 kB/s | 25 kB 00:00 2024-08-17T02:43:49.947 INFO:teuthology.orchestra.run.smithi002.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 4.5 MB/s | 344 kB 00:00 2024-08-17T02:43:49.981 INFO:teuthology.orchestra.run.smithi002.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:43:50.073 INFO:teuthology.orchestra.run.smithi002.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 653 kB/s | 82 kB 00:00 2024-08-17T02:43:50.563 INFO:teuthology.orchestra.run.smithi026.stdout:(10/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 14 MB/s | 15 MB 00:01 2024-08-17T02:43:50.632 INFO:teuthology.orchestra.run.smithi002.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 295 kB/s | 165 kB 00:00 2024-08-17T02:43:50.698 INFO:teuthology.orchestra.run.smithi002.stdout:(27/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 4.1 MB/s | 2.9 MB 00:00 2024-08-17T02:43:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 266 kB/s | 24 kB 00:00 2024-08-17T02:43:50.741 INFO:teuthology.orchestra.run.smithi002.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.9 MB/s | 124 kB 00:00 2024-08-17T02:43:50.764 INFO:teuthology.orchestra.run.smithi026.stdout:(11/133): ceph-radosgw-17.2.7-1375.g2577e813.el 12 MB/s | 14 MB 00:01 2024-08-17T02:43:50.789 INFO:teuthology.orchestra.run.smithi026.stdout:(12/133): cephfs-mirror-17.2.7-1375.g2577e813.e 955 kB/s | 215 kB 00:00 2024-08-17T02:43:50.814 INFO:teuthology.orchestra.run.smithi026.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 501 kB/s | 25 kB 00:00 2024-08-17T02:43:50.856 INFO:teuthology.orchestra.run.smithi026.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 9.3 MB/s | 636 kB 00:00 2024-08-17T02:43:50.881 INFO:teuthology.orchestra.run.smithi026.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.4 MB/s | 163 kB 00:00 2024-08-17T02:43:50.923 INFO:teuthology.orchestra.run.smithi026.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 1.9 MB/s | 126 kB 00:00 2024-08-17T02:43:50.957 INFO:teuthology.orchestra.run.smithi026.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 6.0 MB/s | 458 kB 00:00 2024-08-17T02:43:50.957 INFO:teuthology.orchestra.run.smithi002.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 14 MB/s | 3.4 MB 00:00 2024-08-17T02:43:51.033 INFO:teuthology.orchestra.run.smithi026.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 598 kB/s | 45 kB 00:00 2024-08-17T02:43:51.042 INFO:teuthology.orchestra.run.smithi002.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.8 MB/s | 240 kB 00:00 2024-08-17T02:43:51.099 INFO:teuthology.orchestra.run.smithi026.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.8 MB/s | 120 kB 00:00 2024-08-17T02:43:51.108 INFO:teuthology.orchestra.run.smithi002.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 715 kB/s | 47 kB 00:00 2024-08-17T02:43:51.183 INFO:teuthology.orchestra.run.smithi026.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 2.1 MB/s | 182 kB 00:00 2024-08-17T02:43:51.183 INFO:teuthology.orchestra.run.smithi002.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 194 kB/s | 15 kB 00:00 2024-08-17T02:43:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:(34/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.5 MB/s | 269 kB 00:00 2024-08-17T02:43:51.275 INFO:teuthology.orchestra.run.smithi026.stdout:(21/133): librgw2-17.2.7-1375.g2577e813.el9.x86 14 MB/s | 4.9 MB 00:00 2024-08-17T02:43:51.309 INFO:teuthology.orchestra.run.smithi026.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 2.9 MB/s | 369 kB 00:00 2024-08-17T02:43:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:(35/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:43:51.351 INFO:teuthology.orchestra.run.smithi026.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 4.5 MB/s | 344 kB 00:00 2024-08-17T02:43:51.359 INFO:teuthology.orchestra.run.smithi002.stdout:(36/133): cephfs-top-17.2.7-1375.g2577e813.el9. 363 kB/s | 18 kB 00:00 2024-08-17T02:43:51.393 INFO:teuthology.orchestra.run.smithi026.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.4 MB/s | 116 kB 00:00 2024-08-17T02:43:51.472 INFO:teuthology.orchestra.run.smithi002.stdout:(37/133): fuse-2.9.9-16.el9.x86_64.rpm 872 kB/s | 80 kB 00:00 2024-08-17T02:43:51.473 INFO:teuthology.orchestra.run.smithi026.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.2 MB/s | 82 kB 00:00 2024-08-17T02:43:51.473 INFO:teuthology.orchestra.run.smithi026.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:43:51.543 INFO:teuthology.orchestra.run.smithi026.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 327 kB/s | 24 kB 00:00 2024-08-17T02:43:51.560 INFO:teuthology.orchestra.run.smithi002.stdout:(38/133): libgfortran-11.4.1-3.el9.x86_64.rpm 7.3 MB/s | 803 kB 00:00 2024-08-17T02:43:51.602 INFO:teuthology.orchestra.run.smithi002.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-08-17T02:43:51.602 INFO:teuthology.orchestra.run.smithi026.stdout:(28/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 14 MB/s | 2.9 MB 00:00 2024-08-17T02:43:51.627 INFO:teuthology.orchestra.run.smithi026.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.5 MB/s | 124 kB 00:00 2024-08-17T02:43:51.644 INFO:teuthology.orchestra.run.smithi002.stdout:(40/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-08-17T02:43:51.711 INFO:teuthology.orchestra.run.smithi002.stdout:(41/133): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-08-17T02:43:51.753 INFO:teuthology.orchestra.run.smithi002.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-08-17T02:43:51.794 INFO:teuthology.orchestra.run.smithi002.stdout:(43/133): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-08-17T02:43:51.836 INFO:teuthology.orchestra.run.smithi002.stdout:(44/133): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-08-17T02:43:51.878 INFO:teuthology.orchestra.run.smithi002.stdout:(45/133): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-08-17T02:43:51.987 INFO:teuthology.orchestra.run.smithi002.stdout:(46/133): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-08-17T02:43:52.036 INFO:teuthology.orchestra.run.smithi026.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 7.7 MB/s | 3.4 MB 00:00 2024-08-17T02:43:52.086 INFO:teuthology.orchestra.run.smithi026.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.7 MB/s | 240 kB 00:00 2024-08-17T02:43:52.087 INFO:teuthology.orchestra.run.smithi002.stdout:(47/133): ceph-mgr-diskprediction-local-17.2.7- 5.5 MB/s | 7.4 MB 00:01 2024-08-17T02:43:52.121 INFO:teuthology.orchestra.run.smithi002.stdout:(48/133): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-08-17T02:43:52.186 INFO:teuthology.orchestra.run.smithi026.stdout:(32/133): ceph-mgr-diskprediction-local-17.2.7- 13 MB/s | 7.4 MB 00:00 2024-08-17T02:43:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:(49/133): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-08-17T02:43:52.212 INFO:teuthology.orchestra.run.smithi026.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 379 kB/s | 47 kB 00:00 2024-08-17T02:43:52.213 INFO:teuthology.orchestra.run.smithi002.stdout:(50/133): elfutils-libelf-devel-0.191-4.el9.x86 173 kB/s | 22 kB 00:00 2024-08-17T02:43:52.237 INFO:teuthology.orchestra.run.smithi026.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 292 kB/s | 15 kB 00:00 2024-08-17T02:43:52.239 INFO:teuthology.orchestra.run.smithi002.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 648 kB/s | 33 kB 00:00 2024-08-17T02:43:52.262 INFO:teuthology.orchestra.run.smithi026.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 5.2 MB/s | 269 kB 00:00 2024-08-17T02:43:52.288 INFO:teuthology.orchestra.run.smithi026.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:43:52.289 INFO:teuthology.orchestra.run.smithi002.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-08-17T02:43:52.313 INFO:teuthology.orchestra.run.smithi026.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 363 kB/s | 18 kB 00:00 2024-08-17T02:43:52.347 INFO:teuthology.orchestra.run.smithi002.stdout:(53/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-08-17T02:43:52.373 INFO:teuthology.orchestra.run.smithi002.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-08-17T02:43:52.406 INFO:teuthology.orchestra.run.smithi002.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-17T02:43:52.432 INFO:teuthology.orchestra.run.smithi002.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-08-17T02:43:52.474 INFO:teuthology.orchestra.run.smithi002.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 9.6 MB/s | 662 kB 00:00 2024-08-17T02:43:52.488 INFO:teuthology.orchestra.run.smithi026.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 399 kB/s | 80 kB 00:00 2024-08-17T02:43:52.524 INFO:teuthology.orchestra.run.smithi002.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-08-17T02:43:52.559 INFO:teuthology.orchestra.run.smithi002.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 306 kB/s | 25 kB 00:00 2024-08-17T02:43:52.583 INFO:teuthology.orchestra.run.smithi002.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-08-17T02:43:52.616 INFO:teuthology.orchestra.run.smithi002.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-17T02:43:52.642 INFO:teuthology.orchestra.run.smithi002.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-08-17T02:43:52.955 INFO:teuthology.orchestra.run.smithi026.stdout:(39/133): ceph-test-17.2.7-1375.g2577e813.el9.x 16 MB/s | 48 MB 00:03 2024-08-17T02:43:52.980 INFO:teuthology.orchestra.run.smithi026.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 397 kB/s | 195 kB 00:00 2024-08-17T02:43:53.056 INFO:teuthology.orchestra.run.smithi026.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-08-17T02:43:53.122 INFO:teuthology.orchestra.run.smithi026.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-17T02:43:53.156 INFO:teuthology.orchestra.run.smithi026.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-08-17T02:43:53.159 INFO:teuthology.orchestra.run.smithi002.stdout:(63/133): ceph-test-17.2.7-1375.g2577e813.el9.x 11 MB/s | 48 MB 00:04 2024-08-17T02:43:53.190 INFO:teuthology.orchestra.run.smithi026.stdout:(44/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-08-17T02:43:53.215 INFO:teuthology.orchestra.run.smithi026.stdout:(45/133): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-08-17T02:43:53.240 INFO:teuthology.orchestra.run.smithi026.stdout:(46/133): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-08-17T02:43:53.268 INFO:teuthology.orchestra.run.smithi002.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-08-17T02:43:53.274 INFO:teuthology.orchestra.run.smithi026.stdout:(47/133): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-08-17T02:43:53.343 INFO:teuthology.orchestra.run.smithi002.stdout:(65/133): openblas-openmp-0.3.21-2.el9.x86_64.r 6.5 MB/s | 4.7 MB 00:00 2024-08-17T02:43:53.368 INFO:teuthology.orchestra.run.smithi002.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-08-17T02:43:53.393 INFO:teuthology.orchestra.run.smithi002.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-08-17T02:43:53.410 INFO:teuthology.orchestra.run.smithi002.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 612 kB/s | 26 kB 00:00 2024-08-17T02:43:53.452 INFO:teuthology.orchestra.run.smithi002.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-08-17T02:43:53.486 INFO:teuthology.orchestra.run.smithi002.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-08-17T02:43:53.511 INFO:teuthology.orchestra.run.smithi002.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-08-17T02:43:53.566 INFO:teuthology.orchestra.run.smithi026.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 74 kB/s | 22 kB 00:00 2024-08-17T02:43:53.570 INFO:teuthology.orchestra.run.smithi002.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-08-17T02:43:53.670 INFO:teuthology.orchestra.run.smithi002.stdout:(73/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-08-17T02:43:53.703 INFO:teuthology.orchestra.run.smithi002.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-08-17T02:43:53.729 INFO:teuthology.orchestra.run.smithi002.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-17T02:43:53.754 INFO:teuthology.orchestra.run.smithi002.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-08-17T02:43:53.779 INFO:teuthology.orchestra.run.smithi002.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-17T02:43:53.841 INFO:teuthology.orchestra.run.smithi026.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-08-17T02:43:53.880 INFO:teuthology.orchestra.run.smithi002.stdout:(78/133): python3-babel-2.9.1-2.el9.noarch.rpm 8.3 MB/s | 6.0 MB 00:00 2024-08-17T02:43:53.905 INFO:teuthology.orchestra.run.smithi002.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 407 kB/s | 51 kB 00:00 2024-08-17T02:43:53.908 INFO:teuthology.orchestra.run.smithi026.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-08-17T02:43:53.930 INFO:teuthology.orchestra.run.smithi002.stdout:(80/133): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-08-17T02:43:53.955 INFO:teuthology.orchestra.run.smithi002.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 713 kB/s | 54 kB 00:00 2024-08-17T02:43:53.989 INFO:teuthology.orchestra.run.smithi002.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 715 kB/s | 42 kB 00:00 2024-08-17T02:43:54.032 INFO:teuthology.orchestra.run.smithi002.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-08-17T02:43:54.057 INFO:teuthology.orchestra.run.smithi002.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.4 MB/s | 96 kB 00:00 2024-08-17T02:43:54.082 INFO:teuthology.orchestra.run.smithi002.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:43:54.092 INFO:teuthology.orchestra.run.smithi026.stdout:(51/133): flex-2.6.4-9.el9.x86_64.rpm 597 kB/s | 313 kB 00:00 2024-08-17T02:43:54.117 INFO:teuthology.orchestra.run.smithi026.stdout:(52/133): flexiblas-3.0.4-8.el9.x86_64.rpm 119 kB/s | 33 kB 00:00 2024-08-17T02:43:54.141 INFO:teuthology.orchestra.run.smithi002.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 537 kB/s | 45 kB 00:00 2024-08-17T02:43:54.208 INFO:teuthology.orchestra.run.smithi002.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.4 MB/s | 309 kB 00:00 2024-08-17T02:43:54.241 INFO:teuthology.orchestra.run.smithi002.stdout:(88/133): liboath-2.6.7-2.el9.x86_64.rpm 498 kB/s | 49 kB 00:00 2024-08-17T02:43:54.266 INFO:teuthology.orchestra.run.smithi002.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-08-17T02:43:54.317 INFO:teuthology.orchestra.run.smithi026.stdout:(53/133): libaio-devel-0.3.111-13.el9.x86_64.rp 56 kB/s | 11 kB 00:00 2024-08-17T02:43:54.325 INFO:teuthology.orchestra.run.smithi002.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 747 kB/s | 43 kB 00:00 2024-08-17T02:43:54.350 INFO:teuthology.orchestra.run.smithi002.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:43:54.368 INFO:teuthology.orchestra.run.smithi026.stdout:(54/133): flexiblas-openblas-openmp-3.0.4-8.el9 66 kB/s | 18 kB 00:00 2024-08-17T02:43:54.376 INFO:teuthology.orchestra.run.smithi002.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 569 kB/s | 14 kB 00:00 2024-08-17T02:43:54.409 INFO:teuthology.orchestra.run.smithi002.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 5.1 MB/s | 172 kB 00:00 2024-08-17T02:43:54.435 INFO:teuthology.orchestra.run.smithi002.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 2.8 MB/s | 548 kB 00:00 2024-08-17T02:43:54.468 INFO:teuthology.orchestra.run.smithi002.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:43:54.493 INFO:teuthology.orchestra.run.smithi002.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-08-17T02:43:54.519 INFO:teuthology.orchestra.run.smithi002.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.2 MB/s | 358 kB 00:00 2024-08-17T02:43:54.544 INFO:teuthology.orchestra.run.smithi002.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 351 kB/s | 18 kB 00:00 2024-08-17T02:43:54.569 INFO:teuthology.orchestra.run.smithi002.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 464 kB/s | 23 kB 00:00 2024-08-17T02:43:54.595 INFO:teuthology.orchestra.run.smithi002.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-17T02:43:54.620 INFO:teuthology.orchestra.run.smithi002.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-08-17T02:43:54.637 INFO:teuthology.orchestra.run.smithi002.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 218 kB/s | 9.0 kB 00:00 2024-08-17T02:43:54.654 INFO:teuthology.orchestra.run.smithi002.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2024-08-17T02:43:54.670 INFO:teuthology.orchestra.run.smithi002.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-08-17T02:43:54.696 INFO:teuthology.orchestra.run.smithi002.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:43:54.713 INFO:teuthology.orchestra.run.smithi002.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-17T02:43:54.743 INFO:teuthology.orchestra.run.smithi026.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 377 kB/s | 160 kB 00:00 2024-08-17T02:43:54.746 INFO:teuthology.orchestra.run.smithi002.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:43:54.768 INFO:teuthology.orchestra.run.smithi026.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 113 kB/s | 45 kB 00:00 2024-08-17T02:43:54.772 INFO:teuthology.orchestra.run.smithi002.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-08-17T02:43:54.797 INFO:teuthology.orchestra.run.smithi002.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-08-17T02:43:54.814 INFO:teuthology.orchestra.run.smithi002.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.9 MB/s | 31 kB 00:00 2024-08-17T02:43:54.827 INFO:teuthology.orchestra.run.smithi026.stdout:(57/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-08-17T02:43:54.848 INFO:teuthology.orchestra.run.smithi002.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-08-17T02:43:54.882 INFO:teuthology.orchestra.run.smithi002.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-08-17T02:43:54.907 INFO:teuthology.orchestra.run.smithi002.stdout:(113/133): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-08-17T02:43:54.932 INFO:teuthology.orchestra.run.smithi002.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 717 kB/s | 36 kB 00:00 2024-08-17T02:43:54.958 INFO:teuthology.orchestra.run.smithi002.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-08-17T02:43:54.983 INFO:teuthology.orchestra.run.smithi002.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-08-17T02:43:55.008 INFO:teuthology.orchestra.run.smithi002.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:43:55.033 INFO:teuthology.orchestra.run.smithi002.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-08-17T02:43:55.067 INFO:teuthology.orchestra.run.smithi002.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-17T02:43:55.094 INFO:teuthology.orchestra.run.smithi026.stdout:(58/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 95 kB/s | 25 kB 00:00 2024-08-17T02:43:55.125 INFO:teuthology.orchestra.run.smithi002.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:43:55.336 INFO:teuthology.orchestra.run.smithi026.stdout:(59/133): libtool-2.4.6-46.el9.x86_64.rpm 1.0 MB/s | 581 kB 00:00 2024-08-17T02:43:55.369 INFO:teuthology.orchestra.run.smithi026.stdout:(60/133): librdkafka-1.6.1-102.el9.x86_64.rpm 1.0 MB/s | 662 kB 00:00 2024-08-17T02:43:55.384 INFO:teuthology.orchestra.run.smithi002.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:43:55.436 INFO:teuthology.orchestra.run.smithi026.stdout:(61/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-08-17T02:43:55.501 INFO:teuthology.orchestra.run.smithi002.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 7.1 MB/s | 3.1 MB 00:00 2024-08-17T02:43:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:(123/133): NetworkManager-1.48.2-2.el9.x86_64.r 9.9 MB/s | 2.3 MB 00:00 2024-08-17T02:43:55.660 INFO:teuthology.orchestra.run.smithi002.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 991 kB/s | 41 kB 00:00 2024-08-17T02:43:55.661 INFO:teuthology.orchestra.run.smithi026.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 121 kB/s | 35 kB 00:00 2024-08-17T02:43:55.727 INFO:teuthology.orchestra.run.smithi002.stdout:(125/133): librbd1-17.2.7-1375.g2577e813.el9.x8 4.9 MB/s | 2.9 MB 00:00 2024-08-17T02:43:55.752 INFO:teuthology.orchestra.run.smithi002.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 2.6 MB/s | 247 kB 00:00 2024-08-17T02:43:55.802 INFO:teuthology.orchestra.run.smithi002.stdout:(127/133): NetworkManager-libnm-1.48.2-2.el9.x8 6.0 MB/s | 1.8 MB 00:00 2024-08-17T02:43:55.828 INFO:teuthology.orchestra.run.smithi002.stdout:(128/133): elfutils-debuginfod-client-0.191-4.e 366 kB/s | 37 kB 00:00 2024-08-17T02:43:55.853 INFO:teuthology.orchestra.run.smithi002.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 2.0 MB/s | 207 kB 00:00 2024-08-17T02:43:55.878 INFO:teuthology.orchestra.run.smithi002.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 3.4 MB/s | 260 kB 00:00 2024-08-17T02:43:55.879 INFO:teuthology.orchestra.run.smithi026.stdout:(63/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 539 kB/s | 292 kB 00:00 2024-08-17T02:43:55.945 INFO:teuthology.orchestra.run.smithi002.stdout:(131/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-08-17T02:43:55.979 INFO:teuthology.orchestra.run.smithi002.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-08-17T02:43:56.020 INFO:teuthology.orchestra.run.smithi002.stdout:(133/133): openssl-3.2.2-2.el9.x86_64.rpm 7.0 MB/s | 1.4 MB 00:00 2024-08-17T02:43:56.025 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:43:56.025 INFO:teuthology.orchestra.run.smithi002.stdout:Total 21 MB/s | 206 MB 00:09 2024-08-17T02:43:56.445 INFO:teuthology.orchestra.run.smithi026.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 4.7 MB/s | 4.7 MB 00:01 2024-08-17T02:43:56.604 INFO:teuthology.orchestra.run.smithi026.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-08-17T02:43:56.912 INFO:teuthology.orchestra.run.smithi026.stdout:(66/133): python3-babel-2.9.1-2.el9.noarch.rpm 5.8 MB/s | 6.0 MB 00:01 2024-08-17T02:43:57.029 INFO:teuthology.orchestra.run.smithi026.stdout:(67/133): python3-devel-3.9.18-3.el9.x86_64.rpm 418 kB/s | 244 kB 00:00 2024-08-17T02:43:57.105 INFO:teuthology.orchestra.run.smithi026.stdout:(68/133): python3-jinja2-2.11.3-6.el9.noarch.rp 496 kB/s | 248 kB 00:00 2024-08-17T02:43:57.180 INFO:teuthology.orchestra.run.smithi026.stdout:(69/133): python3-jsonpatch-1.21-16.el9.noarch. 96 kB/s | 26 kB 00:00 2024-08-17T02:43:57.305 INFO:teuthology.orchestra.run.smithi026.stdout:(70/133): python3-jsonpointer-2.0-4.el9.noarch. 69 kB/s | 19 kB 00:00 2024-08-17T02:43:57.464 INFO:teuthology.orchestra.run.smithi026.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 122 kB/s | 35 kB 00:00 2024-08-17T02:43:57.614 INFO:teuthology.orchestra.run.smithi026.stdout:(72/133): python3-mako-1.1.4-6.el9.noarch.rpm 338 kB/s | 172 kB 00:00 2024-08-17T02:43:57.765 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-08-17T02:43:57.972 INFO:teuthology.orchestra.run.smithi026.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 493 kB/s | 250 kB 00:00 2024-08-17T02:43:57.995 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-08-17T02:43:57.995 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-08-17T02:43:58.123 INFO:teuthology.orchestra.run.smithi026.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 437 kB/s | 222 kB 00:00 2024-08-17T02:43:58.340 INFO:teuthology.orchestra.run.smithi026.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 210 kB/s | 77 kB 00:00 2024-08-17T02:43:58.424 INFO:teuthology.orchestra.run.smithi026.stdout:(76/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-08-17T02:43:58.457 INFO:teuthology.orchestra.run.smithi026.stdout:(77/133): python3-prettytable-0.7.2-27.el9.noar 126 kB/s | 42 kB 00:00 2024-08-17T02:43:58.807 INFO:teuthology.orchestra.run.smithi026.stdout:(78/133): python3-pytz-2021.1-5.el9.noarch.rpm 146 kB/s | 51 kB 00:00 2024-08-17T02:43:58.866 INFO:teuthology.orchestra.run.smithi026.stdout:(79/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 302 kB/s | 159 kB 00:00 2024-08-17T02:43:58.941 INFO:teuthology.orchestra.run.smithi026.stdout:(80/133): python3-pyasn1-modules-0.4.8-6.el9.no 539 kB/s | 279 kB 00:00 2024-08-17T02:43:59.158 INFO:teuthology.orchestra.run.smithi026.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 153 kB/s | 54 kB 00:00 2024-08-17T02:43:59.208 INFO:teuthology.orchestra.run.smithi026.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 156 kB/s | 42 kB 00:00 2024-08-17T02:43:59.558 INFO:teuthology.orchestra.run.smithi026.stdout:(83/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 273 kB/s | 96 kB 00:00 2024-08-17T02:43:59.659 INFO:teuthology.orchestra.run.smithi026.stdout:(84/133): socat-1.7.4.1-6.el9.x86_64.rpm 608 kB/s | 304 kB 00:00 2024-08-17T02:43:59.993 INFO:teuthology.orchestra.run.smithi026.stdout:(85/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 134 kB/s | 45 kB 00:00 2024-08-17T02:44:00.088 INFO:teuthology.orchestra.run.smithi026.stdout:(86/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 3.2 MB/s | 309 kB 00:00 2024-08-17T02:44:00.110 INFO:teuthology.orchestra.run.smithi026.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 2.2 MB/s | 49 kB 00:00 2024-08-17T02:44:00.135 INFO:teuthology.orchestra.run.smithi026.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-17T02:44:00.168 INFO:teuthology.orchestra.run.smithi026.stdout:(89/133): python3-asyncssh-2.13.2-5.el9.noarch. 16 MB/s | 548 kB 00:00 2024-08-17T02:44:00.194 INFO:teuthology.orchestra.run.smithi026.stdout:(90/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 100 kB/s | 64 kB 00:00 2024-08-17T02:44:00.196 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-08-17T02:44:00.196 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-08-17T02:44:00.219 INFO:teuthology.orchestra.run.smithi026.stdout:(91/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 865 kB/s | 43 kB 00:00 2024-08-17T02:44:00.278 INFO:teuthology.orchestra.run.smithi026.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 523 kB/s | 14 kB 00:00 2024-08-17T02:44:00.311 INFO:teuthology.orchestra.run.smithi026.stdout:(93/133): python3-cachetools-4.2.4-1.el9.noarch 275 kB/s | 32 kB 00:00 2024-08-17T02:44:00.336 INFO:teuthology.orchestra.run.smithi026.stdout:(94/133): python3-cheroot-8.6.0-4.el9.noarch.rp 3.0 MB/s | 172 kB 00:00 2024-08-17T02:44:00.370 INFO:teuthology.orchestra.run.smithi026.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:44:00.395 INFO:teuthology.orchestra.run.smithi026.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-08-17T02:44:00.421 INFO:teuthology.orchestra.run.smithi026.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.2 MB/s | 358 kB 00:00 2024-08-17T02:44:00.446 INFO:teuthology.orchestra.run.smithi026.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 351 kB/s | 18 kB 00:00 2024-08-17T02:44:00.471 INFO:teuthology.orchestra.run.smithi026.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 463 kB/s | 23 kB 00:00 2024-08-17T02:44:00.496 INFO:teuthology.orchestra.run.smithi026.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-17T02:44:00.522 INFO:teuthology.orchestra.run.smithi026.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-08-17T02:44:00.547 INFO:teuthology.orchestra.run.smithi026.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:44:00.572 INFO:teuthology.orchestra.run.smithi026.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 816 kB/s | 41 kB 00:00 2024-08-17T02:44:00.598 INFO:teuthology.orchestra.run.smithi026.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:44:00.615 INFO:teuthology.orchestra.run.smithi026.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-08-17T02:44:00.648 INFO:teuthology.orchestra.run.smithi026.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-08-17T02:44:00.682 INFO:teuthology.orchestra.run.smithi026.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-08-17T02:44:00.707 INFO:teuthology.orchestra.run.smithi026.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-08-17T02:44:00.741 INFO:teuthology.orchestra.run.smithi026.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-08-17T02:44:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:44:00.800 INFO:teuthology.orchestra.run.smithi026.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.0 MB/s | 1.0 MB 00:00 2024-08-17T02:44:00.825 INFO:teuthology.orchestra.run.smithi026.stdout:(112/133): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-08-17T02:44:00.850 INFO:teuthology.orchestra.run.smithi026.stdout:(113/133): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-17T02:44:00.876 INFO:teuthology.orchestra.run.smithi026.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-08-17T02:44:00.901 INFO:teuthology.orchestra.run.smithi026.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:44:00.935 INFO:teuthology.orchestra.run.smithi026.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-08-17T02:44:00.968 INFO:teuthology.orchestra.run.smithi026.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-17T02:44:00.985 INFO:teuthology.orchestra.run.smithi026.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-08-17T02:44:01.019 INFO:teuthology.orchestra.run.smithi026.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-17T02:44:01.077 INFO:teuthology.orchestra.run.smithi026.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:44:01.328 INFO:teuthology.orchestra.run.smithi026.stdout:(121/133): librados2-17.2.7-1375.g2577e813.el9. 10 MB/s | 3.1 MB 00:00 2024-08-17T02:44:01.503 INFO:teuthology.orchestra.run.smithi026.stdout:(122/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-08-17T02:44:01.570 INFO:teuthology.orchestra.run.smithi026.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 6.0 MB/s | 2.9 MB 00:00 2024-08-17T02:44:01.620 INFO:teuthology.orchestra.run.smithi026.stdout:(124/133): NetworkManager-1.48.2-2.el9.x86_64.r 7.9 MB/s | 2.3 MB 00:00 2024-08-17T02:44:01.646 INFO:teuthology.orchestra.run.smithi026.stdout:(125/133): NetworkManager-team-1.48.2-2.el9.x86 544 kB/s | 41 kB 00:00 2024-08-17T02:44:01.696 INFO:teuthology.orchestra.run.smithi026.stdout:(126/133): NetworkManager-libnm-1.48.2-2.el9.x8 9.4 MB/s | 1.8 MB 00:00 2024-08-17T02:44:01.721 INFO:teuthology.orchestra.run.smithi026.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 488 kB/s | 37 kB 00:00 2024-08-17T02:44:01.746 INFO:teuthology.orchestra.run.smithi026.stdout:(128/133): NetworkManager-tui-1.48.2-2.el9.x86_ 1.9 MB/s | 247 kB 00:00 2024-08-17T02:44:01.772 INFO:teuthology.orchestra.run.smithi026.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 2.7 MB/s | 207 kB 00:00 2024-08-17T02:44:01.797 INFO:teuthology.orchestra.run.smithi026.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 3.4 MB/s | 260 kB 00:00 2024-08-17T02:44:01.839 INFO:teuthology.orchestra.run.smithi026.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-08-17T02:44:01.889 INFO:teuthology.orchestra.run.smithi026.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-08-17T02:44:01.947 INFO:teuthology.orchestra.run.smithi026.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2024-08-17T02:44:01.952 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:44:01.952 INFO:teuthology.orchestra.run.smithi026.stdout:Total 15 MB/s | 206 MB 00:13 2024-08-17T02:44:03.699 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-08-17T02:44:03.930 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-08-17T02:44:03.930 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-08-17T02:44:05.898 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-08-17T02:44:05.984 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:44:06.035 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:44:06.110 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:44:06.132 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-08-17T02:44:06.132 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-08-17T02:44:06.154 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:44:06.185 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:44:06.250 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:44:06.603 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:44:06.702 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:06.891 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:06.920 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:07.090 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:07.595 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:44:07.621 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:07.707 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:07.806 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:44:07.831 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:07.978 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:08.007 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:44:08.303 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:44:08.691 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:44:08.904 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:44:09.033 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:44:09.143 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:09.276 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:09.626 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:09.674 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:44:09.719 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:44:09.803 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:44:09.843 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:44:09.876 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:44:09.977 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:44:10.047 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:44:10.080 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:44:10.127 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:44:10.225 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:44:10.259 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:44:10.305 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:44:10.401 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:44:10.589 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:44:10.653 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:44:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:44:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:44:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:44:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:44:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:44:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:44:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:44:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:44:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:44:12.007 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-08-17T02:44:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:44:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:44:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:44:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:44:12.163 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:44:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:44:12.229 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:44:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:44:12.273 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:44:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:44:12.303 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:44:12.365 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:44:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:44:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:44:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:44:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:44:12.713 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:44:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:44:12.812 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:44:12.813 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:12.846 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:44:12.879 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:44:12.918 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:44:12.950 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:12.954 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:44:12.980 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:12.990 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:44:13.022 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:44:13.067 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:44:13.099 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:44:13.107 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:13.142 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:44:13.193 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:44:13.322 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:44:13.383 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:44:13.632 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:44:13.657 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:13.761 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:13.841 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:44:13.867 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:13.990 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:14.018 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:44:14.166 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:44:14.319 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:44:14.383 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:44:14.417 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:44:14.478 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:44:14.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:44:14.591 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:44:14.657 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:44:14.735 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:44:14.828 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:44:14.853 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:14.863 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:44:14.943 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:14.970 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:44:15.318 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:44:15.389 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:44:15.437 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:44:15.522 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:44:15.569 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:44:15.603 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:44:15.696 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:44:15.757 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:44:15.798 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:44:15.809 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:44:15.845 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:44:15.934 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:44:15.963 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:44:15.968 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:44:16.015 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:44:16.111 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:44:16.287 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:44:16.354 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:44:17.044 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:44:17.148 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:44:17.184 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:44:17.230 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:44:17.274 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:44:17.313 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:44:17.588 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:44:17.612 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:44:17.697 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:44:17.701 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:44:17.737 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:44:17.769 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:44:17.770 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:44:17.854 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:44:17.897 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:44:17.933 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:44:17.993 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:44:18.047 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:44:18.106 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:44:18.114 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:44:18.156 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:18.274 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:18.285 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:44:18.300 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:44:18.338 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:44:18.381 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:44:18.522 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:44:18.563 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:44:18.606 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:44:18.670 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:44:18.706 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:44:18.745 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:44:18.782 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:44:18.825 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:44:18.861 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:44:18.902 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:44:18.934 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:44:18.969 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:44:19.021 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:44:19.149 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:44:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:44:20.177 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:44:20.235 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:44:20.269 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:44:20.390 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:44:20.443 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:44:20.687 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:44:20.731 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:44:20.828 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:44:21.246 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:21.298 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:21.696 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:44:21.843 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:44:21.917 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:21.993 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:22.127 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:22.167 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:44:22.167 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:44:22.167 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:22.168 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:44:23.570 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:44:23.678 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:44:23.715 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:44:23.747 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:44:24.085 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:44:24.125 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:24.251 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:44:24.277 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:44:27.052 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:27.098 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:27.732 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:44:27.777 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:27.911 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:44:27.912 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:44:27.912 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:44:27.912 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:27.944 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:44:34.472 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-08-17T02:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-08-17T02:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-08-17T02:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-08-17T02:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-08-17T02:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-08-17T02:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-08-17T02:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:34.791 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:44:34.827 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:44:34.827 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:34.827 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:44:34.827 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:36.333 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:44:36.393 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:44:36.393 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:36.393 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:44:36.393 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:44:36.393 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:44:36.393 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:36.625 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:44:36.677 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:44:36.677 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:36.677 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:44:36.677 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:44:36.677 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:44:36.678 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:37.101 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:44:37.153 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:44:37.153 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:37.153 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:44:37.153 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:44:37.153 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:44:37.153 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:37.293 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:44:37.355 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:44:37.428 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:44:37.664 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:44:37.722 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:44:37.818 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:44:37.937 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:44:38.115 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:44:38.169 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:44:38.193 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:44:38.229 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:44:38.270 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:44:38.295 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:44:38.807 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:44:38.853 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:44:38.883 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:44:38.946 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:44:38.975 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:44:40.192 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:44:40.258 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:44:40.446 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:44:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2024-08-17T02:44:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2024-08-17T02:44:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2024-08-17T02:44:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2024-08-17T02:44:40.446 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2024-08-17T02:44:40.447 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /root 2024-08-17T02:44:40.447 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2024-08-17T02:44:40.447 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:40.663 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:44:40.700 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:44:40.700 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:40.700 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:44:40.700 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:41.406 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:44:41.435 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:44:41.577 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:44:41.746 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:44:41.779 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:44:41.831 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:44:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:44:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:44:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:44:41.831 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:44:41.907 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:44:42.009 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:44:42.079 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:44:42.224 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:44:42.283 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:44:42.283 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:42.283 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:44:42.283 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:44:42.284 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:44:42.284 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:42.516 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:44:42.567 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:44:42.567 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:42.567 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:44:42.567 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:44:42.567 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:44:42.568 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:42.992 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:44:43.043 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:44:43.043 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:43.043 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:44:43.043 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:44:43.043 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:44:43.044 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:43.176 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:44:43.237 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:44:43.311 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:44:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:44:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:44:43.548 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:44:43.604 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:44:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:44:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:44:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:44:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:44:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:43.695 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:44:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:44:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:44:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:44:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:43.813 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:44:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:44:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:44:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:44:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:44:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:44:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:44.011 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:44:44.068 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:44:44.093 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:44:44.129 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:44:44.169 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:44:44.194 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:44:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:44:44.281 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:44:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:44:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:44:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:44:44.282 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:44.706 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:44:44.743 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:44:44.782 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:44:44.846 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:44:44.874 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:44:46.105 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:44:46.143 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:44:47.295 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:44:47.326 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:44:47.471 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:44:47.638 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:44:47.662 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:44:47.714 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:44:47.714 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:47.714 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:44:47.714 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:44:47.714 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:44:47.714 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:47.762 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:44:47.788 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:44:47.885 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:44:47.954 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:44:49.304 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:44:49.346 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:44:49.369 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:44:49.391 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:44:49.427 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:44:49.501 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:44:49.506 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:44:49.537 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:44:49.568 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:44:49.600 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:44:49.612 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:44:49.612 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:49.612 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:44:49.612 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:44:49.612 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:44:49.612 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:49.648 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:44:49.782 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:44:49.833 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:44:49.833 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:49.834 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:44:49.834 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:49.891 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:44:49.942 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:44:49.942 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:49.942 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:44:49.942 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:44:49.943 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:44:49.943 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:50.301 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:44:50.352 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:44:50.352 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:44:50.352 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:44:50.352 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:44:50.352 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:44:50.352 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:51.051 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:44:51.317 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:44:51.385 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:44:51.433 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:44:51.547 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:44:51.587 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:44:51.612 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:44:51.638 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:44:51.667 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:44:51.667 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:44:51.766 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:44:51.798 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:44:51.798 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:44:51.917 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:44:51.941 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:44:51.958 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:51.958 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:52.210 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:52.210 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:44:52.322 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:44:52.352 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:44:52.379 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:44:52.454 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:52.696 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:52.697 INFO:teuthology.orchestra.run.smithi002.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:44:52.697 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:55.375 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:44:55.417 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:44:55.462 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:44:55.498 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:44:55.532 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:44:55.566 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:44:55.597 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:44:55.629 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:44:55.677 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:44:57.076 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:44:57.332 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:44:57.388 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:44:57.437 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:44:57.542 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:44:57.575 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:44:57.600 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:44:57.625 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:44:57.654 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:44:57.654 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:44:57.754 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:44:57.786 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:44:57.786 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:44:57.890 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:44:57.891 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:44:57.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:44:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:44:57.895 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:44:57.896 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:44:57.900 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:44:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:44:57.902 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:44:57.920 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:44:57.945 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:57.946 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:58.197 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:44:58.198 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:44:58.308 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:44:58.340 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:44:58.367 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:44:58.443 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:58.655 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:58.655 INFO:teuthology.orchestra.run.smithi026.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:44:58.655 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:44:59.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:44:59.845 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:59.845 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.846 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.848 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:44:59.849 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:44:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:44:59.851 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:44:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:44:59.854 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:44:59.854 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:44:59.854 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:44:59.854 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:44:59.854 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:44:59.854 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:44:59.854 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:44:59.854 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:44:59.855 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.856 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:44:59.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:44:59.858 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:44:59.859 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:44:59.859 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:44:59.859 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-08-17T02:45:00.476 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:03.860 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:45:03.860 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:45:03.860 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:45:03.860 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:45:03.860 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:45:03.860 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:45:03.860 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:45:03.861 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:45:03.862 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:45:03.862 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:45:03.862 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:45:03.862 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:45:03.862 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:45:03.874 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:45:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:45:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:45:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:45:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:45:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:45:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:45:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:45:03.876 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:45:03.877 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:45:03.878 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:45:03.879 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:45:03.880 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:45:03.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:45:03.882 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:45:03.883 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:45:03.883 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:45:03.883 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:45:03.883 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:45:03.883 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:45:03.883 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:45:03.883 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:45:03.883 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:45:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:45:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:45:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:45:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:45:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:45:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:45:03.884 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:45:05.827 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:45:05.827 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:05.827 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2024-08-17T02:45:05.827 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:05.827 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:45:05.828 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.829 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.830 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.831 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:45:05.832 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:45:05.833 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:45:05.834 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:45:05.835 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:45:05.836 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:45:05.837 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:45:05.838 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:45:05.839 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:45:05.839 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:45:05.839 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:45:05.839 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:05.839 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-08-17T02:45:06.558 DEBUG:teuthology.parallel:result is None 2024-08-17T02:45:06.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:45:06.697 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:45:06.748 INFO:teuthology.orchestra.run.smithi002.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:45:06.748 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:45:06.748 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:45:06.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:45:06.883 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:45:06.928 INFO:teuthology.orchestra.run.smithi026.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:45:06.928 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:45:06.928 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:45:06.930 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:45:06.930 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:06.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:45:06.995 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:06.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:45:07.054 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:45:07.054 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:07.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:45:07.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:45:07.213 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:07.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:45:07.270 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:45:07.366 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:45:07.366 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:07.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:45:07.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:45:07.522 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:07.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:45:07.580 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:45:07.677 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:45:07.677 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:07.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:45:07.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:45:07.832 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:07.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:45:07.890 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:45:07.991 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:45:08.080 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:45:08.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2024-08-17T02:45:08.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2024-08-17T02:45:08.141 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:45:08.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:45:08.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:45:08.203 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:45:08.203 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:45:08.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:45:08.273 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:45:08.273 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:45:08.273 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:45:08.273 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:08.274 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:45:08.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:08.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:08.532 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:08.532 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:45:08.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:08.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:08.804 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:45:08.805 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:45:08.805 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858292', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsyC7Ohz4uikJ9N5Yd35Dqhfxj7kTlg7+oUxdkBPO3tg/vkxIcAeWAxX0DIoDX6AXhlEiwPgYaNMYz9sOaKruo=', 'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPkwOwDzdQyIaJZOHwSLK1zks4Fhz0Z98dwqBPr/trE2qRxk1wxP1R7JHqK5L7FaWjfAx82LxNOv5ZqCDu0tlw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:10:27', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:45:08.806 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:45:08.810 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:45:08.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:45:08.886 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:45:08.943 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:08.943 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:45:08.978 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:45:08.979 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-08-17T02:45:09.055 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:45:09.055 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:09.055 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 640 Links: 1 2024-08-17T02:45:09.056 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:09.056 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:09.056 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-17 02:44:53.081495642 +0000 2024-08-17T02:45:09.056 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-17 02:42:25.716292189 +0000 2024-08-17T02:45:09.056 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-17 02:42:25.716292189 +0000 2024-08-17T02:45:09.056 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-17 02:42:25.716292189 +0000 2024-08-17T02:45:09.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:45:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-17T02:45:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-17T02:45:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000158064 s, 3.2 MB/s 2024-08-17T02:45:09.151 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:45:09.188 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-08-17T02:45:09.264 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:45:09.264 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:09.264 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 658 Links: 1 2024-08-17T02:45:09.264 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:09.265 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:09.265 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-17 02:44:53.082495620 +0000 2024-08-17T02:45:09.265 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-17 02:42:26.191281639 +0000 2024-08-17T02:45:09.265 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-17 02:42:26.191281639 +0000 2024-08-17T02:45:09.265 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-17 02:42:26.191281639 +0000 2024-08-17T02:45:09.265 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:45:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-17T02:45:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-17T02:45:09.357 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000173903 s, 2.9 MB/s 2024-08-17T02:45:09.360 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:45:09.397 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-08-17T02:45:09.471 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:45:09.471 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:09.472 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-08-17T02:45:09.472 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:09.472 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:09.472 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-17 02:44:53.082495620 +0000 2024-08-17T02:45:09.472 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-17 02:42:26.693270490 +0000 2024-08-17T02:45:09.472 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-17 02:42:26.693270490 +0000 2024-08-17T02:45:09.472 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-17 02:42:26.693270490 +0000 2024-08-17T02:45:09.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:45:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-17T02:45:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-17T02:45:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.00015754 s, 3.2 MB/s 2024-08-17T02:45:09.567 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:45:09.604 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-08-17T02:45:09.680 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:45:09.680 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:09.681 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-08-17T02:45:09.681 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:09.681 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:09.681 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-08-17 02:44:53.083495598 +0000 2024-08-17T02:45:09.681 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-08-17 02:42:27.168259940 +0000 2024-08-17T02:45:09.681 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-08-17 02:42:27.168259940 +0000 2024-08-17T02:45:09.681 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-08-17 02:42:27.168259940 +0000 2024-08-17T02:45:09.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:45:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-08-17T02:45:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-08-17T02:45:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000156058 s, 3.3 MB/s 2024-08-17T02:45:09.777 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:45:09.814 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:09.815 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:09.815 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:45:09.850 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:45:09.851 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2024-08-17T02:45:09.925 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:45:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:09.926 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-08-17T02:45:09.926 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:09.926 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:09.926 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-08-17 02:44:59.025862485 +0000 2024-08-17T02:45:09.926 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-08-17 02:42:33.941148277 +0000 2024-08-17T02:45:09.926 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-08-17 02:42:33.941148277 +0000 2024-08-17T02:45:09.926 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-08-17 02:42:33.941148277 +0000 2024-08-17T02:45:09.926 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:45:10.019 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-08-17T02:45:10.019 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-08-17T02:45:10.019 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000211565 s, 2.4 MB/s 2024-08-17T02:45:10.022 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:45:10.058 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2024-08-17T02:45:10.134 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:45:10.134 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:10.134 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-17T02:45:10.134 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:10.134 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:10.134 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-08-17 02:44:59.026862470 +0000 2024-08-17T02:45:10.134 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-08-17 02:42:34.416141221 +0000 2024-08-17T02:45:10.135 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-08-17 02:42:34.416141221 +0000 2024-08-17T02:45:10.135 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-08-17 02:42:34.416141221 +0000 2024-08-17T02:45:10.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:45:10.227 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-08-17T02:45:10.227 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-08-17T02:45:10.227 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000187159 s, 2.7 MB/s 2024-08-17T02:45:10.230 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:45:10.266 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-08-17 02:44:59.027862455 +0000 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-08-17 02:42:34.857134671 +0000 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-08-17 02:42:34.857134671 +0000 2024-08-17T02:45:10.342 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-08-17 02:42:34.857134671 +0000 2024-08-17T02:45:10.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:45:10.435 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-08-17T02:45:10.435 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-08-17T02:45:10.435 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000178758 s, 2.9 MB/s 2024-08-17T02:45:10.437 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:45:10.474 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2024-08-17T02:45:10.550 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:45:10.550 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:45:10.550 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-08-17T02:45:10.550 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:45:10.550 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:45:10.550 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-08-17 02:44:59.027862455 +0000 2024-08-17T02:45:10.551 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-08-17 02:42:35.329127660 +0000 2024-08-17T02:45:10.551 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-08-17 02:42:35.329127660 +0000 2024-08-17T02:45:10.551 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2024-08-17 02:42:35.329127660 +0000 2024-08-17T02:45:10.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:45:10.644 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-08-17T02:45:10.644 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-08-17T02:45:10.644 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000173822 s, 2.9 MB/s 2024-08-17T02:45:10.646 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:45:10.683 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:10.683 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:45:10.683 INFO:tasks.ceph:Generating config... 2024-08-17T02:45:10.684 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:45:10.684 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:45:10.685 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:45:10.685 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:45:10.685 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:45:10.685 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:45:10.685 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:45:10.685 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:45:10.685 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:45:10.685 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:45:10.685 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:45:10.685 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:45:10.685 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:45:10.685 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:45:10.685 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:45:10.686 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:45:10.686 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:45:10.686 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:45:10.686 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:45:10.686 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:45:10.687 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:45:10.688 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:45:10.688 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:45:10.689 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:45:10.689 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:45:10.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:10.787 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:45:10.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:45:10.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:45:10.929 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.b', '172.21.15.26'), ('mon.c', '[v2:172.21.15.26:3301,v1:172.21.15.26:6790]')] 2024-08-17T02:45:10.930 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2,172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:45:10.931 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:10.931 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:45:10.966 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --add b 172.21.15.26 --addv c '[v2:172.21.15.26:3301,v1:172.21.15.26:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:11.077 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid f19c300a-c18c-4d11-a652-563f33592040 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = octopus 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:fsid f19c300a-c18c-4d11-a652-563f33592040 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2024-08-17T02:45:11.077879+0000 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-08-17T02:45:11.077879+0000 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 15 (octopus) 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.b 2024-08-17T02:45:11.078 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] mon.c 2024-08-17T02:45:11.079 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:45:11.080 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:45:11.115 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f19c300a-c18c-4d11-a652-563f33592040... 2024-08-17T02:45:11.116 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:45:11.159 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:45:11.253 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-08-17T02:45:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2024-08-17T02:45:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:45:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:45:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2024-08-17T02:45:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790]" 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on skipped message = False 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = f19c300a-c18c-4d11-a652-563f33592040 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2024-08-17T02:45:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2024-08-17T02:45:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2024-08-17T02:45:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:45:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:45:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2024-08-17T02:45:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2024-08-17T02:45:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.261 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2024-08-17T02:45:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:45:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2024-08-17T02:45:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-08-17T02:45:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-08-17T02:45:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2024-08-17T02:45:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2024-08-17T02:45:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: debug finisher = 20 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2024-08-17T02:45:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:45:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = "" 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2024-08-17T02:45:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2024-08-17T02:45:11.266 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2024-08-17T02:45:11.266 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2024-08-17T02:45:11.266 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2024-08-17T02:45:11.266 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2024-08-17T02:45:11.266 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2024-08-17T02:45:11.266 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2024-08-17T02:45:11.266 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds balancer = 20 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2024-08-17T02:45:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2024-08-17T02:45:11.268 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2024-08-17T02:45:11.268 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2024-08-17T02:45:11.268 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:45:11.268 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2024-08-17T02:45:11.268 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.268 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2024-08-17T02:45:11.268 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:45:11.269 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2024-08-17T02:45:11.270 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:45:11.271 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.272 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2024-08-17T02:45:11.273 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.273 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2024-08-17T02:45:11.273 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.2,172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790]" 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on skipped message = False 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = f19c300a-c18c-4d11-a652-563f33592040 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:45:11.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:45:11.275 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: bdev async discard = True 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: bdev enable discard = True 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore allocator = bitmap 2024-08-17T02:45:11.276 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 1/20 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 1/20 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 4/10 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-08-17T02:45:11.277 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug finisher = 20 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-08-17T02:45:11.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.279 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2024-08-17T02:45:11.280 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = "" 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-08-17T02:45:11.281 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-08-17T02:45:11.282 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-08-17T02:45:11.284 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:45:11.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:45:11.374 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:45:11.374 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:11.374 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:45:11.409 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:11.409 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:45:11.485 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:45:11.485 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:11.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:45:11.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:45:11.603 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:11.603 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:11.682 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:45:11.682 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:11.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:45:11.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:45:11.761 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:11.761 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:11.836 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:45:11.836 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:45:11.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:45:11.935 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:45:11.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:45:12.046 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:45:12.052 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:45:12.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:45:12.151 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:45:12.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:45:12.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:45:12.313 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:45:12.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:45:12.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:45:12.474 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:45:12.479 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:45:12.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:45:12.634 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:45:12.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:45:12.694 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:45:12.695 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:45:12.777 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:45:12.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:45:12.880 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:45:12.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:45:12.985 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:45:13.012 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:45:13.087 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:45:13.114 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:45:13.114 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:45:13.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:45:13.172 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:13.172 INFO:tasks.ceph:role: osd.0 2024-08-17T02:45:13.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:45:13.173 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:45:13.228 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:13.228 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:13.228 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:13.229 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:13.229 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:13.229 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:13.229 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:13.261 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-08-17T02:45:13.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-08-17T02:45:13.265 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:45:13.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:45:13.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:45:13.468 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:13.468 INFO:tasks.ceph:role: osd.1 2024-08-17T02:45:13.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:45:13.469 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:45:13.523 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:13.523 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:13.523 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:13.524 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:13.524 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:13.524 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:13.524 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:13.556 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-08-17T02:45:13.560 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-08-17T02:45:13.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:45:13.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:45:13.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:13.760 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:13.760 INFO:tasks.ceph:role: osd.2 2024-08-17T02:45:13.760 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:45:13.761 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:45:13.818 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:13.819 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:13.851 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-08-17T02:45:13.853 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-08-17T02:45:13.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:13.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:13.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:14.051 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:14.051 INFO:tasks.ceph:role: osd.3 2024-08-17T02:45:14.052 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:45:14.052 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:45:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:14.107 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:14.108 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:14.108 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:14.108 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:14.108 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:14.108 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:14.141 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-08-17T02:45:14.144 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-08-17T02:45:14.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:14.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:14.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:14.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:14.388+0000 7f917ab882c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:45:14.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:14.389+0000 7f917ab882c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:45:14.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:14.389+0000 7f917ab882c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:45:14.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:14.389+0000 7f917ab882c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:45:14.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:14.389+0000 7f917ab882c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:45:14.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:14.391+0000 7f917ab882c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:45:14.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:14.930+0000 7f917ab882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:15.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:15.701+0000 7f917ab882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:16.474+0000 7f917ab882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:17.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:45:17.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:17.466+0000 7fe50ff232c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:45:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:17.466+0000 7fe50ff232c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:45:17.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:17.466+0000 7fe50ff232c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:45:17.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:17.466+0000 7fe50ff232c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:45:17.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:17.466+0000 7fe50ff232c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:45:17.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:17.468+0000 7fe50ff232c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:45:18.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:18.019+0000 7fe50ff232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:18.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:18.788+0000 7fe50ff232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:19.559+0000 7fe50ff232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:20.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:45:20.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:20.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:20.543+0000 7f1ad843a2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:45:20.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:20.543+0000 7f1ad843a2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:45:20.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:20.543+0000 7f1ad843a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:45:20.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:20.543+0000 7f1ad843a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:45:20.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:20.543+0000 7f1ad843a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:45:20.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:20.545+0000 7f1ad843a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:45:21.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:21.090+0000 7f1ad843a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:21.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:21.860+0000 7f1ad843a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:22.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:22.632+0000 7f1ad843a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:23.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:45:23.518 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:23.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:23.603+0000 7f6822b212c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:45:23.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:23.603+0000 7f6822b212c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:45:23.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:23.603+0000 7f6822b212c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:23.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:23.603+0000 7f6822b212c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:23.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:23.603+0000 7f6822b212c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:45:23.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:23.605+0000 7f6822b212c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:45:24.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:24.146+0000 7f6822b212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:24.912+0000 7f6822b212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:25.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:25.695+0000 7f6822b212c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:26.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:45:26.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:26.663 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:26.663 INFO:tasks.ceph:role: osd.4 2024-08-17T02:45:26.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:45:26.663 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:45:26.721 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:26.721 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:26.721 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:26.721 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:26.722 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:26.722 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:26.722 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:26.722 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:26.722 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:26.722 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:26.755 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-08-17T02:45:26.759 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-08-17T02:45:26.759 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:26.840 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:26.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:26.961 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:26.961 INFO:tasks.ceph:role: osd.5 2024-08-17T02:45:26.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:45:26.961 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:27.017 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:27.018 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:27.055 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-08-17T02:45:27.058 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-08-17T02:45:27.059 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:27.139 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:27.201 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:45:27.259 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:27.259 INFO:tasks.ceph:role: osd.6 2024-08-17T02:45:27.259 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:45:27.259 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:27.315 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:27.349 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-08-17T02:45:27.353 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-08-17T02:45:27.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:45:27.437 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:45:27.501 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:45:27.559 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:45:27.559 INFO:tasks.ceph:role: osd.7 2024-08-17T02:45:27.559 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:45:27.560 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:45:27.618 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:45:27.619 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:45:27.619 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:45:27.619 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:45:27.619 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:45:27.619 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:45:27.620 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:45:27.620 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:45:27.620 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:45:27.620 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:45:27.651 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-08-17T02:45:27.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-08-17T02:45:27.656 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:45:27.740 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:45:27.804 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:27.898+0000 7fdd7b80e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:45:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:27.899+0000 7fdd7b80e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:45:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:27.899+0000 7fdd7b80e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:45:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:27.899+0000 7fdd7b80e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:45:27.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:27.899+0000 7fdd7b80e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:45:27.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:27.901+0000 7fdd7b80e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:45:28.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:28.445+0000 7fdd7b80e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:29.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:29.206+0000 7fdd7b80e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:29.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:29.988+0000 7fdd7b80e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:30.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:45:30.879 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:30.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:30.965+0000 7f94efa0e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:45:30.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:30.966+0000 7f94efa0e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:45:30.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:30.966+0000 7f94efa0e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:45:30.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:30.966+0000 7f94efa0e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:45:30.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:30.966+0000 7f94efa0e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:45:30.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:30.968+0000 7f94efa0e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:45:31.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:31.509+0000 7f94efa0e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:32.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:32.280+0000 7f94efa0e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:33.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:33.054+0000 7f94efa0e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:33.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:45:33.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:34.028+0000 7f71e8c092c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:45:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:34.028+0000 7f71e8c092c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:45:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:34.028+0000 7f71e8c092c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:45:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:34.028+0000 7f71e8c092c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:45:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:34.028+0000 7f71e8c092c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:45:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:34.030+0000 7f71e8c092c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:45:34.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:34.570+0000 7f71e8c092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:35.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:35.341+0000 7f71e8c092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:36.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:36.114+0000 7f71e8c092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:36.942 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:45:37.000 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:37.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:37.084+0000 7fe5157232c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:45:37.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:37.084+0000 7fe5157232c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:45:37.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:37.085+0000 7fe5157232c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:45:37.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:37.085+0000 7fe5157232c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:45:37.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:37.085+0000 7fe5157232c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:45:37.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:37.086+0000 7fe5157232c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:45:37.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:37.629+0000 7fe5157232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:38.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:38.400+0000 7fe5157232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:38.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:38.811 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:45:39.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:39.183+0000 7fe5157232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:45:40.019 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:45:40.079 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:45:40.080 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:40.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:45:40.142 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:40.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:45:40.242 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:40.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:45:40.339 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:40.339 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:45:40.435 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:40.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:45:40.532 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:40.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:45:40.628 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:40.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:45:40.725 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:40.725 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:45:40.787 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:40.788 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:45:40.886 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:40.886 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:45:40.983 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:40.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:45:41.079 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:41.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:45:41.174 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:41.175 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:45:41.269 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:41.270 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:45:41.365 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:41.365 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:45:41.402 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:41.403 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:45:41.479 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:41.482 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:45:41.517 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:41.518 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:45:41.592 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:45:41.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:45:41.596 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:45:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC3DsBmxKXLNxAAziyp5inxsVr1mysLraQhlA== 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC4DsBmkIgGCRAAHgkFzhKVZXp+Lg9uGfDT9g== 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC4DsBmE9u4EhAAnLpJu3rbH+j/4MRz7IcpOw== 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC6DsBmNdkwFxAAY2sxwcscxR+693f36biudQ== 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC9DsBm94fdGxAArxvOmrVN2iDV5ezP9a9csw== 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDADsBmTxpzIBAAUOW545GGGfz2CWl06hM5Eg== 2024-08-17T02:45:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDDDsBmpiMGJBAAc729WEParLg877Gi8XQoug== 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC4DsBmtFXJAhAAMUs6joGZYEQfs9njc6ZP0g== 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC4DsBmQGZOHBAAGJfje6uIKi+s18vWnBwUFg== 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC4DsBmIsDWJRAA0/H8/wdkzVWO0YQdxRP6Aw== 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDHDsBmA8mhNRAAyBLucpoOYminNKSe67Rv9Q== 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDKDsBm7LOeORAA2ynGp358kl6e1s22ovsscg== 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2024-08-17T02:45:41.648 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDODsBmoYO8ARAA8q67190yaWJMITQ8W6bLUQ== 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDRDsBmUBgYBRAA+ZF39JSTLaD4UQoLr2hIQg== 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC4DsBmeaVPLhAA4c5JYYf5xIEIHiiZ4hSj4A== 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:[client.2] 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC4DsBmdeCDNBAAb7yShKQLCct3tplRYDlSOg== 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC4DsBmoaW+OhAArHgs4dD4M7fBfhmeKrANYg== 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:[client.3] 2024-08-17T02:45:41.649 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQC5DsBm8+QzBRAAW+HJI9Nz5NZNnGTAol4dpQ== 2024-08-17T02:45:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2024-08-17T02:45:41.686 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC3DsBmxKXLNxAAziyp5inxsVr1mysLraQhlA== 2024-08-17T02:45:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-08-17T02:45:41.686 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC4DsBmkIgGCRAAHgkFzhKVZXp+Lg9uGfDT9g== 2024-08-17T02:45:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-08-17T02:45:41.686 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC4DsBmE9u4EhAAnLpJu3rbH+j/4MRz7IcpOw== 2024-08-17T02:45:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2024-08-17T02:45:41.686 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC6DsBmNdkwFxAAY2sxwcscxR+693f36biudQ== 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC9DsBm94fdGxAArxvOmrVN2iDV5ezP9a9csw== 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDADsBmTxpzIBAAUOW545GGGfz2CWl06hM5Eg== 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDDDsBmpiMGJBAAc729WEParLg877Gi8XQoug== 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC4DsBmtFXJAhAAMUs6joGZYEQfs9njc6ZP0g== 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC4DsBmQGZOHBAAGJfje6uIKi+s18vWnBwUFg== 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC4DsBmIsDWJRAA0/H8/wdkzVWO0YQdxRP6Aw== 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2024-08-17T02:45:41.687 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDHDsBmA8mhNRAAyBLucpoOYminNKSe67Rv9Q== 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDKDsBm7LOeORAA2ynGp358kl6e1s22ovsscg== 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDODsBmoYO8ARAA8q67190yaWJMITQ8W6bLUQ== 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDRDsBmUBgYBRAA+ZF39JSTLaD4UQoLr2hIQg== 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC4DsBmeaVPLhAA4c5JYYf5xIEIHiiZ4hSj4A== 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout:[client.2] 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC4DsBmdeCDNBAAb7yShKQLCct3tplRYDlSOg== 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC4DsBmoaW+OhAArHgs4dD4M7fBfhmeKrANYg== 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout:[client.3] 2024-08-17T02:45:41.688 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQC5DsBm8+QzBRAAW+HJI9Nz5NZNnGTAol4dpQ== 2024-08-17T02:45:41.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:45:41.695 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:45:41.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:41.820 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:41.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:41.914 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:42.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.010 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.102 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.193 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:45:42.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:45:42.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:42.466 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:42.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:42.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:45:42.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.655 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:42.928 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:45:43.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:43.019 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:43.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:43.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:43.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:43.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:43.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:43.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:45:43.392 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:45:43.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:45:43.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:43.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:45:43.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:45:43.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:43.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:45:43.822 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:45:43.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:45:43.976 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:45:44.032 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:44.036 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:45:44.070 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:45:44.071 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:45:44.071 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:45:44.112 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:45:44.112 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:45:44.112 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:45:44.116 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:45:44.116 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:45:44.116 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:45:44.119 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:45:44.119 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:45:44.119 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:45:44.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:45:44.123 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:45:44.123 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:45:44.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:45:44.127 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:45:44.127 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:45:44.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:45:44.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.274+0000 7fd61be00640 1 Processor -- start 2024-08-17T02:45:44.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.274+0000 7fd61be00640 1 -- start start 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61be00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61be00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c0cbc50 con 0x7fd61c06e590 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61be00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0cbf30 con 0x7fd61c0cb190 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61be00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0cc210 con 0x7fd61c158a00 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:34654/0 (socket says 172.21.15.2:34654) 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 learned_addr learned my addr 172.21.15.2:0/2545952558 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:44.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:44.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:44.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.275+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:44.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.276+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:44.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.276+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:44.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.276+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:44.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.276+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:45:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:45:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:45:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:44.878+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:45:45.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:45.679+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:45:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd61c158dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd618c00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd61c158dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 msgr2=0x7fd61c0cb5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:47.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd618c00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd61c0cb190 0x7fd61c0cb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:47.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 >> v1:172.21.15.2:6789/0 conn(0x7fd61c06e590 legacy=0x7fd61c0683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:47.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd618c00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:47.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c0b2930 con 0x7fd5f80036a0 2024-08-17T02:45:47.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0cbf30 con 0x7fd5f8007320 2024-08-17T02:45:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.276+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.477+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.477+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:47.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.879+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.879+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.879+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.879+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:47.879+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:45:48.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:48.681+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:48.681+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:48.681+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:48.681+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:48.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:48.681+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.275+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 msgr2=0x7fd5f80097b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.275+0000 7fd618c00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8007320 0x7fd5f80097b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.275+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 >> v1:172.21.15.26:6789/0 conn(0x7fd5f80036a0 legacy=0x7fd5f8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.275+0000 7fd618c00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.275+0000 7fd61b400640 1 -- 172.21.15.2:0/2545952558 reap_dead start 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.275+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f800aeb0 con 0x7fd61c06e590 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.275+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f800aa80 con 0x7fd5f800a4d0 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.275+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0cbf30 con 0x7fd61c158a00 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.276+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.276+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:50.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.276+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:50.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.276+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:50.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.276+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.477+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.477+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:50.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:50.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:45:50.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.878+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:50.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.879+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:50.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.879+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:50.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.879+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:50.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:50.879+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:45:51.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:51.680+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:51.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:51.680+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:51.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:51.680+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:51.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:51.680+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:51.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:51.680+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:45:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 msgr2=0x7fd5f8009f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:45:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd618c00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c158a00 0x7fd5f8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 >> v1:172.21.15.26:6789/0 conn(0x7fd5f800a4d0 legacy=0x7fd5f800f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 >> v1:172.21.15.2:6789/0 conn(0x7fd61c06e590 legacy=0x7fd5f80128f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd618c00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd618c00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0cbf30 con 0x7fd5f8007970 2024-08-17T02:45:53.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd618c00640 1 -- 172.21.15.2:0/2545952558 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c0cc210 con 0x7fd5f8008830 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 msgr2=0x7fd5f8007d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 msgr2=0x7fd5f8007d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 msgr2=0x7fd5f8008cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 msgr2=0x7fd5f8008cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.276+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 msgr2=0x7fd5f8007d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 msgr2=0x7fd5f8007d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 msgr2=0x7fd5f8008cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 msgr2=0x7fd5f8008cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:53.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.477+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.879+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.879+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 msgr2=0x7fd5f8007d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.879+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 msgr2=0x7fd5f8007d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.879+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.880+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.880+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.880+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 msgr2=0x7fd5f8008cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.880+0000 7fd613e00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 msgr2=0x7fd5f8008cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:45:53.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.880+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:45:53.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:53.880+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:45:54.628 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:54.628+0000 7fca49218ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:45:54.629 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:54.629+0000 7ff401a15ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:45:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.681+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.2:3300/0 conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.681+0000 7fd613e00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.681+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 msgr2=0x7fd5f8008cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.681+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> v2:172.21.15.26:3300/0 conn(0x7fd5f8008830 0x7fd5f8008cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.681+0000 7fd61aa00640 1 -- 172.21.15.2:0/2545952558 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f800acb0 con 0x7fd5f8007970 2024-08-17T02:45:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.682+0000 7fd61aa00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd5f8007d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006f30 tx=0x7fd60c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959d1390206cbca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61a000640 1 -- 172.21.15.2:0/2545952558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c02ca10 con 0x7fd5f8007970 2024-08-17T02:45:54.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61a000640 1 -- 172.21.15.2:0/2545952558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00c040 con 0x7fd5f8007970 2024-08-17T02:45:54.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61a000640 1 -- 172.21.15.2:0/2545952558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c02cda0 con 0x7fd5f8007970 2024-08-17T02:45:54.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61be00640 1 -- 172.21.15.2:0/2545952558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 msgr2=0x7fd5f8007d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61be00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd5f8007d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd60c006f30 tx=0x7fd60c008040 comp rx=0 tx=0).stop 2024-08-17T02:45:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61b400640 1 -- 172.21.15.2:0/2545952558 reap_dead start 2024-08-17T02:45:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61be00640 1 -- 172.21.15.2:0/2545952558 shutdown_connections 2024-08-17T02:45:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61be00640 1 --2- 172.21.15.2:0/2545952558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd5f8007d70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.683+0000 7fd61be00640 1 -- 172.21.15.2:0/2545952558 >> 172.21.15.2:0/2545952558 conn(0x7fd61c0cfb80 msgr2=0x7fd61c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.684+0000 7fd61be00640 1 -- 172.21.15.2:0/2545952558 shutdown_connections 2024-08-17T02:45:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.684+0000 7fd61be00640 1 -- 172.21.15.2:0/2545952558 wait complete. 2024-08-17T02:45:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.685+0000 7fd61be00640 1 Processor -- start 2024-08-17T02:45:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.686+0000 7fd61be00640 1 -- start start 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.686+0000 7fd61be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd61c144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.686+0000 7fd61be00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c0a6680 0x7fd61c0c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.686+0000 7fd61be00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61c0c7640 0x7fd61c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.686+0000 7fd61be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0c87d0 con 0x7fd5f8007970 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.686+0000 7fd61be00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0c7bc0 con 0x7fd61c0c7640 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.686+0000 7fd61be00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0c7ea0 con 0x7fd61c0a6680 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd61c144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61b400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61c0c7640 0x7fd61c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd61c144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39614/0 (socket says 172.21.15.2:39614) 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61aa00640 1 -- 172.21.15.2:0/1270498066 learned_addr learned my addr 172.21.15.2:0/1270498066 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:45:54.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd613e00640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c0a6680 0x7fd61c0c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61b400640 1 -- 172.21.15.2:0/1270498066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c0a6680 msgr2=0x7fd61c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61b400640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c0a6680 0x7fd61c0c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61b400640 1 -- 172.21.15.2:0/1270498066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 msgr2=0x7fd61c144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61b400640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd61c144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61b400640 1 -- 172.21.15.2:0/1270498066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c00e040 con 0x7fd61c0c7640 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.687+0000 7fd61aa00640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd61c144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.688+0000 7fd61b400640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61c0c7640 0x7fd61c0c8c60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80076f0 tx=0x7fd614007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.688+0000 7fd612000640 1 -- 172.21.15.2:0/1270498066 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614005d10 con 0x7fd61c0c7640 2024-08-17T02:45:54.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.688+0000 7fd612000640 1 -- 172.21.15.2:0/1270498066 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd614002020 con 0x7fd61c0c7640 2024-08-17T02:45:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.688+0000 7fd612000640 1 -- 172.21.15.2:0/1270498066 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61400c850 con 0x7fd61c0c7640 2024-08-17T02:45:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.688+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61c0c8180 con 0x7fd61c0c7640 2024-08-17T02:45:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.688+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c1445b0 con 0x7fd61c0c7640 2024-08-17T02:45:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.688+0000 7fd612000640 1 -- 172.21.15.2:0/1270498066 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd61400cc40 con 0x7fd61c0c7640 2024-08-17T02:45:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.688+0000 7fd612000640 1 -- 172.21.15.2:0/1270498066 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd614007800 con 0x7fd61c0c7640 2024-08-17T02:45:54.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.689+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c070720 con 0x7fd61c0c7640 2024-08-17T02:45:54.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.692+0000 7fd612000640 1 -- 172.21.15.2:0/1270498066 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd6140079c0 con 0x7fd61c0c7640 2024-08-17T02:45:54.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.761+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd61c06f0e0 con 0x7fd61c0c7640 2024-08-17T02:45:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.765+0000 7fd612000640 1 -- 172.21.15.2:0/1270498066 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd6140014a0 con 0x7fd61c0c7640 2024-08-17T02:45:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61c0c7640 msgr2=0x7fd61c0c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61c0c7640 0x7fd61c0c8c60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80076f0 tx=0x7fd614007f60 comp rx=0 tx=0).stop 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 shutdown_connections 2024-08-17T02:45:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd61c0c7640 0x7fd61c0c8c60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd61c0a6680 0x7fd61c0c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 --2- 172.21.15.2:0/1270498066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5f8007970 0x7fd61c144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 >> 172.21.15.2:0/1270498066 conn(0x7fd61c0cfb80 msgr2=0x7fd61c06e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 shutdown_connections 2024-08-17T02:45:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:54.766+0000 7fd61be00640 1 -- 172.21.15.2:0/1270498066 wait complete. 2024-08-17T02:45:54.780 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:54.780+0000 7fca49218ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:45:54.781 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:45:54.782 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:54.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:45:54.786 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:54.785+0000 7ff401a15ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:45:54.838 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:54.838 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:45:54.844 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:54.843+0000 7fca49218ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:45:54.847 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:54.847+0000 7ff401a15ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:45:54.900 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:54.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:45:54.996 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-08-17T02:45:54.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:45:55.094 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:55.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:45:55.133 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:55.133+0000 7fca49218ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:45:55.137 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:55.137+0000 7ff401a15ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:45:55.151 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:55.151 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:45:55.185 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:55.185+0000 7fca49218ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:45:55.191 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:55.191+0000 7ff401a15ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:45:55.247 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:55.247 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:45:55.343 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-08-17T02:45:55.343 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:45:55.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 032a88b1-f4bd-43d4-af19-9c0bd408f20a 0 2024-08-17T02:45:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.626+0000 7f8186e00640 1 Processor -- start 2024-08-17T02:45:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.626+0000 7f8186e00640 1 -- start start 2024-08-17T02:45:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.627+0000 7f8186e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81801589e0 0x7f8180158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.627+0000 7f8186e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81800ca9c0 0x7f81800cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.627+0000 7f8186e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81800af9a0 con 0x7f81800cda30 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.627+0000 7f8186e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81800af810 con 0x7f81800ca9c0 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.627+0000 7f8186e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81800cb340 con 0x7f81801589e0 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817fe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81801589e0 0x7f8180158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817fe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81801589e0 0x7f8180158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43066/0 (socket says 172.21.15.26:43066) 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817fe00640 1 -- 172.21.15.26:0/3192136924 learned_addr learned my addr 172.21.15.26:0/3192136924 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817f400640 1 --2- 172.21.15.26:0/3192136924 >> v2:172.21.15.2:3300/0 conn(0x7f81800ca9c0 0x7f81800cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817fe00640 1 -- 172.21.15.26:0/3192136924 >> v2:172.21.15.2:3300/0 conn(0x7f81800ca9c0 msgr2=0x7f81800cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817fe00640 1 --2- 172.21.15.26:0/3192136924 >> v2:172.21.15.2:3300/0 conn(0x7f81800ca9c0 0x7f81800cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817fe00640 1 -- 172.21.15.26:0/3192136924 >> v1:172.21.15.2:6789/0 conn(0x7f81800cda30 legacy=0x7f81800cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817fe00640 1 -- 172.21.15.26:0/3192136924 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81800ce740 con 0x7f81801589e0 2024-08-17T02:45:55.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.628+0000 7f817f400640 1 --2- 172.21.15.26:0/3192136924 >> v2:172.21.15.2:3300/0 conn(0x7f81800ca9c0 0x7f81800cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.629+0000 7f817fe00640 1 --2- 172.21.15.26:0/3192136924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81801589e0 0x7f8180158db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f81800d0d70 tx=0x7f81700091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97631b0ff9816974 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.629+0000 7f817ea00640 1 -- 172.21.15.26:0/3192136924 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817002ae60 con 0x7f81801589e0 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f817ea00640 1 -- 172.21.15.26:0/3192136924 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8170032440 con 0x7f81801589e0 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f817ea00640 1 -- 172.21.15.26:0/3192136924 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700327e0 con 0x7f81801589e0 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f8186e00640 1 -- 172.21.15.26:0/3192136924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81801589e0 msgr2=0x7f8180158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f8186e00640 1 --2- 172.21.15.26:0/3192136924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81801589e0 0x7f8180158db0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f81800d0d70 tx=0x7f81700091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f8186e00640 1 -- 172.21.15.26:0/3192136924 shutdown_connections 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f8186e00640 1 --2- 172.21.15.26:0/3192136924 >> v2:172.21.15.2:3300/0 conn(0x7f81800ca9c0 0x7f81800cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f8186e00640 1 --2- 172.21.15.26:0/3192136924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81801589e0 0x7f8180158db0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f8186e00640 1 -- 172.21.15.26:0/3192136924 >> 172.21.15.26:0/3192136924 conn(0x7f818006e590 msgr2=0x7f818006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f8186e00640 1 -- 172.21.15.26:0/3192136924 shutdown_connections 2024-08-17T02:45:55.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.630+0000 7f8186e00640 1 -- 172.21.15.26:0/3192136924 wait complete. 2024-08-17T02:45:55.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.632+0000 7f8186e00640 1 Processor -- start 2024-08-17T02:45:55.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.632+0000 7f8186e00640 1 -- start start 2024-08-17T02:45:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f8186e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81800ca9c0 0x7f81800b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f8186e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81800cda30 0x7f81800c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f8186e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81801589e0 0x7f81800b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f8186e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818014e0e0 con 0x7f81800ca9c0 2024-08-17T02:45:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f8186e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81801520c0 con 0x7f81800cda30 2024-08-17T02:45:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f8186e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81800b1750 con 0x7f81801589e0 2024-08-17T02:45:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817f400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81800cda30 0x7f81800c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81800ca9c0 0x7f81800b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81800ca9c0 0x7f81800b1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.26:33154/0 (socket says 172.21.15.26:33154) 2024-08-17T02:45:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817fe00640 1 -- 172.21.15.26:0/3517629231 learned_addr learned my addr 172.21.15.26:0/3517629231 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f8184e00640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81801589e0 0x7f81800b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817fe00640 1 -- 172.21.15.26:0/3517629231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81801589e0 msgr2=0x7f81800b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817fe00640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81801589e0 0x7f81800b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817fe00640 1 -- 172.21.15.26:0/3517629231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81800cda30 msgr2=0x7f81800c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817fe00640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81800cda30 0x7f81800c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817fe00640 1 -- 172.21.15.26:0/3517629231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c009390 con 0x7f81800ca9c0 2024-08-17T02:45:55.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.633+0000 7f817f400640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81800cda30 0x7f81800c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.634+0000 7f817fe00640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81800ca9c0 0x7f81800b1be0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8170009940 tx=0x7f8170032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.634+0000 7f8177400640 1 -- 172.21.15.26:0/3517629231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170000d10 con 0x7f81800ca9c0 2024-08-17T02:45:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.634+0000 7f8177400640 1 -- 172.21.15.26:0/3517629231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8170031de0 con 0x7f81800ca9c0 2024-08-17T02:45:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.634+0000 7f8177400640 1 -- 172.21.15.26:0/3517629231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817003d650 con 0x7f81800ca9c0 2024-08-17T02:45:55.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.634+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8170009450 con 0x7f81800ca9c0 2024-08-17T02:45:55.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.634+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81800b0e20 con 0x7f81800ca9c0 2024-08-17T02:45:55.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.634+0000 7f8177400640 1 -- 172.21.15.26:0/3517629231 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8170039040 con 0x7f81800ca9c0 2024-08-17T02:45:55.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.634+0000 7f8177400640 1 -- 172.21.15.26:0/3517629231 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8170047790 con 0x7f81800ca9c0 2024-08-17T02:45:55.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.635+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8180063fb0 con 0x7f81800ca9c0 2024-08-17T02:45:55.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.638+0000 7f8177400640 1 -- 172.21.15.26:0/3517629231 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8170042070 con 0x7f81800ca9c0 2024-08-17T02:45:55.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.715+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "032a88b1-f4bd-43d4-af19-9c0bd408f20a", "id": 0} v 0) v1 -- 0x7f81800c6a50 con 0x7f81800ca9c0 2024-08-17T02:45:55.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.718+0000 7f8177400640 1 -- 172.21.15.26:0/3517629231 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "032a88b1-f4bd-43d4-af19-9c0bd408f20a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f817002ae60 con 0x7f81800ca9c0 2024-08-17T02:45:55.719 INFO:teuthology.orchestra.run.smithi026.stdout:0 2024-08-17T02:45:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.719+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81800ca9c0 msgr2=0x7f81800b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.719+0000 7f8186e00640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81800ca9c0 0x7f81800b1be0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8170009940 tx=0x7f8170032000 comp rx=0 tx=0).stop 2024-08-17T02:45:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.719+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 shutdown_connections 2024-08-17T02:45:55.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.719+0000 7f8186e00640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81801589e0 0x7f81800b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.719+0000 7f8186e00640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81800cda30 0x7f81800c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.719+0000 7f8186e00640 1 --2- 172.21.15.26:0/3517629231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81800ca9c0 0x7f81800b1be0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.719+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 >> 172.21.15.26:0/3517629231 conn(0x7f818006e590 msgr2=0x7f81800cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.720+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 shutdown_connections 2024-08-17T02:45:55.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.720+0000 7f8186e00640 1 -- 172.21.15.26:0/3517629231 wait complete. 2024-08-17T02:45:55.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 246f5645-d860-4bde-95e1-b2b41809af1b 1 2024-08-17T02:45:55.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.885+0000 7f2101600640 1 Processor -- start 2024-08-17T02:45:55.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.885+0000 7f2101600640 1 -- start start 2024-08-17T02:45:55.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.886+0000 7f2101600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20fc0b21c0 0x7f20fc0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.886+0000 7f2101600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.886+0000 7f2101600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc159130 con 0x7f20fc0b1df0 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.886+0000 7f2101600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc0b31d0 con 0x7f20fc0b21c0 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.886+0000 7f2101600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0b34a0 con 0x7f20fc158770 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.886+0000 7f20fa000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20fc0b21c0 0x7f20fc0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.887+0000 7f20fa000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20fc0b21c0 0x7f20fc0ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43084/0 (socket says 172.21.15.26:43084) 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.887+0000 7f20fa000640 1 -- 172.21.15.26:0/3306270965 learned_addr learned my addr 172.21.15.26:0/3306270965 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.887+0000 7f20fb400640 1 --2- 172.21.15.26:0/3306270965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.887+0000 7f20fa000640 1 -- 172.21.15.26:0/3306270965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 msgr2=0x7f20fc158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.887+0000 7f20fa000640 1 --2- 172.21.15.26:0/3306270965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.887+0000 7f20fa000640 1 -- 172.21.15.26:0/3306270965 >> v1:172.21.15.2:6789/0 conn(0x7f20fc0b1df0 legacy=0x7f20fc0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.887+0000 7f20fa000640 1 -- 172.21.15.26:0/3306270965 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc0b3780 con 0x7f20fc0b21c0 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.888+0000 7f20fa000640 1 --2- 172.21.15.26:0/3306270965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 0x7f20fc0ca930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009910 tx=0x7f20e80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9211f447696e8fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.888+0000 7f20f9600640 1 -- 172.21.15.26:0/3306270965 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e802ae40 con 0x7f20fc0b21c0 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.888+0000 7f20f9600640 1 -- 172.21.15.26:0/3306270965 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e8032440 con 0x7f20fc0b21c0 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.888+0000 7f20f9600640 1 -- 172.21.15.26:0/3306270965 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8032820 con 0x7f20fc0b21c0 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.889+0000 7f2101600640 1 -- 172.21.15.26:0/3306270965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 msgr2=0x7f20fc0ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.889+0000 7f2101600640 1 --2- 172.21.15.26:0/3306270965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 0x7f20fc0ca930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009910 tx=0x7f20e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.889+0000 7f2101600640 1 -- 172.21.15.26:0/3306270965 shutdown_connections 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.889+0000 7f2101600640 1 --2- 172.21.15.26:0/3306270965 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.889+0000 7f2101600640 1 --2- 172.21.15.26:0/3306270965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 0x7f20fc0ca930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.889+0000 7f2101600640 1 -- 172.21.15.26:0/3306270965 >> 172.21.15.26:0/3306270965 conn(0x7f20fc06e590 msgr2=0x7f20fc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.889+0000 7f2101600640 1 -- 172.21.15.26:0/3306270965 shutdown_connections 2024-08-17T02:45:55.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.889+0000 7f2101600640 1 -- 172.21.15.26:0/3306270965 wait complete. 2024-08-17T02:45:55.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.891+0000 7f2101600640 1 Processor -- start 2024-08-17T02:45:55.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.891+0000 7f2101600640 1 -- start start 2024-08-17T02:45:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f2101600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20fc0b1df0 0x7f20fc14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f2101600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 0x7f20fc15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f2101600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc0c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f2101600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c49c0 con 0x7f20fc0b1df0 2024-08-17T02:45:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f2101600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c3db0 con 0x7f20fc0b21c0 2024-08-17T02:45:55.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f2101600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c4090 con 0x7f20fc158770 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fa000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 0x7f20fc15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fb400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc0c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fb400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc0c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33416/0 (socket says 172.21.15.26:33416) 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fb400640 1 -- 172.21.15.26:0/3089860881 learned_addr learned my addr 172.21.15.26:0/3089860881 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20faa00640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20fc0b1df0 0x7f20fc14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fb400640 1 -- 172.21.15.26:0/3089860881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 msgr2=0x7f20fc15a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fb400640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 0x7f20fc15a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fb400640 1 -- 172.21.15.26:0/3089860881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20fc0b1df0 msgr2=0x7f20fc14f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fb400640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20fc0b1df0 0x7f20fc14f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fb400640 1 -- 172.21.15.26:0/3089860881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8009450 con 0x7f20fc158770 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.892+0000 7f20fa000640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 0x7f20fc15a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:55.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.893+0000 7f20fb400640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc0c3330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009e90 tx=0x7f20f400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:55.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.893+0000 7f20f2000640 1 -- 172.21.15.26:0/3089860881 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400cd40 con 0x7f20fc158770 2024-08-17T02:45:55.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.893+0000 7f20f2000640 1 -- 172.21.15.26:0/3089860881 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f400f040 con 0x7f20fc158770 2024-08-17T02:45:55.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.893+0000 7f20f2000640 1 -- 172.21.15.26:0/3089860881 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40146d0 con 0x7f20fc158770 2024-08-17T02:45:55.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.893+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc0c4370 con 0x7f20fc158770 2024-08-17T02:45:55.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.893+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc0cbc90 con 0x7f20fc158770 2024-08-17T02:45:55.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.893+0000 7f20f2000640 1 -- 172.21.15.26:0/3089860881 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f20f4014d10 con 0x7f20fc158770 2024-08-17T02:45:55.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.894+0000 7f20f2000640 1 -- 172.21.15.26:0/3089860881 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f20f40133e0 con 0x7f20fc158770 2024-08-17T02:45:55.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.894+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc0c4b30 con 0x7f20fc158770 2024-08-17T02:45:55.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.897+0000 7f20f2000640 1 -- 172.21.15.26:0/3089860881 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f20f4018020 con 0x7f20fc158770 2024-08-17T02:45:55.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.972+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd new", "uuid": "246f5645-d860-4bde-95e1-b2b41809af1b", "id": 1} v 0) v1 -- 0x7f20fc063fb0 con 0x7f20fc158770 2024-08-17T02:45:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.976+0000 7f20f2000640 1 -- 172.21.15.26:0/3089860881 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "246f5645-d860-4bde-95e1-b2b41809af1b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20f401d570 con 0x7f20fc158770 2024-08-17T02:45:55.976 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-08-17T02:45:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 msgr2=0x7f20fc0c3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc0c3330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009e90 tx=0x7f20f400b040 comp rx=0 tx=0).stop 2024-08-17T02:45:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 shutdown_connections 2024-08-17T02:45:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f20fc158770 0x7f20fc0c3330 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20fc0b21c0 0x7f20fc15a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 --2- 172.21.15.26:0/3089860881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20fc0b1df0 0x7f20fc14f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 >> 172.21.15.26:0/3089860881 conn(0x7f20fc06e590 msgr2=0x7f20fc151590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:55.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 shutdown_connections 2024-08-17T02:45:55.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:55.977+0000 7f2101600640 1 -- 172.21.15.26:0/3089860881 wait complete. 2024-08-17T02:45:55.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new e12756ac-1613-40d4-8acb-279976c28e4a 2 2024-08-17T02:45:56.044 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:56.044+0000 7fca49218ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:45:56.118 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:56.118+0000 7ff401a15ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:45:56.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.137+0000 7f0889400640 1 Processor -- start 2024-08-17T02:45:56.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.137+0000 7f0889400640 1 -- start start 2024-08-17T02:45:56.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.138+0000 7f0889400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08840afca0 0x7f08840b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.138+0000 7f0889400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08840c92b0 con 0x7f08841590b0 2024-08-17T02:45:56.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.138+0000 7f0889400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08840ad480 con 0x7f08840acf10 2024-08-17T02:45:56.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.138+0000 7f0889400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08840b0980 con 0x7f08840afca0 2024-08-17T02:45:56.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.139+0000 7f0879e00640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f08840acf10 0x7f08841589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60574/0 (socket says 172.21.15.26:60574) 2024-08-17T02:45:56.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.139+0000 7f0879e00640 1 -- 172.21.15.26:0/4165139304 learned_addr learned my addr 172.21.15.26:0/4165139304 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-08-17T02:45:56.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.139+0000 7f0882800640 1 --2- 172.21.15.26:0/4165139304 >> v2:172.21.15.2:3300/0 conn(0x7f08840afca0 0x7f08840b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.139+0000 7f0881e00640 1 -- 172.21.15.26:0/4165139304 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078907627 0 0) 0x7f08840ad480 con 0x7f08840acf10 2024-08-17T02:45:56.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.139+0000 7f0881e00640 1 -- 172.21.15.26:0/4165139304 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08680034e0 con 0x7f08840acf10 2024-08-17T02:45:56.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.139+0000 7f0882800640 1 -- 172.21.15.26:0/4165139304 >> v1:172.21.15.26:6789/0 conn(0x7f08840acf10 legacy=0x7f08841589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.139+0000 7f0882800640 1 -- 172.21.15.26:0/4165139304 >> v1:172.21.15.2:6789/0 conn(0x7f08841590b0 legacy=0x7f08840c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.139+0000 7f0882800640 1 -- 172.21.15.26:0/4165139304 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08840ad760 con 0x7f08840afca0 2024-08-17T02:45:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.140+0000 7f0882800640 1 --2- 172.21.15.26:0/4165139304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 0x7f08840b0070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0874009850 tx=0x7f08740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6f5f1d55df4e80 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0881e00640 1 -- 172.21.15.26:0/4165139304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087402adb0 con 0x7f08840afca0 2024-08-17T02:45:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0881e00640 1 -- 172.21.15.26:0/4165139304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874032440 con 0x7f08840afca0 2024-08-17T02:45:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0881e00640 1 -- 172.21.15.26:0/4165139304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874032820 con 0x7f08840afca0 2024-08-17T02:45:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0889400640 1 -- 172.21.15.26:0/4165139304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 msgr2=0x7f08840b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0889400640 1 --2- 172.21.15.26:0/4165139304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 0x7f08840b0070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0874009850 tx=0x7f08740090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0889400640 1 -- 172.21.15.26:0/4165139304 shutdown_connections 2024-08-17T02:45:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0889400640 1 --2- 172.21.15.26:0/4165139304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 0x7f08840b0070 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0889400640 1 -- 172.21.15.26:0/4165139304 >> 172.21.15.26:0/4165139304 conn(0x7f0884066e60 msgr2=0x7f0884067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0889400640 1 -- 172.21.15.26:0/4165139304 shutdown_connections 2024-08-17T02:45:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.141+0000 7f0889400640 1 -- 172.21.15.26:0/4165139304 wait complete. 2024-08-17T02:45:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.143+0000 7f0889400640 1 Processor -- start 2024-08-17T02:45:56.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.143+0000 7f0889400640 1 -- start start 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0889400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08840acf10 0x7f088414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0889400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 0x7f08841485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0889400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08841590b0 0x7f088414fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0889400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884148b20 con 0x7f08840afca0 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0889400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0884150430 con 0x7f08840acf10 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0889400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0884150710 con 0x7f08841590b0 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0882800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08840acf10 0x7f088414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0882800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08840acf10 0x7f088414ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43108/0 (socket says 172.21.15.26:43108) 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0882800640 1 -- 172.21.15.26:0/970741248 learned_addr learned my addr 172.21.15.26:0/970741248 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0883200640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08841590b0 0x7f088414fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0879e00640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 0x7f08841485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0882800640 1 -- 172.21.15.26:0/970741248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08841590b0 msgr2=0x7f088414fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0882800640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08841590b0 0x7f088414fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0882800640 1 -- 172.21.15.26:0/970741248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 msgr2=0x7f08841485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0882800640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 0x7f08841485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.144+0000 7f0882800640 1 -- 172.21.15.26:0/970741248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0874009390 con 0x7f08840acf10 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.145+0000 7f0882800640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08840acf10 0x7f088414ae40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0874009360 tx=0x7f0874032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.145+0000 7f087aa00640 1 -- 172.21.15.26:0/970741248 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874000d10 con 0x7f08840acf10 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.145+0000 7f087aa00640 1 -- 172.21.15.26:0/970741248 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874031a60 con 0x7f08840acf10 2024-08-17T02:45:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.145+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08841509f0 con 0x7f08840acf10 2024-08-17T02:45:56.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.145+0000 7f087aa00640 1 -- 172.21.15.26:0/970741248 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874031e20 con 0x7f08840acf10 2024-08-17T02:45:56.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.145+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0884150fb0 con 0x7f08840acf10 2024-08-17T02:45:56.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.146+0000 7f087aa00640 1 -- 172.21.15.26:0/970741248 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0874039040 con 0x7f08840acf10 2024-08-17T02:45:56.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.146+0000 7f087aa00640 1 -- 172.21.15.26:0/970741248 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f0874041030 con 0x7f08840acf10 2024-08-17T02:45:56.148 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:56.147+0000 7fca49218ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:45:56.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.147+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08841511d0 con 0x7f08840acf10 2024-08-17T02:45:56.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.149+0000 7f087aa00640 1 -- 172.21.15.26:0/970741248 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f087404b060 con 0x7f08840acf10 2024-08-17T02:45:56.198 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:56.198+0000 7fca49218ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:45:56.224 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:56.223+0000 7ff401a15ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:45:56.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.225+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e12756ac-1613-40d4-8acb-279976c28e4a", "id": 2} v 0) v1 -- 0x7f0884063fb0 con 0x7f08840acf10 2024-08-17T02:45:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.229+0000 7f087aa00640 1 -- 172.21.15.26:0/970741248 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e12756ac-1613-40d4-8acb-279976c28e4a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0874037070 con 0x7f08840acf10 2024-08-17T02:45:56.229 INFO:teuthology.orchestra.run.smithi026.stdout:2 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08840acf10 msgr2=0x7f088414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08840acf10 0x7f088414ae40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0874009360 tx=0x7f0874032000 comp rx=0 tx=0).stop 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 shutdown_connections 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08841590b0 0x7f088414fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08840afca0 0x7f08841485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 --2- 172.21.15.26:0/970741248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08840acf10 0x7f088414ae40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 >> 172.21.15.26:0/970741248 conn(0x7f0884066e60 msgr2=0x7f0884158770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 shutdown_connections 2024-08-17T02:45:56.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.230+0000 7f0889400640 1 -- 172.21.15.26:0/970741248 wait complete. 2024-08-17T02:45:56.250 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new e113cc6c-8f60-47dd-bd6e-38ee163a40a6 3 2024-08-17T02:45:56.284 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:56.283+0000 7ff401a15ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:45:56.374 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:56.374+0000 7fca49218ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:45:56.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.398+0000 7f5525400640 1 Processor -- start 2024-08-17T02:45:56.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.398+0000 7f5525400640 1 -- start start 2024-08-17T02:45:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.399+0000 7f5525400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5520158b90 0x7f55200b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.399+0000 7f5525400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f55200b2370 0x7f55200aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f5525400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55200af380 con 0x7f55200aef60 2024-08-17T02:45:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f5525400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55200afd20 con 0x7f55200b2370 2024-08-17T02:45:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f5525400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55200affe0 con 0x7f5520158b90 2024-08-17T02:45:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f551e800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5520158b90 0x7f55200b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f551e800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5520158b90 0x7f55200b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33438/0 (socket says 172.21.15.26:33438) 2024-08-17T02:45:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f551e800640 1 -- 172.21.15.26:0/2508238370 learned_addr learned my addr 172.21.15.26:0/2508238370 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f5517e00640 1 --2- 172.21.15.26:0/2508238370 >> v2:172.21.15.2:3300/0 conn(0x7f55200b2370 0x7f55200aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f551de00640 1 -- 172.21.15.26:0/2508238370 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865792353 0 0) 0x7f55200af380 con 0x7f55200aef60 2024-08-17T02:45:56.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f5517e00640 1 -- 172.21.15.26:0/2508238370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5520158b90 msgr2=0x7f55200b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f5517e00640 1 --2- 172.21.15.26:0/2508238370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5520158b90 0x7f55200b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f5517e00640 1 -- 172.21.15.26:0/2508238370 >> v1:172.21.15.2:6789/0 conn(0x7f55200aef60 legacy=0x7f5520068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.400+0000 7f5517e00640 1 -- 172.21.15.26:0/2508238370 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200b02c0 con 0x7f55200b2370 2024-08-17T02:45:56.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.401+0000 7f5517e00640 1 --2- 172.21.15.26:0/2508238370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55200b2370 0x7f55200aea20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5508009850 tx=0x7f55080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d7a69418973914 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.402+0000 7f551de00640 1 -- 172.21.15.26:0/2508238370 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550802ad80 con 0x7f55200b2370 2024-08-17T02:45:56.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.402+0000 7f551de00640 1 -- 172.21.15.26:0/2508238370 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508032440 con 0x7f55200b2370 2024-08-17T02:45:56.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.402+0000 7f551de00640 1 -- 172.21.15.26:0/2508238370 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080327e0 con 0x7f55200b2370 2024-08-17T02:45:56.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.402+0000 7f5525400640 1 -- 172.21.15.26:0/2508238370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55200b2370 msgr2=0x7f55200aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.402+0000 7f5525400640 1 --2- 172.21.15.26:0/2508238370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55200b2370 0x7f55200aea20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5508009850 tx=0x7f55080090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.403+0000 7f5525400640 1 -- 172.21.15.26:0/2508238370 shutdown_connections 2024-08-17T02:45:56.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.403+0000 7f5525400640 1 --2- 172.21.15.26:0/2508238370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55200b2370 0x7f55200aea20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.403+0000 7f5525400640 1 --2- 172.21.15.26:0/2508238370 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5520158b90 0x7f55200b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.403+0000 7f5525400640 1 -- 172.21.15.26:0/2508238370 >> 172.21.15.26:0/2508238370 conn(0x7f552006e590 msgr2=0x7f552006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.403+0000 7f5525400640 1 -- 172.21.15.26:0/2508238370 shutdown_connections 2024-08-17T02:45:56.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.403+0000 7f5525400640 1 -- 172.21.15.26:0/2508238370 wait complete. 2024-08-17T02:45:56.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.404+0000 7f5525400640 1 Processor -- start 2024-08-17T02:45:56.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.404+0000 7f5525400640 1 -- start start 2024-08-17T02:45:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5525400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55200aef60 0x7f5520169040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5525400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55200b2370 0x7f5520157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5525400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5520158b90 0x7f552015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5525400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552015ca40 con 0x7f5520158b90 2024-08-17T02:45:56.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5525400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5520158390 con 0x7f55200aef60 2024-08-17T02:45:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5525400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552015a680 con 0x7f55200b2370 2024-08-17T02:45:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5517e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55200b2370 0x7f5520157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f551e800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55200aef60 0x7f5520169040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5517e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55200b2370 0x7f5520157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33454/0 (socket says 172.21.15.26:33454) 2024-08-17T02:45:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f551e800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55200aef60 0x7f5520169040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43114/0 (socket says 172.21.15.26:43114) 2024-08-17T02:45:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f5517e00640 1 -- 172.21.15.26:0/321567948 learned_addr learned my addr 172.21.15.26:0/321567948 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:56.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.405+0000 7f551f200640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5520158b90 0x7f552015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.406+0000 7f5517e00640 1 -- 172.21.15.26:0/321567948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55200aef60 msgr2=0x7f5520169040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.406+0000 7f5517e00640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55200aef60 0x7f5520169040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.406+0000 7f5517e00640 1 -- 172.21.15.26:0/321567948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5520158b90 msgr2=0x7f552015b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.406+0000 7f5517e00640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5520158b90 0x7f552015b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.406+0000 7f5517e00640 1 -- 172.21.15.26:0/321567948 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009390 con 0x7f55200b2370 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.406+0000 7f551f200640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5520158b90 0x7f552015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.406+0000 7f5517e00640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55200b2370 0x7f5520157e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5508009360 tx=0x7f5508032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.407+0000 7f5516000640 1 -- 172.21.15.26:0/321567948 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508000d10 con 0x7f55200b2370 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.407+0000 7f5516000640 1 -- 172.21.15.26:0/321567948 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5508031e00 con 0x7f55200b2370 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.407+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552015cc90 con 0x7f55200b2370 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.407+0000 7f5516000640 1 -- 172.21.15.26:0/321567948 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550803d670 con 0x7f55200b2370 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.407+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552015d250 con 0x7f55200b2370 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.407+0000 7f5516000640 1 -- 172.21.15.26:0/321567948 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5508039040 con 0x7f55200b2370 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.407+0000 7f5516000640 1 -- 172.21.15.26:0/321567948 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f550803b890 con 0x7f55200b2370 2024-08-17T02:45:56.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.408+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552015d440 con 0x7f55200b2370 2024-08-17T02:45:56.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.410+0000 7f5516000640 1 -- 172.21.15.26:0/321567948 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5508042070 con 0x7f55200b2370 2024-08-17T02:45:56.431 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:56.431+0000 7fca49218ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:45:56.466 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:56.465+0000 7ff401a15ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:45:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.486+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e113cc6c-8f60-47dd-bd6e-38ee163a40a6", "id": 3} v 0) v1 -- 0x7f5520063fb0 con 0x7f55200b2370 2024-08-17T02:45:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.489+0000 7f5516000640 1 -- 172.21.15.26:0/321567948 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e113cc6c-8f60-47dd-bd6e-38ee163a40a6", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5508037070 con 0x7f55200b2370 2024-08-17T02:45:56.490 INFO:teuthology.orchestra.run.smithi026.stdout:3 2024-08-17T02:45:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.490+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55200b2370 msgr2=0x7f5520157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.490+0000 7f5525400640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55200b2370 0x7f5520157e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5508009360 tx=0x7f5508032000 comp rx=0 tx=0).stop 2024-08-17T02:45:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.491+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 shutdown_connections 2024-08-17T02:45:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.491+0000 7f5525400640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5520158b90 0x7f552015b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.491+0000 7f5525400640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f55200b2370 0x7f5520157e50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.491+0000 7f5525400640 1 --2- 172.21.15.26:0/321567948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55200aef60 0x7f5520169040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.491+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 >> 172.21.15.26:0/321567948 conn(0x7f552006e590 msgr2=0x7f55200b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.491+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 shutdown_connections 2024-08-17T02:45:56.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.491+0000 7f5525400640 1 -- 172.21.15.26:0/321567948 wait complete. 2024-08-17T02:45:56.494 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:56.494+0000 7fca49218ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:45:56.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 00d2db92-f8ce-4a86-94b4-60080a276b05 4 2024-08-17T02:45:56.533 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:56.533+0000 7ff401a15ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:45:56.602 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:56.601+0000 7ff401a15ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:45:56.605 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:56.605+0000 7fca49218ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:45:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.683+0000 7f1533200640 1 Processor -- start 2024-08-17T02:45:56.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.683+0000 7f1533200640 1 -- start start 2024-08-17T02:45:56.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.684+0000 7f1533200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f152c0ad960 0x7f152c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f1533200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f152c0add30 0x7f152c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f1533200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c15b5e0 con 0x7f152c0ca050 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f1533200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c0cb160 con 0x7f152c0add30 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f1533200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c0b0d10 con 0x7f152c0ad960 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f152be00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f152c0ad960 0x7f152c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f152be00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f152c0ad960 0x7f152c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43120/0 (socket says 172.21.15.26:43120) 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f152be00640 1 -- 172.21.15.26:0/2998140001 learned_addr learned my addr 172.21.15.26:0/2998140001 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:56.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f1531200640 1 --2- 172.21.15.26:0/2998140001 >> v2:172.21.15.2:3300/0 conn(0x7f152c0add30 0x7f152c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f152aa00640 1 -- 172.21.15.26:0/2998140001 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882878381 0 0) 0x7f1518001110 con 0x7f152c0ca050 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f152be00640 1 -- 172.21.15.26:0/2998140001 >> v2:172.21.15.2:3300/0 conn(0x7f152c0add30 msgr2=0x7f152c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f152be00640 1 --2- 172.21.15.26:0/2998140001 >> v2:172.21.15.2:3300/0 conn(0x7f152c0add30 0x7f152c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f152be00640 1 -- 172.21.15.26:0/2998140001 >> v1:172.21.15.2:6789/0 conn(0x7f152c0ca050 legacy=0x7f152c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.685+0000 7f152be00640 1 -- 172.21.15.26:0/2998140001 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0ca550 con 0x7f152c0ad960 2024-08-17T02:45:56.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.687+0000 7f152be00640 1 --2- 172.21.15.26:0/2998140001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0ad960 0x7f152c15b0a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f152c0cc910 tx=0x7f151c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a32507ab9ba3ae9c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.687+0000 7f152aa00640 1 -- 172.21.15.26:0/2998140001 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c032440 con 0x7f152c0ad960 2024-08-17T02:45:56.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.687+0000 7f152aa00640 1 -- 172.21.15.26:0/2998140001 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c0325a0 con 0x7f152c0ad960 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.687+0000 7f152aa00640 1 -- 172.21.15.26:0/2998140001 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c032940 con 0x7f152c0ad960 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.687+0000 7f1533200640 1 -- 172.21.15.26:0/2998140001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0ad960 msgr2=0x7f152c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.687+0000 7f1533200640 1 --2- 172.21.15.26:0/2998140001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0ad960 0x7f152c15b0a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f152c0cc910 tx=0x7f151c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.688+0000 7f1533200640 1 -- 172.21.15.26:0/2998140001 shutdown_connections 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.688+0000 7f1533200640 1 --2- 172.21.15.26:0/2998140001 >> v2:172.21.15.2:3300/0 conn(0x7f152c0add30 0x7f152c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.688+0000 7f1533200640 1 --2- 172.21.15.26:0/2998140001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0ad960 0x7f152c15b0a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.688+0000 7f1533200640 1 -- 172.21.15.26:0/2998140001 >> 172.21.15.26:0/2998140001 conn(0x7f152c066e60 msgr2=0x7f152c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.688+0000 7f1533200640 1 -- 172.21.15.26:0/2998140001 shutdown_connections 2024-08-17T02:45:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.688+0000 7f1533200640 1 -- 172.21.15.26:0/2998140001 wait complete. 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.689+0000 7f1533200640 1 Processor -- start 2024-08-17T02:45:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.689+0000 7f1533200640 1 -- start start 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.690+0000 7f1533200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152c0ad960 0x7f152c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.690+0000 7f1533200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0add30 0x7f152c0ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.690+0000 7f1533200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f152c0ca050 0x7f152c0a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.690+0000 7f1533200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c14bc00 con 0x7f152c0ad960 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.690+0000 7f1533200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0ab760 con 0x7f152c0add30 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.690+0000 7f1533200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0a8d30 con 0x7f152c0ca050 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.690+0000 7f152b400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0add30 0x7f152c0ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.690+0000 7f152be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152c0ad960 0x7f152c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f152b400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0add30 0x7f152c0ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43132/0 (socket says 172.21.15.26:43132) 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f152b400640 1 -- 172.21.15.26:0/230516077 learned_addr learned my addr 172.21.15.26:0/230516077 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f1531200640 1 --2- 172.21.15.26:0/230516077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f152c0ca050 0x7f152c0a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f152b400640 1 -- 172.21.15.26:0/230516077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f152c0ca050 msgr2=0x7f152c0a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f152b400640 1 --2- 172.21.15.26:0/230516077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f152c0ca050 0x7f152c0a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f152b400640 1 -- 172.21.15.26:0/230516077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152c0ad960 msgr2=0x7f152c14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f152b400640 1 --2- 172.21.15.26:0/230516077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152c0ad960 0x7f152c14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f152b400640 1 -- 172.21.15.26:0/230516077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c009450 con 0x7f152c0add30 2024-08-17T02:45:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.691+0000 7f152b400640 1 --2- 172.21.15.26:0/230516077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0add30 0x7f152c0ac380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f151800c7e0 tx=0x7f1518007bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.692+0000 7f1523400640 1 -- 172.21.15.26:0/230516077 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800a640 con 0x7f152c0add30 2024-08-17T02:45:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.692+0000 7f1523400640 1 -- 172.21.15.26:0/230516077 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151800a7c0 con 0x7f152c0add30 2024-08-17T02:45:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.692+0000 7f1523400640 1 -- 172.21.15.26:0/230516077 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800ab80 con 0x7f152c0add30 2024-08-17T02:45:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.692+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c0a9010 con 0x7f152c0add30 2024-08-17T02:45:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.692+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c0a95d0 con 0x7f152c0add30 2024-08-17T02:45:56.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.692+0000 7f1523400640 1 -- 172.21.15.26:0/230516077 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1518012420 con 0x7f152c0add30 2024-08-17T02:45:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.692+0000 7f1523400640 1 -- 172.21.15.26:0/230516077 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f1518011380 con 0x7f152c0add30 2024-08-17T02:45:56.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.693+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c063fb0 con 0x7f152c0add30 2024-08-17T02:45:56.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.695+0000 7f1523400640 1 -- 172.21.15.26:0/230516077 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f152c15b5e0 con 0x7f152c0add30 2024-08-17T02:45:56.719 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:56.719+0000 7ff401a15ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:45:56.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.770+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00d2db92-f8ce-4a86-94b4-60080a276b05", "id": 4} v 0) v1 -- 0x7f152c152680 con 0x7f152c0add30 2024-08-17T02:45:56.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.774+0000 7f1523400640 1 -- 172.21.15.26:0/230516077 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00d2db92-f8ce-4a86-94b4-60080a276b05", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f15180126d0 con 0x7f152c0add30 2024-08-17T02:45:56.775 INFO:teuthology.orchestra.run.smithi026.stdout:4 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0add30 msgr2=0x7f152c0ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 --2- 172.21.15.26:0/230516077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0add30 0x7f152c0ac380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f151800c7e0 tx=0x7f1518007bd0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 shutdown_connections 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 --2- 172.21.15.26:0/230516077 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f152c0ca050 0x7f152c0a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 --2- 172.21.15.26:0/230516077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f152c0add30 0x7f152c0ac380 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 --2- 172.21.15.26:0/230516077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f152c0ad960 0x7f152c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 >> 172.21.15.26:0/230516077 conn(0x7f152c066e60 msgr2=0x7f152c154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 shutdown_connections 2024-08-17T02:45:56.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.775+0000 7f1533200640 1 -- 172.21.15.26:0/230516077 wait complete. 2024-08-17T02:45:56.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 28352cad-5d51-4699-b770-28f35da20025 5 2024-08-17T02:45:56.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.941+0000 7fbed0e00640 1 Processor -- start 2024-08-17T02:45:56.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.941+0000 7fbed0e00640 1 -- start start 2024-08-17T02:45:56.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.943+0000 7fbed0e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbecc158e80 0x7fbecc0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.943+0000 7fbed0e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0b31d0 con 0x7fbecc0b1df0 2024-08-17T02:45:56.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.943+0000 7fbed0e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0b34a0 con 0x7fbecc0b21c0 2024-08-17T02:45:56.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.943+0000 7fbed0e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc0b3780 con 0x7fbecc158e80 2024-08-17T02:45:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.943+0000 7fbeca800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbecc158e80 0x7fbecc0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.943+0000 7fbeca800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbecc158e80 0x7fbecc0ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43136/0 (socket says 172.21.15.26:43136) 2024-08-17T02:45:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.943+0000 7fbeca800640 1 -- 172.21.15.26:0/101676529 learned_addr learned my addr 172.21.15.26:0/101676529 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.943+0000 7fbec9400640 1 --1- 172.21.15.26:0/101676529 >> v1:172.21.15.26:6789/0 conn(0x7fbecc0b21c0 0x7fbecc158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60582/0 (socket says 172.21.15.26:60582) 2024-08-17T02:45:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.944+0000 7fbeca800640 1 -- 172.21.15.26:0/101676529 >> v1:172.21.15.26:6789/0 conn(0x7fbecc0b21c0 legacy=0x7fbecc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.944+0000 7fbeca800640 1 -- 172.21.15.26:0/101676529 >> v1:172.21.15.2:6789/0 conn(0x7fbecc0b1df0 legacy=0x7fbecc0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.944+0000 7fbec8a00640 1 -- 172.21.15.26:0/101676529 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678970572 0 0) 0x7fbecc0b31d0 con 0x7fbecc0b1df0 2024-08-17T02:45:56.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.944+0000 7fbeca800640 1 -- 172.21.15.26:0/101676529 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0b3a60 con 0x7fbecc158e80 2024-08-17T02:45:56.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.945+0000 7fbeca800640 1 --2- 172.21.15.26:0/101676529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc158e80 0x7fbecc0ca930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009f20 tx=0x7fbec4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa7c99c3aab791bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.945+0000 7fbec8a00640 1 -- 172.21.15.26:0/101676529 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4032460 con 0x7fbecc158e80 2024-08-17T02:45:56.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.945+0000 7fbec8a00640 1 -- 172.21.15.26:0/101676529 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec40325c0 con 0x7fbecc158e80 2024-08-17T02:45:56.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.945+0000 7fbec8a00640 1 -- 172.21.15.26:0/101676529 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4032960 con 0x7fbecc158e80 2024-08-17T02:45:56.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.946+0000 7fbed0e00640 1 -- 172.21.15.26:0/101676529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc158e80 msgr2=0x7fbecc0ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.946+0000 7fbed0e00640 1 --2- 172.21.15.26:0/101676529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc158e80 0x7fbecc0ca930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009f20 tx=0x7fbec4009840 comp rx=0 tx=0).stop 2024-08-17T02:45:56.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.946+0000 7fbed0e00640 1 -- 172.21.15.26:0/101676529 shutdown_connections 2024-08-17T02:45:56.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.946+0000 7fbed0e00640 1 --2- 172.21.15.26:0/101676529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc158e80 0x7fbecc0ca930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.946+0000 7fbed0e00640 1 -- 172.21.15.26:0/101676529 >> 172.21.15.26:0/101676529 conn(0x7fbecc06e590 msgr2=0x7fbecc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:56.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.946+0000 7fbed0e00640 1 -- 172.21.15.26:0/101676529 shutdown_connections 2024-08-17T02:45:56.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.946+0000 7fbed0e00640 1 -- 172.21.15.26:0/101676529 wait complete. 2024-08-17T02:45:56.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.948+0000 7fbed0e00640 1 Processor -- start 2024-08-17T02:45:56.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.948+0000 7fbed0e00640 1 -- start start 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbed0e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc0b1df0 0x7fbecc15e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbed0e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc0b21c0 0x7fbecc0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbed0e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbecc158e80 0x7fbecc0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbed0e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc15fcf0 con 0x7fbecc0b21c0 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbed0e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1526a0 con 0x7fbecc0b1df0 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbed0e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc15f860 con 0x7fbecc158e80 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbec9e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc0b1df0 0x7fbecc15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbec9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc0b21c0 0x7fbecc0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbeca800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbecc158e80 0x7fbecc0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:56.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbec9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc0b21c0 0x7fbecc0c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.26:33236/0 (socket says 172.21.15.26:33236) 2024-08-17T02:45:56.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbec9400640 1 -- 172.21.15.26:0/4125500150 learned_addr learned my addr 172.21.15.26:0/4125500150 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:56.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.949+0000 7fbec9e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc0b1df0 0x7fbecc15e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43148/0 (socket says 172.21.15.26:43148) 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec9400640 1 -- 172.21.15.26:0/4125500150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbecc158e80 msgr2=0x7fbecc0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec9400640 1 --2- 172.21.15.26:0/4125500150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbecc158e80 0x7fbecc0ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec9400640 1 -- 172.21.15.26:0/4125500150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc0b1df0 msgr2=0x7fbecc15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec9400640 1 --2- 172.21.15.26:0/4125500150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc0b1df0 0x7fbecc15e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec9400640 1 -- 172.21.15.26:0/4125500150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4009ae0 con 0x7fbecc0b21c0 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec9400640 1 --2- 172.21.15.26:0/4125500150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc0b21c0 0x7fbecc0c8850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c590 tx=0x7fbeb8007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec1600640 1 -- 172.21.15.26:0/4125500150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80072e0 con 0x7fbecc0b21c0 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec1600640 1 -- 172.21.15.26:0/4125500150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb8007480 con 0x7fbecc0b21c0 2024-08-17T02:45:56.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc15e940 con 0x7fbecc0b21c0 2024-08-17T02:45:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.950+0000 7fbec1600640 1 -- 172.21.15.26:0/4125500150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80047a0 con 0x7fbecc0b21c0 2024-08-17T02:45:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.951+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc15f210 con 0x7fbecc0b21c0 2024-08-17T02:45:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.951+0000 7fbec1600640 1 -- 172.21.15.26:0/4125500150 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbeb8004bd0 con 0x7fbecc0b21c0 2024-08-17T02:45:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.951+0000 7fbec1600640 1 -- 172.21.15.26:0/4125500150 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fbeb8013400 con 0x7fbecc0b21c0 2024-08-17T02:45:56.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.952+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc063fb0 con 0x7fbecc0b21c0 2024-08-17T02:45:56.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:56.954+0000 7fbec1600640 1 -- 172.21.15.26:0/4125500150 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbeb80139f0 con 0x7fbecc0b21c0 2024-08-17T02:45:57.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.031+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd new", "uuid": "28352cad-5d51-4699-b770-28f35da20025", "id": 5} v 0) v1 -- 0x7fbecc0ca380 con 0x7fbecc0b21c0 2024-08-17T02:45:57.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.034+0000 7fbec1600640 1 -- 172.21.15.26:0/4125500150 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28352cad-5d51-4699-b770-28f35da20025", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbeb8013b90 con 0x7fbecc0b21c0 2024-08-17T02:45:57.035 INFO:teuthology.orchestra.run.smithi026.stdout:5 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc0b21c0 msgr2=0x7fbecc0c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 --2- 172.21.15.26:0/4125500150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc0b21c0 0x7fbecc0c8850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c590 tx=0x7fbeb8007ee0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 shutdown_connections 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 --2- 172.21.15.26:0/4125500150 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbecc158e80 0x7fbecc0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 --2- 172.21.15.26:0/4125500150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbecc0b21c0 0x7fbecc0c8850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 --2- 172.21.15.26:0/4125500150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbecc0b1df0 0x7fbecc15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 >> 172.21.15.26:0/4125500150 conn(0x7fbecc06e590 msgr2=0x7fbecc155520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 shutdown_connections 2024-08-17T02:45:57.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.036+0000 7fbed0e00640 1 -- 172.21.15.26:0/4125500150 wait complete. 2024-08-17T02:45:57.056 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93 6 2024-08-17T02:45:57.079 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:57.076+0000 7fca49218ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:45:57.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.203+0000 7f0832400640 1 Processor -- start 2024-08-17T02:45:57.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.203+0000 7f0832400640 1 -- start start 2024-08-17T02:45:57.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f0832400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f082c06e060 0x7f082c06e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f0832400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c0aeeb0 con 0x7f082c155040 2024-08-17T02:45:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f0832400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c06e9f0 con 0x7f082c0af340 2024-08-17T02:45:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f0832400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082c0aadd0 con 0x7f082c06e060 2024-08-17T02:45:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f0823e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f082c06e060 0x7f082c06e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f082b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f082c155040 0x7f082c158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.26:36764/0 (socket says 172.21.15.26:36764) 2024-08-17T02:45:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f082b400640 1 -- 172.21.15.26:0/3266332858 learned_addr learned my addr 172.21.15.26:0/3266332858 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-08-17T02:45:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f0823e00640 1 -- 172.21.15.26:0/3266332858 >> v1:172.21.15.26:6789/0 conn(0x7f082c0af340 legacy=0x7f082c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f082aa00640 1 -- 172.21.15.26:0/3266332858 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522456761 0 0) 0x7f082c0aeeb0 con 0x7f082c155040 2024-08-17T02:45:57.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f0823e00640 1 -- 172.21.15.26:0/3266332858 >> v1:172.21.15.2:6789/0 conn(0x7f082c155040 legacy=0x7f082c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.205+0000 7f0823e00640 1 -- 172.21.15.26:0/3266332858 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c1597f0 con 0x7f082c06e060 2024-08-17T02:45:57.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.206+0000 7f0823e00640 1 --2- 172.21.15.26:0/3266332858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c06e4b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0814009850 tx=0x7f08140090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb144c867709bf77 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.207+0000 7f082aa00640 1 -- 172.21.15.26:0/3266332858 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081402ad00 con 0x7f082c06e060 2024-08-17T02:45:57.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.207+0000 7f082aa00640 1 -- 172.21.15.26:0/3266332858 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081402ae60 con 0x7f082c06e060 2024-08-17T02:45:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.207+0000 7f082aa00640 1 -- 172.21.15.26:0/3266332858 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814032670 con 0x7f082c06e060 2024-08-17T02:45:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.207+0000 7f0832400640 1 -- 172.21.15.26:0/3266332858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 msgr2=0x7f082c06e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.207+0000 7f0832400640 1 --2- 172.21.15.26:0/3266332858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c06e4b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0814009850 tx=0x7f08140090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.207+0000 7f0832400640 1 -- 172.21.15.26:0/3266332858 shutdown_connections 2024-08-17T02:45:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.207+0000 7f0832400640 1 --2- 172.21.15.26:0/3266332858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c06e4b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.207+0000 7f0832400640 1 -- 172.21.15.26:0/3266332858 >> 172.21.15.26:0/3266332858 conn(0x7f082c066e60 msgr2=0x7f082c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.208+0000 7f0832400640 1 -- 172.21.15.26:0/3266332858 shutdown_connections 2024-08-17T02:45:57.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.208+0000 7f0832400640 1 -- 172.21.15.26:0/3266332858 wait complete. 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.209+0000 7f0832400640 1 Processor -- start 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.209+0000 7f0832400640 1 -- start start 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f0832400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f0832400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f082c0af340 0x7f082c15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f0832400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f082c155040 0x7f082c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f0832400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c15d910 con 0x7f082c155040 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f0832400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c157310 con 0x7f082c06e060 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f0832400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c1575f0 con 0x7f082c0af340 2024-08-17T02:45:57.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f082b400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f0823e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f082c0af340 0x7f082c15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f082b400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43170/0 (socket says 172.21.15.26:43170) 2024-08-17T02:45:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f082b400640 1 -- 172.21.15.26:0/2209012903 learned_addr learned my addr 172.21.15.26:0/2209012903 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.210+0000 7f082be00640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f082c155040 0x7f082c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f082b400640 1 -- 172.21.15.26:0/2209012903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f082c0af340 msgr2=0x7f082c15bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f082b400640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f082c0af340 0x7f082c15bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f082b400640 1 -- 172.21.15.26:0/2209012903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f082c155040 msgr2=0x7f082c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f082b400640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f082c155040 0x7f082c15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f082b400640 1 -- 172.21.15.26:0/2209012903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814009390 con 0x7f082c06e060 2024-08-17T02:45:57.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f0823e00640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f082c0af340 0x7f082c15bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:45:57.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f082b400640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c158750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c510 tx=0x7f081c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f0822a00640 1 -- 172.21.15.26:0/2209012903 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c005aa0 con 0x7f082c06e060 2024-08-17T02:45:57.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f0822a00640 1 -- 172.21.15.26:0/2209012903 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c005c00 con 0x7f082c06e060 2024-08-17T02:45:57.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f0822a00640 1 -- 172.21.15.26:0/2209012903 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c0070d0 con 0x7f082c06e060 2024-08-17T02:45:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c1578d0 con 0x7f082c06e060 2024-08-17T02:45:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.211+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c158c90 con 0x7f082c06e060 2024-08-17T02:45:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.212+0000 7f0822a00640 1 -- 172.21.15.26:0/2209012903 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f081c007500 con 0x7f082c06e060 2024-08-17T02:45:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.212+0000 7f0822a00640 1 -- 172.21.15.26:0/2209012903 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f081c01c440 con 0x7f082c06e060 2024-08-17T02:45:57.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.213+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c158f40 con 0x7f082c06e060 2024-08-17T02:45:57.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.215+0000 7f0822a00640 1 -- 172.21.15.26:0/2209012903 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f081c017070 con 0x7f082c06e060 2024-08-17T02:45:57.254 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:57.253+0000 7ff401a15ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:45:57.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.291+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93", "id": 6} v 0) v1 -- 0x7f082c063fb0 con 0x7f082c06e060 2024-08-17T02:45:57.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.295+0000 7f0822a00640 1 -- 172.21.15.26:0/2209012903 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f081c01c990 con 0x7f082c06e060 2024-08-17T02:45:57.296 INFO:teuthology.orchestra.run.smithi026.stdout:6 2024-08-17T02:45:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 msgr2=0x7f082c158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c158750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c510 tx=0x7f081c00c910 comp rx=0 tx=0).stop 2024-08-17T02:45:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 shutdown_connections 2024-08-17T02:45:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f082c155040 0x7f082c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f082c0af340 0x7f082c15bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 --2- 172.21.15.26:0/2209012903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f082c06e060 0x7f082c158750 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 >> 172.21.15.26:0/2209012903 conn(0x7f082c066e60 msgr2=0x7f082c0a92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 shutdown_connections 2024-08-17T02:45:57.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.296+0000 7f0832400640 1 -- 172.21.15.26:0/2209012903 wait complete. 2024-08-17T02:45:57.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd new 4d9d3701-49b0-4975-b22e-6d73d4c53e31 7 2024-08-17T02:45:57.356 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:57.356+0000 7fca49218ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:45:57.417 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:57.417+0000 7fca49218ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:45:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.457+0000 7fbfe1c00640 1 Processor -- start 2024-08-17T02:45:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.457+0000 7fbfe1c00640 1 -- start start 2024-08-17T02:45:57.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfe1c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbfdc158a00 0x7fbfdc158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfe1c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc0cb190 0x7fbfdc0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfe1c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0cbc50 con 0x7fbfdc06e590 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfe1c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc0cbf30 con 0x7fbfdc158a00 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfe1c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0cc210 con 0x7fbfdc0cb190 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfdbe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbfdc158a00 0x7fbfdc158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfdbe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbfdc158a00 0x7fbfdc158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43176/0 (socket says 172.21.15.26:43176) 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfdbe00640 1 -- 172.21.15.26:0/1769145503 learned_addr learned my addr 172.21.15.26:0/1769145503 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.458+0000 7fbfdb400640 1 --2- 172.21.15.26:0/1769145503 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc0cb190 0x7fbfdc0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.459+0000 7fbfdbe00640 1 -- 172.21.15.26:0/1769145503 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc0cb190 msgr2=0x7fbfdc0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.459+0000 7fbfdbe00640 1 --2- 172.21.15.26:0/1769145503 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc0cb190 0x7fbfdc0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.459+0000 7fbfdbe00640 1 -- 172.21.15.26:0/1769145503 >> v1:172.21.15.2:6789/0 conn(0x7fbfdc06e590 legacy=0x7fbfdc0683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.459+0000 7fbfdaa00640 1 -- 172.21.15.26:0/1769145503 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048814524 0 0) 0x7fbfdc0cbc50 con 0x7fbfdc06e590 2024-08-17T02:45:57.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.459+0000 7fbfdbe00640 1 -- 172.21.15.26:0/1769145503 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0b2930 con 0x7fbfdc158a00 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfdbe00640 1 --2- 172.21.15.26:0/1769145503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc158a00 0x7fbfdc158dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009910 tx=0x7fbfcc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5abc83ff320b4a07 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfdaa00640 1 -- 172.21.15.26:0/1769145503 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc02ae40 con 0x7fbfdc158a00 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfdaa00640 1 -- 172.21.15.26:0/1769145503 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc032440 con 0x7fbfdc158a00 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfdaa00640 1 -- 172.21.15.26:0/1769145503 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0327e0 con 0x7fbfdc158a00 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfe1c00640 1 -- 172.21.15.26:0/1769145503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc158a00 msgr2=0x7fbfdc158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfe1c00640 1 --2- 172.21.15.26:0/1769145503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc158a00 0x7fbfdc158dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009910 tx=0x7fbfcc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfe1c00640 1 -- 172.21.15.26:0/1769145503 shutdown_connections 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfe1c00640 1 --2- 172.21.15.26:0/1769145503 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc0cb190 0x7fbfdc0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfe1c00640 1 --2- 172.21.15.26:0/1769145503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc158a00 0x7fbfdc158dd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfe1c00640 1 -- 172.21.15.26:0/1769145503 >> 172.21.15.26:0/1769145503 conn(0x7fbfdc0cfb80 msgr2=0x7fbfdc0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfe1c00640 1 -- 172.21.15.26:0/1769145503 shutdown_connections 2024-08-17T02:45:57.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.460+0000 7fbfe1c00640 1 -- 172.21.15.26:0/1769145503 wait complete. 2024-08-17T02:45:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.462+0000 7fbfe1c00640 1 Processor -- start 2024-08-17T02:45:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.463+0000 7fbfe1c00640 1 -- start start 2024-08-17T02:45:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.464+0000 7fbfe1c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc06e590 0x7fbfdc15f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.464+0000 7fbfe1c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc0cb190 0x7fbfdc157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.464+0000 7fbfe1c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc158a00 0x7fbfdc0a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.464+0000 7fbfe1c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0c6930 con 0x7fbfdc158a00 2024-08-17T02:45:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.464+0000 7fbfe1c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc15ef60 con 0x7fbfdc0cb190 2024-08-17T02:45:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.464+0000 7fbfe1c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0c6650 con 0x7fbfdc06e590 2024-08-17T02:45:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.464+0000 7fbfdbe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc06e590 0x7fbfdc15f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdbe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc06e590 0x7fbfdc15f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.26:33494/0 (socket says 172.21.15.26:33494) 2024-08-17T02:45:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdbe00640 1 -- 172.21.15.26:0/2728543748 learned_addr learned my addr 172.21.15.26:0/2728543748 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-08-17T02:45:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdb400640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc0cb190 0x7fbfdc157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfe1200640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc158a00 0x7fbfdc0a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdbe00640 1 -- 172.21.15.26:0/2728543748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc0cb190 msgr2=0x7fbfdc157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdbe00640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc0cb190 0x7fbfdc157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdbe00640 1 -- 172.21.15.26:0/2728543748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc158a00 msgr2=0x7fbfdc0a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdbe00640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc158a00 0x7fbfdc0a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdbe00640 1 -- 172.21.15.26:0/2728543748 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc009450 con 0x7fbfdc06e590 2024-08-17T02:45:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfe1200640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc158a00 0x7fbfdc0a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.465+0000 7fbfdbe00640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc06e590 0x7fbfdc15f3f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc02a840 tx=0x7fbfcc032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.466+0000 7fbfd3400640 1 -- 172.21.15.26:0/2728543748 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc006b30 con 0x7fbfdc06e590 2024-08-17T02:45:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.466+0000 7fbfd3400640 1 -- 172.21.15.26:0/2728543748 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc031a60 con 0x7fbfdc06e590 2024-08-17T02:45:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.466+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc15e910 con 0x7fbfdc06e590 2024-08-17T02:45:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.466+0000 7fbfd3400640 1 -- 172.21.15.26:0/2728543748 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc031e60 con 0x7fbfdc06e590 2024-08-17T02:45:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.466+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc157950 con 0x7fbfdc06e590 2024-08-17T02:45:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.467+0000 7fbfd3400640 1 -- 172.21.15.26:0/2728543748 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbfcc03e8f0 con 0x7fbfdc06e590 2024-08-17T02:45:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.467+0000 7fbfd3400640 1 -- 172.21.15.26:0/2728543748 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fbfcc02ae40 con 0x7fbfdc06e590 2024-08-17T02:45:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.467+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc070720 con 0x7fbfdc06e590 2024-08-17T02:45:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.470+0000 7fbfd3400640 1 -- 172.21.15.26:0/2728543748 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbfcc037070 con 0x7fbfdc06e590 2024-08-17T02:45:57.533 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:57.533+0000 7fca49218ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:45:57.570 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:57.569+0000 7ff401a15ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:45:57.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.576+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4d9d3701-49b0-4975-b22e-6d73d4c53e31", "id": 7} v 0) v1 -- 0x7fbfdc0b0f10 con 0x7fbfdc06e590 2024-08-17T02:45:57.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.580+0000 7fbfd3400640 1 -- 172.21.15.26:0/2728543748 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d9d3701-49b0-4975-b22e-6d73d4c53e31", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbfcc03cb80 con 0x7fbfdc06e590 2024-08-17T02:45:57.582 INFO:teuthology.orchestra.run.smithi026.stdout:7 2024-08-17T02:45:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.581+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc06e590 msgr2=0x7fbfdc15f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.581+0000 7fbfe1c00640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc06e590 0x7fbfdc15f3f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc02a840 tx=0x7fbfcc032000 comp rx=0 tx=0).stop 2024-08-17T02:45:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.581+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 shutdown_connections 2024-08-17T02:45:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.581+0000 7fbfe1c00640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfdc158a00 0x7fbfdc0a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.581+0000 7fbfe1c00640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfdc0cb190 0x7fbfdc157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.581+0000 7fbfe1c00640 1 --2- 172.21.15.26:0/2728543748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbfdc06e590 0x7fbfdc15f3f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.581+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 >> 172.21.15.26:0/2728543748 conn(0x7fbfdc0cfb80 msgr2=0x7fbfdc0cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.582+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 shutdown_connections 2024-08-17T02:45:57.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-08-17T02:45:57.582+0000 7fbfe1c00640 1 -- 172.21.15.26:0/2728543748 wait complete. 2024-08-17T02:45:57.597 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:45:57.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:45:57.601 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:45:57.601 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:45:57.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:45:57.605 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:45:57.605 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:45:57.605 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:45:57.609 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:45:57.609 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:45:57.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:45:57.614 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:45:57.615 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:45:57.615 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:45:57.619 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:45:57.620 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:45:57.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:45:57.625 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:45:57.626 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:45:57.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:45:57.631 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:45:57.631 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:45:57.631 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:45:57.636 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:45:57.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:57.638 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:57.636+0000 7ff401a15ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:45:57.806 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:57.805+0000 7ff401a15ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:45:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.830+0000 7f066ea00640 1 Processor -- start 2024-08-17T02:45:57.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.830+0000 7f066ea00640 1 -- start start 2024-08-17T02:45:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066ea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0668158c60 0x7f066815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066ea00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066ea00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066815b6b0 con 0x7f0668159420 2024-08-17T02:45:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066ea00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680b0540 con 0x7f0668158c60 2024-08-17T02:45:57.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066ea00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066815aac0 con 0x7f0668159030 2024-08-17T02:45:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066cc00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066d600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0668158c60 0x7f066815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066cc00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:36758/0 (socket says 172.21.15.2:36758) 2024-08-17T02:45:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.831+0000 7f066cc00640 1 -- 172.21.15.2:0/3182361119 learned_addr learned my addr 172.21.15.2:0/3182361119 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:45:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.832+0000 7f066cc00640 1 -- 172.21.15.2:0/3182361119 >> v2:172.21.15.2:3300/0 conn(0x7f0668158c60 msgr2=0x7f066815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:57.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.832+0000 7f066cc00640 1 --2- 172.21.15.2:0/3182361119 >> v2:172.21.15.2:3300/0 conn(0x7f0668158c60 0x7f066815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.832+0000 7f066cc00640 1 -- 172.21.15.2:0/3182361119 >> v1:172.21.15.26:6789/0 conn(0x7f0668159420 legacy=0x7f06680b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.832+0000 7f066cc00640 1 -- 172.21.15.2:0/3182361119 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066815ad80 con 0x7f0668159030 2024-08-17T02:45:57.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.832+0000 7f066d600640 1 --2- 172.21.15.2:0/3182361119 >> v2:172.21.15.2:3300/0 conn(0x7f0668158c60 0x7f066815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:45:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.833+0000 7f066cc00640 1 --2- 172.21.15.2:0/3182361119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680ca8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0658009910 tx=0x7f06580091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2830ef2fa88b1ec1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.833+0000 7f0667e00640 1 -- 172.21.15.2:0/3182361119 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065802adb0 con 0x7f0668159030 2024-08-17T02:45:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.833+0000 7f0667e00640 1 -- 172.21.15.2:0/3182361119 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0658032440 con 0x7f0668159030 2024-08-17T02:45:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.833+0000 7f0667e00640 1 -- 172.21.15.2:0/3182361119 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658032820 con 0x7f0668159030 2024-08-17T02:45:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.834+0000 7f066ea00640 1 -- 172.21.15.2:0/3182361119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 msgr2=0x7f06680ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.834+0000 7f066ea00640 1 --2- 172.21.15.2:0/3182361119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680ca8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0658009910 tx=0x7f06580091d0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.834+0000 7f066ea00640 1 -- 172.21.15.2:0/3182361119 shutdown_connections 2024-08-17T02:45:57.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.834+0000 7f066ea00640 1 --2- 172.21.15.2:0/3182361119 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680ca8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.834+0000 7f066ea00640 1 --2- 172.21.15.2:0/3182361119 >> v2:172.21.15.2:3300/0 conn(0x7f0668158c60 0x7f066815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.834+0000 7f066ea00640 1 -- 172.21.15.2:0/3182361119 >> 172.21.15.2:0/3182361119 conn(0x7f066806e590 msgr2=0x7f066806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.834+0000 7f066ea00640 1 -- 172.21.15.2:0/3182361119 shutdown_connections 2024-08-17T02:45:57.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.834+0000 7f066ea00640 1 -- 172.21.15.2:0/3182361119 wait complete. 2024-08-17T02:45:57.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.835+0000 7f066ea00640 1 Processor -- start 2024-08-17T02:45:57.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.835+0000 7f066ea00640 1 -- start start 2024-08-17T02:45:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066ea00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0668158c60 0x7f0668157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066ea00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668159420 0x7f06680cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066ea00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680c4600 con 0x7f0668159420 2024-08-17T02:45:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066ea00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668157d50 con 0x7f0668158c60 2024-08-17T02:45:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066ea00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06680c39f0 con 0x7f0668159030 2024-08-17T02:45:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668159420 0x7f06680cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668159420 0x7f06680cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39652/0 (socket says 172.21.15.2:39652) 2024-08-17T02:45:57.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066e000640 1 -- 172.21.15.2:0/850673065 learned_addr learned my addr 172.21.15.2:0/850673065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:45:57.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.836+0000 7f066cc00640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.837+0000 7f066d600640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0668158c60 0x7f0668157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:57.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.837+0000 7f066e000640 1 -- 172.21.15.2:0/850673065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 msgr2=0x7f06680c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.837+0000 7f066e000640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.837+0000 7f066e000640 1 -- 172.21.15.2:0/850673065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0668158c60 msgr2=0x7f0668157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.837+0000 7f066e000640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0668158c60 0x7f0668157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.837+0000 7f066e000640 1 -- 172.21.15.2:0/850673065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0658009450 con 0x7f0668159420 2024-08-17T02:45:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.837+0000 7f066e000640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668159420 0x7f06680cff80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f066000c7c0 tx=0x7f06600015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.837+0000 7f0664c00640 1 -- 172.21.15.2:0/850673065 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000a640 con 0x7f0668159420 2024-08-17T02:45:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.838+0000 7f0664c00640 1 -- 172.21.15.2:0/850673065 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066000a7c0 con 0x7f0668159420 2024-08-17T02:45:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.838+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06680c3cd0 con 0x7f0668159420 2024-08-17T02:45:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.838+0000 7f0664c00640 1 -- 172.21.15.2:0/850673065 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000ab80 con 0x7f0668159420 2024-08-17T02:45:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.838+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06680c4290 con 0x7f0668159420 2024-08-17T02:45:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.838+0000 7f0664c00640 1 -- 172.21.15.2:0/850673065 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0660003030 con 0x7f0668159420 2024-08-17T02:45:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.838+0000 7f0664c00640 1 -- 172.21.15.2:0/850673065 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f066001bae0 con 0x7f0668159420 2024-08-17T02:45:57.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.839+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06680c4770 con 0x7f0668159420 2024-08-17T02:45:57.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.841+0000 7f0664c00640 1 -- 172.21.15.2:0/850673065 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0660012530 con 0x7f0668159420 2024-08-17T02:45:57.891 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:57.891+0000 7fca49218ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:45:57.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.905+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0668070720 con 0x7f0668159420 2024-08-17T02:45:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.905+0000 7f0664c00640 1 -- 172.21.15.2:0/850673065 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f0660012a60 con 0x7f0668159420 2024-08-17T02:45:57.905 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:45:57.905 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:45:57.579302+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:57.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668159420 msgr2=0x7f06680cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668159420 0x7f06680cff80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f066000c7c0 tx=0x7f06600015f0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 shutdown_connections 2024-08-17T02:45:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0668159420 0x7f06680cff80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0668159030 0x7f06680c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 --2- 172.21.15.2:0/850673065 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0668158c60 0x7f0668157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 >> 172.21.15.2:0/850673065 conn(0x7f066806e590 msgr2=0x7f06680b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 shutdown_connections 2024-08-17T02:45:57.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:45:57.906+0000 7f066ea00640 1 -- 172.21.15.2:0/850673065 wait complete. 2024-08-17T02:45:57.922 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:45:57.922 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:45:57.949 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:57.949+0000 7fca49218ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:45:58.122 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:58.121+0000 7ff401a15ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:45:58.134 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:58.135+0000 7fca49218ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:45:58.178 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:58.176+0000 7ff401a15ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:45:58.194 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:58.194+0000 7fca49218ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:45:58.276 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:58.276+0000 7fca49218ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:45:58.294 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:45:58.294+0000 7fd21e3232c0 -1 Falling back to public interface 2024-08-17T02:45:58.298 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-08-17T02:45:58.299+0000 7f2abf02f2c0 -1 Falling back to public interface 2024-08-17T02:45:58.302 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-08-17T02:45:58.303+0000 7f8c3c1212c0 -1 Falling back to public interface 2024-08-17T02:45:58.307 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-08-17T02:45:58.306+0000 7f3a0c8732c0 -1 Falling back to public interface 2024-08-17T02:45:58.319 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-08-17T02:45:58.318+0000 7f3981e342c0 -1 Falling back to public interface 2024-08-17T02:45:58.321 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-08-17T02:45:58.321+0000 7f7df000c2c0 -1 Falling back to public interface 2024-08-17T02:45:58.329 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-08-17T02:45:58.327+0000 7f436ef2f2c0 -1 Falling back to public interface 2024-08-17T02:45:58.331 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:58.331+0000 7fca49218ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:45:58.349 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-08-17T02:45:58.348+0000 7faf469532c0 -1 Falling back to public interface 2024-08-17T02:45:58.366 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:58.364+0000 7ff401a15ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:45:58.425 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:58.424+0000 7ff401a15ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:45:58.509 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:58.507+0000 7ff401a15ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:45:58.562 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:58.560+0000 7ff401a15ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:45:58.729 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:45:58.862 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.862+0000 7f3688c00640 1 Processor -- start 2024-08-17T02:45:58.863 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.862+0000 7f3688c00640 1 -- start start 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.863+0000 7f3688c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3684159180 0x7f36840caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3688c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36840d0030 0x7f36840d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3688c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36840af2c0 con 0x7f3684158db0 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3688c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36840d09a0 con 0x7f3684159180 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3688c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36840b0410 con 0x7f36840d0030 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3681e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3684158db0 0x7f36840af8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47008/0 (socket says 172.21.15.2:47008) 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3681400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3684159180 0x7f36840caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3681e00640 1 -- 172.21.15.2:0/670760877 learned_addr learned my addr 172.21.15.2:0/670760877 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:45:58.864 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3682800640 1 --2- 172.21.15.2:0/670760877 >> v2:172.21.15.26:3300/0 conn(0x7f36840d0030 0x7f36840d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:58.865 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3681400640 1 -- 172.21.15.2:0/670760877 >> v2:172.21.15.26:3300/0 conn(0x7f36840d0030 msgr2=0x7f36840d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:45:58.865 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3681400640 1 --2- 172.21.15.2:0/670760877 >> v2:172.21.15.26:3300/0 conn(0x7f36840d0030 0x7f36840d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.865 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3680a00640 1 -- 172.21.15.2:0/670760877 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523556468 0 0) 0x7f36840af2c0 con 0x7f3684158db0 2024-08-17T02:45:58.865 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3681400640 1 -- 172.21.15.2:0/670760877 >> v1:172.21.15.2:6789/0 conn(0x7f3684158db0 legacy=0x7f36840af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:58.865 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.864+0000 7f3681400640 1 -- 172.21.15.2:0/670760877 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36840b3c60 con 0x7f3684159180 2024-08-17T02:45:58.866 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.865+0000 7f3681400640 1 --2- 172.21.15.2:0/670760877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3684159180 0x7f36840caad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f36840b5dd0 tx=0x7f36700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270d49399650427a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:58.866 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3680a00640 1 -- 172.21.15.2:0/670760877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367002adb0 con 0x7f3684159180 2024-08-17T02:45:58.866 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3680a00640 1 -- 172.21.15.2:0/670760877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670032440 con 0x7f3684159180 2024-08-17T02:45:58.867 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3680a00640 1 -- 172.21.15.2:0/670760877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700327e0 con 0x7f3684159180 2024-08-17T02:45:58.867 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3688c00640 1 -- 172.21.15.2:0/670760877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3684159180 msgr2=0x7f36840caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:58.867 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3688c00640 1 --2- 172.21.15.2:0/670760877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3684159180 0x7f36840caad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f36840b5dd0 tx=0x7f36700090f0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.867 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3688c00640 1 -- 172.21.15.2:0/670760877 shutdown_connections 2024-08-17T02:45:58.867 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3688c00640 1 --2- 172.21.15.2:0/670760877 >> v2:172.21.15.26:3300/0 conn(0x7f36840d0030 0x7f36840d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.867 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3688c00640 1 --2- 172.21.15.2:0/670760877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3684159180 0x7f36840caad0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.867 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.866+0000 7f3688c00640 1 -- 172.21.15.2:0/670760877 >> 172.21.15.2:0/670760877 conn(0x7f3684062bf0 msgr2=0x7f3684062ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:58.867 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.867+0000 7f3688c00640 1 -- 172.21.15.2:0/670760877 shutdown_connections 2024-08-17T02:45:58.868 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.867+0000 7f3688c00640 1 -- 172.21.15.2:0/670760877 wait complete. 2024-08-17T02:45:58.869 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.869+0000 7f3688c00640 1 Processor -- start 2024-08-17T02:45:58.869 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.869+0000 7f3688c00640 1 -- start start 2024-08-17T02:45:58.871 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.870+0000 7f3688c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36840d0030 0x7f36840c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:58.871 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.870+0000 7f3688c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3684158db0 0x7f36840c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:58.871 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.870+0000 7f3688c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3684159180 0x7f36840cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:45:58.871 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.870+0000 7f3688c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36840c48e0 con 0x7f36840d0030 2024-08-17T02:45:58.871 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.870+0000 7f3688c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36840c3cd0 con 0x7f3684158db0 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.870+0000 7f3688c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36840c3fb0 con 0x7f3684159180 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36840d0030 0x7f36840c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36840d0030 0x7f36840c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39680/0 (socket says 172.21.15.2:39680) 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 -- 172.21.15.2:0/1725248515 learned_addr learned my addr 172.21.15.2:0/1725248515 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3682800640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3684159180 0x7f36840cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681400640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3684158db0 0x7f36840c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 -- 172.21.15.2:0/1725248515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3684159180 msgr2=0x7f36840cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3684159180 0x7f36840cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 -- 172.21.15.2:0/1725248515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3684158db0 msgr2=0x7f36840c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3684158db0 0x7f36840c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.872 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 -- 172.21.15.2:0/1725248515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009390 con 0x7f36840d0030 2024-08-17T02:45:58.873 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.871+0000 7f3681e00640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36840d0030 0x7f36840c4d70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f367400c510 tx=0x7f367400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:45:58.874 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.872+0000 7f3679600640 1 -- 172.21.15.2:0/1725248515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674005aa0 con 0x7f36840d0030 2024-08-17T02:45:58.874 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.872+0000 7f3679600640 1 -- 172.21.15.2:0/1725248515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674005c00 con 0x7f36840d0030 2024-08-17T02:45:58.874 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.872+0000 7f3679600640 1 -- 172.21.15.2:0/1725248515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36740070d0 con 0x7f36840d0030 2024-08-17T02:45:58.874 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.872+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36840c4290 con 0x7f36840d0030 2024-08-17T02:45:58.874 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.872+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36840c9ae0 con 0x7f36840d0030 2024-08-17T02:45:58.874 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.872+0000 7f3679600640 1 -- 172.21.15.2:0/1725248515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3674007500 con 0x7f36840d0030 2024-08-17T02:45:58.874 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.872+0000 7f3679600640 1 -- 172.21.15.2:0/1725248515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f367401c440 con 0x7f36840d0030 2024-08-17T02:45:58.874 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.873+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3684064540 con 0x7f36840d0030 2024-08-17T02:45:58.875 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.875+0000 7f3679600640 1 -- 172.21.15.2:0/1725248515 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3674017070 con 0x7f36840d0030 2024-08-17T02:45:58.885 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:58.885+0000 7fca49218ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:45:58.939 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.939+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36840b38c0 con 0x7f36840d0030 2024-08-17T02:45:58.940 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.940+0000 7f3679600640 1 -- 172.21.15.2:0/1725248515 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f3674024410 con 0x7f36840d0030 2024-08-17T02:45:58.940 INFO:teuthology.misc.health.smithi002.stdout: 2024-08-17T02:45:58.940 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":10,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:45:57.579302+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:45:58.941 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36840d0030 msgr2=0x7f36840c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:45:58.941 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36840d0030 0x7f36840c4d70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f367400c510 tx=0x7f367400c910 comp rx=0 tx=0).stop 2024-08-17T02:45:58.941 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 shutdown_connections 2024-08-17T02:45:58.942 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3684159180 0x7f36840cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.942 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3684158db0 0x7f36840c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.942 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 --2- 172.21.15.2:0/1725248515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36840d0030 0x7f36840c4d70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:45:58.942 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 >> 172.21.15.2:0/1725248515 conn(0x7f3684062bf0 msgr2=0x7f36841575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:45:58.942 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 shutdown_connections 2024-08-17T02:45:58.942 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:45:58.941+0000 7f3688c00640 1 -- 172.21.15.2:0/1725248515 wait complete. 2024-08-17T02:45:58.953 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:45:59.001 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:45:59.001+0000 7fca49218ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:45:59.112 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:59.110+0000 7ff401a15ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:45:59.226 INFO:tasks.ceph.mgr.x.smithi026.stderr:2024-08-17T02:45:59.224+0000 7ff401a15ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:46:00.020 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:46:00.019+0000 7fca2da00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:46:00.020 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-08-17T02:46:00.020+0000 7fca2da00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:46:01.811 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:46:01.809+0000 7fd21e3232c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:46:01.877 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-08-17T02:46:01.876+0000 7f8c3c1212c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:46:01.890 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-08-17T02:46:01.888+0000 7f2abf02f2c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:46:01.893 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-08-17T02:46:01.891+0000 7f3a0c8732c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:46:01.929 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-08-17T02:46:01.927+0000 7f3981e342c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:46:01.954 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-08-17T02:46:01.953+0000 7f7df000c2c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:46:01.954 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-08-17T02:46:01.953+0000 7faf469532c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:46:01.956 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-08-17T02:46:01.954+0000 7f436ef2f2c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:46:04.702 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-08-17T02:46:04.700+0000 7f397bc00640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:46:04.712 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-08-17T02:46:04.711+0000 7f8c35800640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:46:04.713 INFO:tasks.ceph.osd.6.smithi026.stderr:2024-08-17T02:46:04.708+0000 7f3973000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:04.721 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-08-17T02:46:04.721+0000 7f8c2cc00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:04.743 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-08-17T02:46:04.741+0000 7f3a06600640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:46:04.750 INFO:tasks.ceph.osd.5.smithi026.stderr:2024-08-17T02:46:04.749+0000 7f39fda00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:04.755 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-08-17T02:46:04.755+0000 7f2ab8e00640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:46:04.762 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-08-17T02:46:04.761+0000 7f2ab0200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:04.767 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:46:04.766+0000 7fd217a00640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:46:04.767 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-08-17T02:46:04.766+0000 7faf41e00640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:46:04.773 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-08-17T02:46:04.772+0000 7fd20ee00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:04.774 INFO:tasks.ceph.osd.7.smithi026.stderr:2024-08-17T02:46:04.772+0000 7faf37400640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:04.781 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-08-17T02:46:04.780+0000 7f7de9400640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:46:04.786 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-08-17T02:46:04.785+0000 7f7de0800640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:04.803 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-08-17T02:46:04.801+0000 7f4368600640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:46:04.808 INFO:tasks.ceph.osd.4.smithi026.stderr:2024-08-17T02:46:04.806+0000 7f435fa00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:46:05.761 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:05.901 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.899+0000 7f9a45200640 1 Processor -- start 2024-08-17T02:46:05.901 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.900+0000 7f9a45200640 1 -- start start 2024-08-17T02:46:05.903 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a45200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a4006d780 0x7f9a4006db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.903 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a45200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a400a88b0 0x7f9a40152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.903 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a45200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a401531d0 0x7f9a400ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.903 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a45200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a40159140 con 0x7f9a400a88b0 2024-08-17T02:46:05.903 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a45200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a40159f40 con 0x7f9a4006d780 2024-08-17T02:46:05.903 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a45200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40153630 con 0x7f9a401531d0 2024-08-17T02:46:05.903 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a37e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a400a88b0 0x7f9a40152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.903 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a37e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a400a88b0 0x7f9a40152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38216/0 (socket says 172.21.15.2:38216) 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a37e00640 1 -- 172.21.15.2:0/2472679499 learned_addr learned my addr 172.21.15.2:0/2472679499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a3f400640 1 --2- 172.21.15.2:0/2472679499 >> v2:172.21.15.26:3300/0 conn(0x7f9a4006d780 0x7f9a4006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a3fe00640 1 --2- 172.21.15.2:0/2472679499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a401531d0 0x7f9a400ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a37e00640 1 -- 172.21.15.2:0/2472679499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a401531d0 msgr2=0x7f9a400ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a37e00640 1 --2- 172.21.15.2:0/2472679499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a401531d0 0x7f9a400ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a37e00640 1 -- 172.21.15.2:0/2472679499 >> v2:172.21.15.26:3300/0 conn(0x7f9a4006d780 msgr2=0x7f9a4006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a37e00640 1 --2- 172.21.15.2:0/2472679499 >> v2:172.21.15.26:3300/0 conn(0x7f9a4006d780 0x7f9a4006db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a37e00640 1 -- 172.21.15.2:0/2472679499 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40159330 con 0x7f9a400a88b0 2024-08-17T02:46:05.904 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.901+0000 7f9a3f400640 1 --2- 172.21.15.2:0/2472679499 >> v2:172.21.15.26:3300/0 conn(0x7f9a4006d780 0x7f9a4006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.902+0000 7f9a37e00640 1 --2- 172.21.15.2:0/2472679499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a400a88b0 0x7f9a40152c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a400cc860 tx=0x7f9a280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b66505646dbf5d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a3ea00640 1 -- 172.21.15.2:0/2472679499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2802aca0 con 0x7f9a400a88b0 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a3ea00640 1 -- 172.21.15.2:0/2472679499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2802ae00 con 0x7f9a400a88b0 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a3ea00640 1 -- 172.21.15.2:0/2472679499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28032670 con 0x7f9a400a88b0 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a45200640 1 -- 172.21.15.2:0/2472679499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a400a88b0 msgr2=0x7f9a40152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a45200640 1 --2- 172.21.15.2:0/2472679499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a400a88b0 0x7f9a40152c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a400cc860 tx=0x7f9a280091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a45200640 1 -- 172.21.15.2:0/2472679499 shutdown_connections 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a45200640 1 --2- 172.21.15.2:0/2472679499 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a401531d0 0x7f9a400ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a45200640 1 --2- 172.21.15.2:0/2472679499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a400a88b0 0x7f9a40152c90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.906 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a45200640 1 --2- 172.21.15.2:0/2472679499 >> v2:172.21.15.26:3300/0 conn(0x7f9a4006d780 0x7f9a4006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.907 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a45200640 1 -- 172.21.15.2:0/2472679499 >> 172.21.15.2:0/2472679499 conn(0x7f9a40066db0 msgr2=0x7f9a400671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:05.907 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.903+0000 7f9a45200640 1 -- 172.21.15.2:0/2472679499 shutdown_connections 2024-08-17T02:46:05.907 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.904+0000 7f9a45200640 1 -- 172.21.15.2:0/2472679499 wait complete. 2024-08-17T02:46:05.907 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.905+0000 7f9a45200640 1 Processor -- start 2024-08-17T02:46:05.907 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.905+0000 7f9a45200640 1 -- start start 2024-08-17T02:46:05.909 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a45200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4006d780 0x7f9a4014d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.909 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a45200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a88b0 0x7f9a400ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.909 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a45200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a401531d0 0x7f9a40157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.909 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a45200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4014e450 con 0x7f9a4006d780 2024-08-17T02:46:05.909 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a45200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400ad340 con 0x7f9a401531d0 2024-08-17T02:46:05.909 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a45200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4014d840 con 0x7f9a400a88b0 2024-08-17T02:46:05.909 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4006d780 0x7f9a4014d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.909 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4006d780 0x7f9a4014d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38224/0 (socket says 172.21.15.2:38224) 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3f400640 1 -- 172.21.15.2:0/1551708372 learned_addr learned my addr 172.21.15.2:0/1551708372 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3f400640 1 -- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a88b0 msgr2=0x7f9a400ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a37e00640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a88b0 0x7f9a400ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3fe00640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a401531d0 0x7f9a40157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3f400640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a88b0 0x7f9a400ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3f400640 1 -- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a401531d0 msgr2=0x7f9a40157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3f400640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a401531d0 0x7f9a40157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3f400640 1 -- 172.21.15.2:0/1551708372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28009450 con 0x7f9a4006d780 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a37e00640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a88b0 0x7f9a400ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.906+0000 7f9a3fe00640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a401531d0 0x7f9a40157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.907+0000 7f9a3f400640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4006d780 0x7f9a4014d260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000d810 tx=0x7f9a30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.907+0000 7f9a36a00640 1 -- 172.21.15.2:0/1551708372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3000de00 con 0x7f9a4006d780 2024-08-17T02:46:05.910 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.907+0000 7f9a36a00640 1 -- 172.21.15.2:0/1551708372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a300098b0 con 0x7f9a4006d780 2024-08-17T02:46:05.911 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.907+0000 7f9a36a00640 1 -- 172.21.15.2:0/1551708372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30009c70 con 0x7f9a4006d780 2024-08-17T02:46:05.911 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.907+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4014db20 con 0x7f9a4006d780 2024-08-17T02:46:05.911 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.907+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4014e0e0 con 0x7f9a4006d780 2024-08-17T02:46:05.911 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.908+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4006c1d0 con 0x7f9a4006d780 2024-08-17T02:46:05.912 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.909+0000 7f9a36a00640 1 -- 172.21.15.2:0/1551708372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f9a30014640 con 0x7f9a4006d780 2024-08-17T02:46:05.912 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.910+0000 7f9a36a00640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a1c0650c0 0x7f9a1c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:05.912 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.910+0000 7f9a36a00640 1 -- 172.21.15.2:0/1551708372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f9a30082340 con 0x7f9a4006d780 2024-08-17T02:46:05.912 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.910+0000 7f9a37e00640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a1c0650c0 0x7f9a1c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:05.912 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.911+0000 7f9a37e00640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a1c0650c0 0x7f9a1c067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a28034000 tx=0x7f9a28032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:05.916 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:05.915+0000 7f9a36a00640 1 -- 172.21.15.2:0/1551708372 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9a300509d0 con 0x7f9a4006d780 2024-08-17T02:46:06.104 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.103+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a40071010 con 0x7f9a4006d780 2024-08-17T02:46:06.104 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.104+0000 7f9a36a00640 1 -- 172.21.15.2:0/1551708372 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10300 (secure 0 0 0) 0x7f9a30053ff0 con 0x7f9a4006d780 2024-08-17T02:46:06.105 INFO:teuthology.misc.health.smithi002.stdout: 2024-08-17T02:46:06.105 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":13,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:05.706724+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.105+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a1c0650c0 msgr2=0x7f9a1c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.105+0000 7f9a45200640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a1c0650c0 0x7f9a1c067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a28034000 tx=0x7f9a28032000 comp rx=0 tx=0).stop 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.105+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4006d780 msgr2=0x7f9a4014d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.105+0000 7f9a45200640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4006d780 0x7f9a4014d260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000d810 tx=0x7f9a30008040 comp rx=0 tx=0).stop 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.106+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 shutdown_connections 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.106+0000 7f9a45200640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a401531d0 0x7f9a40157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.106+0000 7f9a45200640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a1c0650c0 0x7f9a1c067570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.106+0000 7f9a45200640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a400a88b0 0x7f9a400ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.107 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.106+0000 7f9a45200640 1 --2- 172.21.15.2:0/1551708372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a4006d780 0x7f9a4014d260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.108 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.106+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 >> 172.21.15.2:0/1551708372 conn(0x7f9a40066db0 msgr2=0x7f9a400ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:06.108 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.106+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 shutdown_connections 2024-08-17T02:46:06.108 INFO:teuthology.misc.health.smithi002.stderr:2024-08-17T02:46:06.106+0000 7f9a45200640 1 -- 172.21.15.2:0/1551708372 wait complete. 2024-08-17T02:46:06.119 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:46:06.119 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:46:06.120 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:46:06.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:46:06.124 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:46:06.124 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:46:06.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:46:06.127 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:46:06.128 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:46:06.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:46:06.132 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:46:06.133 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:46:06.133 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:46:06.136 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:46:06.137 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:46:06.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:06.250 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-08-17T02:46:06.250 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-08-17T02:46:06.267 INFO:tasks.ceph.mds.b.smithi026.stdout:starting mds.b at 2024-08-17T02:46:06.268 INFO:tasks.ceph.mds.d.smithi026.stdout:starting mds.d at 2024-08-17T02:46:06.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.293+0000 7f8133000640 1 Processor -- start 2024-08-17T02:46:06.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.293+0000 7f8133000640 1 -- start start 2024-08-17T02:46:06.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.294+0000 7f8133000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f812c0aea20 0x7f812c0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8133000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 0x7f812c0cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8133000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c0af3a0 con 0x7f812c158b90 2024-08-17T02:46:06.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8133000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c0afd20 con 0x7f812c0aea20 2024-08-17T02:46:06.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8133000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0affe0 con 0x7f812c0ca8e0 2024-08-17T02:46:06.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8123e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f812c0aea20 0x7f812c0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8123e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f812c0aea20 0x7f812c0aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38250/0 (socket says 172.21.15.2:38250) 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8123e00640 1 -- 172.21.15.2:0/2839379027 learned_addr learned my addr 172.21.15.2:0/2839379027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f812be00640 1 --1- 172.21.15.2:0/2839379027 >> v1:172.21.15.26:6789/0 conn(0x7f812c158b90 0x7f812c0b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:57324/0 (socket says 172.21.15.2:57324) 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8131000640 1 --2- 172.21.15.2:0/2839379027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 0x7f812c0cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8123e00640 1 -- 172.21.15.2:0/2839379027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 msgr2=0x7f812c0cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8123e00640 1 --2- 172.21.15.2:0/2839379027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 0x7f812c0cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8123e00640 1 -- 172.21.15.2:0/2839379027 >> v1:172.21.15.26:6789/0 conn(0x7f812c158b90 legacy=0x7f812c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f8123e00640 1 -- 172.21.15.2:0/2839379027 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c0b02c0 con 0x7f812c0aea20 2024-08-17T02:46:06.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.295+0000 7f812b400640 1 -- 172.21.15.2:0/2839379027 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019631482 0 0) 0x7f812c0af3a0 con 0x7f812c158b90 2024-08-17T02:46:06.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.296+0000 7f8123e00640 1 --2- 172.21.15.2:0/2839379027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c0aee60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8114009910 tx=0x7f81140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955a5c29694a453d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.296+0000 7f812b400640 1 -- 172.21.15.2:0/2839379027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811402ae40 con 0x7f812c0aea20 2024-08-17T02:46:06.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f812b400640 1 -- 172.21.15.2:0/2839379027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114032440 con 0x7f812c0aea20 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f812b400640 1 -- 172.21.15.2:0/2839379027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140327e0 con 0x7f812c0aea20 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f8133000640 1 -- 172.21.15.2:0/2839379027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 msgr2=0x7f812c0aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f8133000640 1 --2- 172.21.15.2:0/2839379027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c0aee60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8114009910 tx=0x7f81140091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f8133000640 1 -- 172.21.15.2:0/2839379027 shutdown_connections 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f8133000640 1 --2- 172.21.15.2:0/2839379027 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 0x7f812c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f8133000640 1 --2- 172.21.15.2:0/2839379027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c0aee60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f8133000640 1 -- 172.21.15.2:0/2839379027 >> 172.21.15.2:0/2839379027 conn(0x7f812c06e590 msgr2=0x7f812c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f8133000640 1 -- 172.21.15.2:0/2839379027 shutdown_connections 2024-08-17T02:46:06.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.297+0000 7f8133000640 1 -- 172.21.15.2:0/2839379027 wait complete. 2024-08-17T02:46:06.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.299+0000 7f8133000640 1 Processor -- start 2024-08-17T02:46:06.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.299+0000 7f8133000640 1 -- start start 2024-08-17T02:46:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f8133000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f8133000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 0x7f812c0c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f8133000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812c158b90 0x7f812c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f8133000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c159e90 con 0x7f812c0aea20 2024-08-17T02:46:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f8133000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c168cc0 con 0x7f812c158b90 2024-08-17T02:46:06.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f8133000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c1598d0 con 0x7f812c0ca8e0 2024-08-17T02:46:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38256/0 (socket says 172.21.15.2:38256) 2024-08-17T02:46:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 -- 172.21.15.2:0/2712999816 learned_addr learned my addr 172.21.15.2:0/2712999816 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f8123e00640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 0x7f812c0c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 -- 172.21.15.2:0/2712999816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 msgr2=0x7f812c0c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 0x7f812c0c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 -- 172.21.15.2:0/2712999816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812c158b90 msgr2=0x7f812c156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812c158b90 0x7f812c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 -- 172.21.15.2:0/2712999816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114009450 con 0x7f812c0aea20 2024-08-17T02:46:06.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.300+0000 7f812be00640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c158f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f811c00c5b0 tx=0x7f811c007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.301+0000 7f8123400640 1 -- 172.21.15.2:0/2712999816 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c007360 con 0x7f812c0aea20 2024-08-17T02:46:06.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.301+0000 7f8123400640 1 -- 172.21.15.2:0/2712999816 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c0074c0 con 0x7f812c0aea20 2024-08-17T02:46:06.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.301+0000 7f8123400640 1 -- 172.21.15.2:0/2712999816 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0049f0 con 0x7f812c0aea20 2024-08-17T02:46:06.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.301+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c159bb0 con 0x7f812c0aea20 2024-08-17T02:46:06.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.301+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c15ad00 con 0x7f812c0aea20 2024-08-17T02:46:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.302+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c15aef0 con 0x7f812c0aea20 2024-08-17T02:46:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.303+0000 7f8123400640 1 -- 172.21.15.2:0/2712999816 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f811c01b360 con 0x7f812c0aea20 2024-08-17T02:46:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.304+0000 7f8123400640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f81080650c0 0x7f8108067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.304+0000 7f8123400640 1 -- 172.21.15.2:0/2712999816 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f811c0810b0 con 0x7f812c0aea20 2024-08-17T02:46:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.304+0000 7f8123e00640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f81080650c0 0x7f8108067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.305+0000 7f8123e00640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f81080650c0 0x7f8108067570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8114034000 tx=0x7f8114032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.308+0000 7f8123400640 1 -- 172.21.15.2:0/2712999816 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f811c04f7a0 con 0x7f812c0aea20 2024-08-17T02:46:06.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.491+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f812c063fb0 con 0x7f812c0aea20 2024-08-17T02:46:06.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.492+0000 7f8123400640 1 -- 172.21.15.2:0/2712999816 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10300 (secure 0 0 0) 0x7f811c018090 con 0x7f812c0aea20 2024-08-17T02:46:06.493 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:06.493 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:05.706724+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f81080650c0 msgr2=0x7f8108067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f81080650c0 0x7f8108067570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8114034000 tx=0x7f8114032000 comp rx=0 tx=0).stop 2024-08-17T02:46:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 msgr2=0x7f812c158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c158f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f811c00c5b0 tx=0x7f811c007d00 comp rx=0 tx=0).stop 2024-08-17T02:46:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 shutdown_connections 2024-08-17T02:46:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812c158b90 0x7f812c156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f81080650c0 0x7f8108067570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f812c0ca8e0 0x7f812c0c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 --2- 172.21.15.2:0/2712999816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f812c0aea20 0x7f812c158f60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 >> 172.21.15.2:0/2712999816 conn(0x7f812c06e590 msgr2=0x7f812c0b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 shutdown_connections 2024-08-17T02:46:06.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.494+0000 7f8133000640 1 -- 172.21.15.2:0/2712999816 wait complete. 2024-08-17T02:46:06.510 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:46:06.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.661+0000 7f1beba00640 1 Processor -- start 2024-08-17T02:46:06.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.661+0000 7f1beba00640 1 -- start start 2024-08-17T02:46:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1beba00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1be40ad960 0x7f1be415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1beba00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40ca050 0x7f1be4156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1beba00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be415b5e0 con 0x7f1be40add30 2024-08-17T02:46:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1beba00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be40cb160 con 0x7f1be40ad960 2024-08-17T02:46:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1beba00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40b0d10 con 0x7f1be40ca050 2024-08-17T02:46:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1be9000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1be40ad960 0x7f1be415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1be9000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1be40ad960 0x7f1be415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38268/0 (socket says 172.21.15.2:38268) 2024-08-17T02:46:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1be9000640 1 -- 172.21.15.2:0/2305262991 learned_addr learned my addr 172.21.15.2:0/2305262991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1be9000640 1 -- 172.21.15.2:0/2305262991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40ca050 msgr2=0x7f1be4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.662+0000 7f1be3e00640 1 --2- 172.21.15.2:0/2305262991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40ca050 0x7f1be4156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.663+0000 7f1be9000640 1 --2- 172.21.15.2:0/2305262991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40ca050 0x7f1be4156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.663+0000 7f1be9000640 1 -- 172.21.15.2:0/2305262991 >> v1:172.21.15.2:6789/0 conn(0x7f1be40add30 legacy=0x7f1be4156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.663+0000 7f1be9000640 1 -- 172.21.15.2:0/2305262991 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be40ca550 con 0x7f1be40ad960 2024-08-17T02:46:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.663+0000 7f1be3e00640 1 --2- 172.21.15.2:0/2305262991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40ca050 0x7f1be4156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:06.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.664+0000 7f1be9000640 1 --2- 172.21.15.2:0/2305262991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be415b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009910 tx=0x7f1bd80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf5c23bab71a963 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.664+0000 7f1be3400640 1 -- 172.21.15.2:0/2305262991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8032440 con 0x7f1be40ad960 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.664+0000 7f1be3400640 1 -- 172.21.15.2:0/2305262991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd80325a0 con 0x7f1be40ad960 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.664+0000 7f1be3400640 1 -- 172.21.15.2:0/2305262991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8032980 con 0x7f1be40ad960 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.664+0000 7f1beba00640 1 -- 172.21.15.2:0/2305262991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 msgr2=0x7f1be415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.664+0000 7f1beba00640 1 --2- 172.21.15.2:0/2305262991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be415b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009910 tx=0x7f1bd80091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.665+0000 7f1beba00640 1 -- 172.21.15.2:0/2305262991 shutdown_connections 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.665+0000 7f1beba00640 1 --2- 172.21.15.2:0/2305262991 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40ca050 0x7f1be4156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.665+0000 7f1beba00640 1 --2- 172.21.15.2:0/2305262991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be415b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.665+0000 7f1beba00640 1 -- 172.21.15.2:0/2305262991 >> 172.21.15.2:0/2305262991 conn(0x7f1be4066e60 msgr2=0x7f1be4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:06.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.665+0000 7f1beba00640 1 -- 172.21.15.2:0/2305262991 shutdown_connections 2024-08-17T02:46:06.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.665+0000 7f1beba00640 1 -- 172.21.15.2:0/2305262991 wait complete. 2024-08-17T02:46:06.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.666+0000 7f1beba00640 1 Processor -- start 2024-08-17T02:46:06.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.666+0000 7f1beba00640 1 -- start start 2024-08-17T02:46:06.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1beba00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be4157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1beba00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40add30 0x7f1be4154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1beba00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be40ca050 0x7f1be414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1beba00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be41505b0 con 0x7f1be40ad960 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1beba00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40a9800 con 0x7f1be40ca050 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1beba00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40a8c80 con 0x7f1be40add30 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1be9000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be4157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1be9000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be4157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38270/0 (socket says 172.21.15.2:38270) 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1be9000640 1 -- 172.21.15.2:0/3752045721 learned_addr learned my addr 172.21.15.2:0/3752045721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1be3e00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40add30 0x7f1be4154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.667+0000 7f1be9a00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be40ca050 0x7f1be414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1be9000640 1 -- 172.21.15.2:0/3752045721 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40add30 msgr2=0x7f1be4154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1be9000640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40add30 0x7f1be4154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1be9000640 1 -- 172.21.15.2:0/3752045721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be40ca050 msgr2=0x7f1be414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1be9000640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be40ca050 0x7f1be414f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1be9000640 1 -- 172.21.15.2:0/3752045721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd8009450 con 0x7f1be40ad960 2024-08-17T02:46:06.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1be9000640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be4157b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009970 tx=0x7f1bd8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1bd7e00640 1 -- 172.21.15.2:0/3752045721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8031c80 con 0x7f1be40ad960 2024-08-17T02:46:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1bd7e00640 1 -- 172.21.15.2:0/3752045721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd8031e00 con 0x7f1be40ad960 2024-08-17T02:46:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1bd7e00640 1 -- 172.21.15.2:0/3752045721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd803d670 con 0x7f1be40ad960 2024-08-17T02:46:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be40a8f60 con 0x7f1be40ad960 2024-08-17T02:46:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.668+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be40a92f0 con 0x7f1be40ad960 2024-08-17T02:46:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.669+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be4063fb0 con 0x7f1be40ad960 2024-08-17T02:46:06.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.670+0000 7f1bd7e00640 1 -- 172.21.15.2:0/3752045721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f1bd8039040 con 0x7f1be40ad960 2024-08-17T02:46:06.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.671+0000 7f1bd7e00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1bc40650c0 0x7f1bc4067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:06.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.671+0000 7f1bd7e00640 1 -- 172.21.15.2:0/3752045721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f1bd80a1c60 con 0x7f1be40ad960 2024-08-17T02:46:06.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.671+0000 7f1be3e00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1bc40650c0 0x7f1bc4067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:06.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.672+0000 7f1be3e00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1bc40650c0 0x7f1bc4067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1be41530b0 tx=0x7f1bd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.675+0000 7f1bd7e00640 1 -- 172.21.15.2:0/3752045721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1bd80702e0 con 0x7f1be40ad960 2024-08-17T02:46:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.896+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1be415a830 con 0x7f1be40ad960 2024-08-17T02:46:06.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.896+0000 7f1bd7e00640 1 -- 172.21.15.2:0/3752045721 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7f1bd8037500 con 0x7f1be40ad960 2024-08-17T02:46:06.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:06.898 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:46:06.898 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-08-17T02:46:06.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1bc40650c0 msgr2=0x7f1bc4067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1bc40650c0 0x7f1bc4067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1be41530b0 tx=0x7f1bd0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 msgr2=0x7f1be4157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be4157b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009970 tx=0x7f1bd8032000 comp rx=0 tx=0).stop 2024-08-17T02:46:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 shutdown_connections 2024-08-17T02:46:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1be40ca050 0x7f1be414f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1bc40650c0 0x7f1bc4067570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1be40add30 0x7f1be4154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 --2- 172.21.15.2:0/3752045721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be40ad960 0x7f1be4157b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 >> 172.21.15.2:0/3752045721 conn(0x7f1be4066e60 msgr2=0x7f1be4151080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 shutdown_connections 2024-08-17T02:46:06.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:06.898+0000 7f1beba00640 1 -- 172.21.15.2:0/3752045721 wait complete. 2024-08-17T02:46:08.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:08.951 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:08.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.072+0000 7f31d7c00640 1 Processor -- start 2024-08-17T02:46:09.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.072+0000 7f31d7c00640 1 -- start start 2024-08-17T02:46:09.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.073+0000 7f31d7c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31d00aea20 0x7f31d00aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.073+0000 7f31d7c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d00ca8e0 0x7f31d00cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.073+0000 7f31d7c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d00af3a0 con 0x7f31d0158b90 2024-08-17T02:46:09.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.073+0000 7f31d7c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d00afd20 con 0x7f31d00aea20 2024-08-17T02:46:09.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.073+0000 7f31d7c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00affe0 con 0x7f31d00ca8e0 2024-08-17T02:46:09.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31d5200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f31d0158b90 0x7f31d00b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49238/0 (socket says 172.21.15.2:49238) 2024-08-17T02:46:09.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31d5200640 1 -- 172.21.15.2:0/854933146 learned_addr learned my addr 172.21.15.2:0/854933146 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:09.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31d5c00640 1 --2- 172.21.15.2:0/854933146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d00ca8e0 0x7f31d00cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31cfe00640 1 --2- 172.21.15.2:0/854933146 >> v2:172.21.15.26:3300/0 conn(0x7f31d00aea20 0x7f31d00aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31cf400640 1 -- 172.21.15.2:0/854933146 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470547289 0 0) 0x7f31d00af3a0 con 0x7f31d0158b90 2024-08-17T02:46:09.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31cf400640 1 -- 172.21.15.2:0/854933146 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b80034e0 con 0x7f31d0158b90 2024-08-17T02:46:09.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31d5c00640 1 -- 172.21.15.2:0/854933146 >> v2:172.21.15.26:3300/0 conn(0x7f31d00aea20 msgr2=0x7f31d00aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:09.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31d5c00640 1 --2- 172.21.15.2:0/854933146 >> v2:172.21.15.26:3300/0 conn(0x7f31d00aea20 0x7f31d00aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31d5c00640 1 -- 172.21.15.2:0/854933146 >> v1:172.21.15.2:6789/0 conn(0x7f31d0158b90 legacy=0x7f31d00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.074+0000 7f31d5c00640 1 -- 172.21.15.2:0/854933146 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00b02c0 con 0x7f31d00ca8e0 2024-08-17T02:46:09.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.075+0000 7f31d5c00640 1 --2- 172.21.15.2:0/854933146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d00ca8e0 0x7f31d00cace0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009e60 tx=0x7f31c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e482724fce377602 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31cf400640 1 -- 172.21.15.2:0/854933146 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8007550 con 0x7f31d00ca8e0 2024-08-17T02:46:09.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31cf400640 1 -- 172.21.15.2:0/854933146 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c802d050 con 0x7f31d00ca8e0 2024-08-17T02:46:09.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31cf400640 1 -- 172.21.15.2:0/854933146 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8007920 con 0x7f31d00ca8e0 2024-08-17T02:46:09.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31d7c00640 1 -- 172.21.15.2:0/854933146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d00ca8e0 msgr2=0x7f31d00cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31d7c00640 1 --2- 172.21.15.2:0/854933146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d00ca8e0 0x7f31d00cace0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009e60 tx=0x7f31c8009780 comp rx=0 tx=0).stop 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31d7c00640 1 -- 172.21.15.2:0/854933146 shutdown_connections 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31d7c00640 1 --2- 172.21.15.2:0/854933146 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d00ca8e0 0x7f31d00cace0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31d7c00640 1 --2- 172.21.15.2:0/854933146 >> v2:172.21.15.26:3300/0 conn(0x7f31d00aea20 0x7f31d00aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31d7c00640 1 -- 172.21.15.2:0/854933146 >> 172.21.15.2:0/854933146 conn(0x7f31d006e590 msgr2=0x7f31d006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31d7c00640 1 -- 172.21.15.2:0/854933146 shutdown_connections 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.076+0000 7f31d7c00640 1 -- 172.21.15.2:0/854933146 wait complete. 2024-08-17T02:46:09.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.078+0000 7f31d7c00640 1 Processor -- start 2024-08-17T02:46:09.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.078+0000 7f31d7c00640 1 -- start start 2024-08-17T02:46:09.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d7c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d00aea20 0x7f31d0157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d7c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00ca8e0 0x7f31d00c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d7c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d0158b90 0x7f31d0168b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d7c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00c8ad0 con 0x7f31d00aea20 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d7c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0157f40 con 0x7f31d00ca8e0 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d7c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0169610 con 0x7f31d0158b90 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d00aea20 0x7f31d0157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d00aea20 0x7f31d0157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38290/0 (socket says 172.21.15.2:38290) 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5200640 1 -- 172.21.15.2:0/1417487118 learned_addr learned my addr 172.21.15.2:0/1417487118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31cfe00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00ca8e0 0x7f31d00c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5c00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d0158b90 0x7f31d0168b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5200640 1 -- 172.21.15.2:0/1417487118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d0158b90 msgr2=0x7f31d0168b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5200640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d0158b90 0x7f31d0168b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5200640 1 -- 172.21.15.2:0/1417487118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00ca8e0 msgr2=0x7f31d00c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5200640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00ca8e0 0x7f31d00c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.079+0000 7f31d5200640 1 -- 172.21.15.2:0/1417487118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8009a20 con 0x7f31d00aea20 2024-08-17T02:46:09.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.080+0000 7f31d5200640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d00aea20 0x7f31d0157a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c590 tx=0x7f31c4007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.080+0000 7f31c3e00640 1 -- 172.21.15.2:0/1417487118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4005aa0 con 0x7f31d00aea20 2024-08-17T02:46:09.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.080+0000 7f31c3e00640 1 -- 172.21.15.2:0/1417487118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c4005c40 con 0x7f31d00aea20 2024-08-17T02:46:09.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.080+0000 7f31c3e00640 1 -- 172.21.15.2:0/1417487118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c40070f0 con 0x7f31d00aea20 2024-08-17T02:46:09.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.080+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d01698f0 con 0x7f31d00aea20 2024-08-17T02:46:09.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.080+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d00c94a0 con 0x7f31d00aea20 2024-08-17T02:46:09.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.081+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d00ca600 con 0x7f31d00aea20 2024-08-17T02:46:09.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.083+0000 7f31c3e00640 1 -- 172.21.15.2:0/1417487118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f31c4007520 con 0x7f31d00aea20 2024-08-17T02:46:09.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.084+0000 7f31c3e00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f31b00650c0 0x7f31b0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.084+0000 7f31c3e00640 1 -- 172.21.15.2:0/1417487118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f31c40819d0 con 0x7f31d00aea20 2024-08-17T02:46:09.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.084+0000 7f31cfe00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f31b00650c0 0x7f31b0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.085+0000 7f31cfe00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f31b00650c0 0x7f31b0067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31d00c6800 tx=0x7f31bc0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.088+0000 7f31c3e00640 1 -- 172.21.15.2:0/1417487118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31c404ff50 con 0x7f31d00aea20 2024-08-17T02:46:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.322+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31d0169ae0 con 0x7f31d00aea20 2024-08-17T02:46:09.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.322+0000 7f31c3e00640 1 -- 172.21.15.2:0/1417487118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f31c4053570 con 0x7f31d00aea20 2024-08-17T02:46:09.323 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:09.324 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:46:09.324 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2024-08-17T02:46:09.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f31b00650c0 msgr2=0x7f31b0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f31b00650c0 0x7f31b0067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31d00c6800 tx=0x7f31bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d00aea20 msgr2=0x7f31d0157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d00aea20 0x7f31d0157a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c590 tx=0x7f31c4007d40 comp rx=0 tx=0).stop 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 shutdown_connections 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f31b00650c0 0x7f31b0067570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f31d0158b90 0x7f31d0168b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00ca8e0 0x7f31d00c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 --2- 172.21.15.2:0/1417487118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d00aea20 0x7f31d0157a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.324+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 >> 172.21.15.2:0/1417487118 conn(0x7f31d006e590 msgr2=0x7f31d00b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.325+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 shutdown_connections 2024-08-17T02:46:09.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.325+0000 7f31d7c00640 1 -- 172.21.15.2:0/1417487118 wait complete. 2024-08-17T02:46:09.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:09.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.535+0000 7efefea00640 1 Processor -- start 2024-08-17T02:46:09.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.536+0000 7efefea00640 1 -- start start 2024-08-17T02:46:09.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefea00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efef81590b0 0x7efef80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efef80acf10 0x7efef8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefea00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef815a4e0 con 0x7efef80afca0 2024-08-17T02:46:09.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefea00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef80b0980 con 0x7efef80acf10 2024-08-17T02:46:09.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefea00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef80c92b0 con 0x7efef81590b0 2024-08-17T02:46:09.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efef80acf10 0x7efef8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efef80acf10 0x7efef8159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38292/0 (socket says 172.21.15.2:38292) 2024-08-17T02:46:09.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefca00640 1 -- 172.21.15.2:0/2278456148 learned_addr learned my addr 172.21.15.2:0/2278456148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:09.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efeefe00640 1 --2- 172.21.15.2:0/2278456148 >> v2:172.21.15.26:3300/0 conn(0x7efef81590b0 0x7efef80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefca00640 1 -- 172.21.15.2:0/2278456148 >> v2:172.21.15.26:3300/0 conn(0x7efef81590b0 msgr2=0x7efef80b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:09.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.538+0000 7efefca00640 1 --2- 172.21.15.2:0/2278456148 >> v2:172.21.15.26:3300/0 conn(0x7efef81590b0 0x7efef80b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.539+0000 7efefca00640 1 -- 172.21.15.2:0/2278456148 >> v1:172.21.15.26:6789/0 conn(0x7efef80afca0 legacy=0x7efef81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.539+0000 7efefca00640 1 -- 172.21.15.2:0/2278456148 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef80ad480 con 0x7efef80acf10 2024-08-17T02:46:09.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efefca00640 1 --2- 172.21.15.2:0/2278456148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80acf10 0x7efef8159fa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efef80c83b0 tx=0x7efef0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03672bf0c784e46 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efef7400640 1 -- 172.21.15.2:0/2278456148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef002e050 con 0x7efef80acf10 2024-08-17T02:46:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efef7400640 1 -- 172.21.15.2:0/2278456148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef0007400 con 0x7efef80acf10 2024-08-17T02:46:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efef7400640 1 -- 172.21.15.2:0/2278456148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef00077e0 con 0x7efef80acf10 2024-08-17T02:46:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efefea00640 1 -- 172.21.15.2:0/2278456148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80acf10 msgr2=0x7efef8159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efefea00640 1 --2- 172.21.15.2:0/2278456148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80acf10 0x7efef8159fa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efef80c83b0 tx=0x7efef0009840 comp rx=0 tx=0).stop 2024-08-17T02:46:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efefea00640 1 -- 172.21.15.2:0/2278456148 shutdown_connections 2024-08-17T02:46:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efefea00640 1 --2- 172.21.15.2:0/2278456148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80acf10 0x7efef8159fa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.540+0000 7efefea00640 1 --2- 172.21.15.2:0/2278456148 >> v2:172.21.15.26:3300/0 conn(0x7efef81590b0 0x7efef80b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.541+0000 7efefea00640 1 -- 172.21.15.2:0/2278456148 >> 172.21.15.2:0/2278456148 conn(0x7efef8066e60 msgr2=0x7efef8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.541+0000 7efefea00640 1 -- 172.21.15.2:0/2278456148 shutdown_connections 2024-08-17T02:46:09.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.541+0000 7efefea00640 1 -- 172.21.15.2:0/2278456148 wait complete. 2024-08-17T02:46:09.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.542+0000 7efefea00640 1 Processor -- start 2024-08-17T02:46:09.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.542+0000 7efefea00640 1 -- start start 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efefea00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efef80acf10 0x7efef815d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efefea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80afca0 0x7efef80c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efefea00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef81590b0 0x7efef80c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efefea00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef815e470 con 0x7efef80afca0 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efefea00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef815e750 con 0x7efef81590b0 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efefea00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef815ea30 con 0x7efef80acf10 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efeefe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80afca0 0x7efef80c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efeefe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80afca0 0x7efef80c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38296/0 (socket says 172.21.15.2:38296) 2024-08-17T02:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.543+0000 7efeefe00640 1 -- 172.21.15.2:0/1084770803 learned_addr learned my addr 172.21.15.2:0/1084770803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efefca00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef81590b0 0x7efef80c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efef7e00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efef80acf10 0x7efef815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeefe00640 1 -- 172.21.15.2:0/1084770803 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efef80acf10 msgr2=0x7efef815d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeefe00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efef80acf10 0x7efef815d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeefe00640 1 -- 172.21.15.2:0/1084770803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef81590b0 msgr2=0x7efef80c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeefe00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef81590b0 0x7efef80c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeefe00640 1 -- 172.21.15.2:0/1084770803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef0009ae0 con 0x7efef80afca0 2024-08-17T02:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeefe00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80afca0 0x7efef80c4bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efee000d860 tx=0x7efee0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeef400640 1 -- 172.21.15.2:0/1084770803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000b6c0 con 0x7efef80afca0 2024-08-17T02:46:09.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeef400640 1 -- 172.21.15.2:0/1084770803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee000b820 con 0x7efef80afca0 2024-08-17T02:46:09.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.544+0000 7efeef400640 1 -- 172.21.15.2:0/1084770803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000bbe0 con 0x7efef80afca0 2024-08-17T02:46:09.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.545+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef815ed10 con 0x7efef80afca0 2024-08-17T02:46:09.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.545+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef8153490 con 0x7efef80afca0 2024-08-17T02:46:09.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.546+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef815f190 con 0x7efef80afca0 2024-08-17T02:46:09.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.547+0000 7efeef400640 1 -- 172.21.15.2:0/1084770803 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7efee001e460 con 0x7efef80afca0 2024-08-17T02:46:09.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.547+0000 7efeef400640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efed40650c0 0x7efed4067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.547+0000 7efeef400640 1 -- 172.21.15.2:0/1084770803 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efee00825c0 con 0x7efef80afca0 2024-08-17T02:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.548+0000 7efef7e00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efed40650c0 0x7efed4067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.548+0000 7efef7e00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efed40650c0 0x7efed4067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efee8007fd0 tx=0x7efee8007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.552+0000 7efeef400640 1 -- 172.21.15.2:0/1084770803 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efee0050ac0 con 0x7efef80afca0 2024-08-17T02:46:09.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.730+0000 7efeef400640 1 -- 172.21.15.2:0/1084770803 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efee0050e90 con 0x7efef80afca0 2024-08-17T02:46:09.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.739+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efef8063fb0 con 0x7efef80afca0 2024-08-17T02:46:09.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.740+0000 7efeef400640 1 -- 172.21.15.2:0/1084770803 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12031 (secure 0 0 0) 0x7efee0054550 con 0x7efef80afca0 2024-08-17T02:46:09.741 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:09.741 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:09.719041+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:09.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efed40650c0 msgr2=0x7efed4067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efed40650c0 0x7efed4067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efee8007fd0 tx=0x7efee8007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:09.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80afca0 msgr2=0x7efef80c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80afca0 0x7efef80c4bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efee000d860 tx=0x7efee0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:09.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 shutdown_connections 2024-08-17T02:46:09.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efef81590b0 0x7efef80c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef80afca0 0x7efef80c4bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efed40650c0 0x7efed4067570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 --2- 172.21.15.2:0/1084770803 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efef80acf10 0x7efef815d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 >> 172.21.15.2:0/1084770803 conn(0x7efef8066e60 msgr2=0x7efef80c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 shutdown_connections 2024-08-17T02:46:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.742+0000 7efefea00640 1 -- 172.21.15.2:0/1084770803 wait complete. 2024-08-17T02:46:09.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:46:09.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.918+0000 7f638d800640 1 Processor -- start 2024-08-17T02:46:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.918+0000 7f638d800640 1 -- start start 2024-08-17T02:46:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.919+0000 7f638d800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6388156bd0 0x7f63880b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.919+0000 7f638d800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880ac040 con 0x7f63880adf90 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.919+0000 7f638d800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880ab150 con 0x7f6388156fa0 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.919+0000 7f638d800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6388067810 con 0x7f6388156bd0 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.919+0000 7f6386000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f63880adf90 0x7f63880ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49250/0 (socket says 172.21.15.2:49250) 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.919+0000 7f6386000640 1 -- 172.21.15.2:0/2225048582 learned_addr learned my addr 172.21.15.2:0/2225048582 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.919+0000 7f6386a00640 1 --2- 172.21.15.2:0/2225048582 >> v2:172.21.15.26:3300/0 conn(0x7f6388156bd0 0x7f63880b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.920+0000 7f6385600640 1 -- 172.21.15.2:0/2225048582 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818681777 0 0) 0x7f63880ac040 con 0x7f63880adf90 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.920+0000 7f6385600640 1 -- 172.21.15.2:0/2225048582 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f636c0034e0 con 0x7f63880adf90 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.920+0000 7f6385600640 1 -- 172.21.15.2:0/2225048582 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204475609 0 0) 0x7f63880ab150 con 0x7f6388156fa0 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.920+0000 7f6385600640 1 -- 172.21.15.2:0/2225048582 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63880ac040 con 0x7f6388156fa0 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.920+0000 7f6386a00640 1 -- 172.21.15.2:0/2225048582 >> v1:172.21.15.26:6789/0 conn(0x7f6388156fa0 legacy=0x7f63880acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.920+0000 7f6386a00640 1 -- 172.21.15.2:0/2225048582 >> v1:172.21.15.2:6789/0 conn(0x7f63880adf90 legacy=0x7f63880ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.920+0000 7f6386a00640 1 -- 172.21.15.2:0/2225048582 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880ab430 con 0x7f6388156bd0 2024-08-17T02:46:09.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.921+0000 7f6386a00640 1 --2- 172.21.15.2:0/2225048582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f63880b0b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6378009880 tx=0x7f63780090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb1c4fc273035906 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.921+0000 7f6385600640 1 -- 172.21.15.2:0/2225048582 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637802ae20 con 0x7f6388156bd0 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.921+0000 7f6385600640 1 -- 172.21.15.2:0/2225048582 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378032440 con 0x7f6388156bd0 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.921+0000 7f6385600640 1 -- 172.21.15.2:0/2225048582 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780327e0 con 0x7f6388156bd0 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.922+0000 7f638d800640 1 -- 172.21.15.2:0/2225048582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 msgr2=0x7f63880b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.922+0000 7f638d800640 1 --2- 172.21.15.2:0/2225048582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f63880b0b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6378009880 tx=0x7f63780090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.922+0000 7f638d800640 1 -- 172.21.15.2:0/2225048582 shutdown_connections 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.922+0000 7f638d800640 1 --2- 172.21.15.2:0/2225048582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f63880b0b70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.922+0000 7f638d800640 1 -- 172.21.15.2:0/2225048582 >> 172.21.15.2:0/2225048582 conn(0x7f63880cc390 msgr2=0x7f6388066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.922+0000 7f638d800640 1 -- 172.21.15.2:0/2225048582 shutdown_connections 2024-08-17T02:46:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.922+0000 7f638d800640 1 -- 172.21.15.2:0/2225048582 wait complete. 2024-08-17T02:46:09.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.923+0000 7f638d800640 1 Processor -- start 2024-08-17T02:46:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.923+0000 7f638d800640 1 -- start start 2024-08-17T02:46:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f638d800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63880adf90 0x7f638815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f638d800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f638814c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f638d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6388156fa0 0x7f63880ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f638d800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638814dd50 con 0x7f6388156fa0 2024-08-17T02:46:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f638d800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638815ac50 con 0x7f6388156bd0 2024-08-17T02:46:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f638d800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638815aef0 con 0x7f63880adf90 2024-08-17T02:46:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f6386000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f638814c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f6386a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63880adf90 0x7f638815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f6386000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f638814c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:44128/0 (socket says 172.21.15.2:44128) 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f6387400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6388156fa0 0x7f63880ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.924+0000 7f6386000640 1 -- 172.21.15.2:0/174559897 learned_addr learned my addr 172.21.15.2:0/174559897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f6386000640 1 -- 172.21.15.2:0/174559897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63880adf90 msgr2=0x7f638815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f6386000640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63880adf90 0x7f638815a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f6386000640 1 -- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6388156fa0 msgr2=0x7f63880ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f6386000640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6388156fa0 0x7f63880ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f6386000640 1 -- 172.21.15.2:0/174559897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6378009390 con 0x7f6388156bd0 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f6386000640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f638814c650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6374005840 tx=0x7f6374007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f637e000640 1 -- 172.21.15.2:0/174559897 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374005aa0 con 0x7f6388156bd0 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f637e000640 1 -- 172.21.15.2:0/174559897 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6374005c00 con 0x7f6388156bd0 2024-08-17T02:46:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f637e000640 1 -- 172.21.15.2:0/174559897 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740070f0 con 0x7f6388156bd0 2024-08-17T02:46:09.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.925+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638815b1d0 con 0x7f6388156bd0 2024-08-17T02:46:09.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.926+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638814cb90 con 0x7f6388156bd0 2024-08-17T02:46:09.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.927+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638814df00 con 0x7f6388156bd0 2024-08-17T02:46:09.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.927+0000 7f637e000640 1 -- 172.21.15.2:0/174559897 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6374007520 con 0x7f6388156bd0 2024-08-17T02:46:09.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.928+0000 7f637e000640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6368065180 0x7f6368067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:09.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.928+0000 7f637e000640 1 -- 172.21.15.2:0/174559897 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6374081a10 con 0x7f6388156bd0 2024-08-17T02:46:09.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.928+0000 7f6386a00640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6368065180 0x7f6368067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:09.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.929+0000 7f6386a00640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6368065180 0x7f6368067630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6378034000 tx=0x7f6378032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:09.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:09.933+0000 7f637e000640 1 -- 172.21.15.2:0/174559897 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f638814df00 con 0x7f6388156bd0 2024-08-17T02:46:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.116+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f638814dec0 con 0x7f6388156bd0 2024-08-17T02:46:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.117+0000 7f637e000640 1 -- 172.21.15.2:0/174559897 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f637404ff30 con 0x7f6388156bd0 2024-08-17T02:46:10.118 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6368065180 msgr2=0x7f6368067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6368065180 0x7f6368067630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6378034000 tx=0x7f6378032000 comp rx=0 tx=0).stop 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 msgr2=0x7f638814c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f638814c650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6374005840 tx=0x7f6374007df0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 shutdown_connections 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6388156fa0 0x7f63880ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6388156bd0 0x7f638814c650 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6368065180 0x7f6368067630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 --2- 172.21.15.2:0/174559897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63880adf90 0x7f638815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 >> 172.21.15.2:0/174559897 conn(0x7f63880cc390 msgr2=0x7f6388152ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 shutdown_connections 2024-08-17T02:46:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.119+0000 7f638d800640 1 -- 172.21.15.2:0/174559897 wait complete. 2024-08-17T02:46:10.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:46:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.286+0000 7f1a9fc00640 1 Processor -- start 2024-08-17T02:46:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.286+0000 7f1a9fc00640 1 -- start start 2024-08-17T02:46:10.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.287+0000 7f1a9fc00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1a980ca050 0x7f1a98156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.287+0000 7f1a9fc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a980add30 0x7f1a9815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.287+0000 7f1a9fc00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9815b5e0 con 0x7f1a980ad960 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.287+0000 7f1a9fc00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980cb160 con 0x7f1a980add30 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.287+0000 7f1a9fc00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980b0d10 con 0x7f1a980ca050 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a9d200640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1a980ad960 0x7f1a98156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:57340/0 (socket says 172.21.15.2:57340) 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a9d200640 1 -- 172.21.15.2:0/494669534 learned_addr learned my addr 172.21.15.2:0/494669534 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a97e00640 1 --2- 172.21.15.2:0/494669534 >> v2:172.21.15.26:3300/0 conn(0x7f1a980ca050 0x7f1a98156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a9dc00640 1 --2- 172.21.15.2:0/494669534 >> v2:172.21.15.2:3300/0 conn(0x7f1a980add30 0x7f1a9815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a97400640 1 -- 172.21.15.2:0/494669534 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657685307 0 0) 0x7f1a8c001110 con 0x7f1a980ad960 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a97400640 1 -- 172.21.15.2:0/494669534 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a800034e0 con 0x7f1a980ad960 2024-08-17T02:46:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a97e00640 1 -- 172.21.15.2:0/494669534 >> v2:172.21.15.2:3300/0 conn(0x7f1a980add30 msgr2=0x7f1a9815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a97e00640 1 --2- 172.21.15.2:0/494669534 >> v2:172.21.15.2:3300/0 conn(0x7f1a980add30 0x7f1a9815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a97e00640 1 -- 172.21.15.2:0/494669534 >> v1:172.21.15.26:6789/0 conn(0x7f1a980ad960 legacy=0x7f1a98156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.288+0000 7f1a97e00640 1 -- 172.21.15.2:0/494669534 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980ca550 con 0x7f1a980ca050 2024-08-17T02:46:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.289+0000 7f1a97e00640 1 --2- 172.21.15.2:0/494669534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ca050 0x7f1a98156b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1a98063600 tx=0x7f1a840090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260c5ddb539ce9e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a97400640 1 -- 172.21.15.2:0/494669534 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8402ae40 con 0x7f1a980ca050 2024-08-17T02:46:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a97400640 1 -- 172.21.15.2:0/494669534 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84032440 con 0x7f1a980ca050 2024-08-17T02:46:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a97400640 1 -- 172.21.15.2:0/494669534 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84032820 con 0x7f1a980ca050 2024-08-17T02:46:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a9fc00640 1 -- 172.21.15.2:0/494669534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ca050 msgr2=0x7f1a98156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/494669534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ca050 0x7f1a98156b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1a98063600 tx=0x7f1a840090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a9fc00640 1 -- 172.21.15.2:0/494669534 shutdown_connections 2024-08-17T02:46:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/494669534 >> v2:172.21.15.2:3300/0 conn(0x7f1a980add30 0x7f1a9815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/494669534 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ca050 0x7f1a98156b30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a9fc00640 1 -- 172.21.15.2:0/494669534 >> 172.21.15.2:0/494669534 conn(0x7f1a98066e60 msgr2=0x7f1a98067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a9fc00640 1 -- 172.21.15.2:0/494669534 shutdown_connections 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.290+0000 7f1a9fc00640 1 -- 172.21.15.2:0/494669534 wait complete. 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.292+0000 7f1a9fc00640 1 Processor -- start 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.292+0000 7f1a9fc00640 1 -- start start 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9fc00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ad960 0x7f1a980aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9fc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a980add30 0x7f1a980aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9fc00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a980ca050 0x7f1a980aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9fc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980a92f0 con 0x7f1a980add30 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9fc00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980a95d0 con 0x7f1a980ad960 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9fc00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980a98b0 con 0x7f1a980ca050 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a97e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a980add30 0x7f1a980aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a97e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a980add30 0x7f1a980aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38344/0 (socket says 172.21.15.2:38344) 2024-08-17T02:46:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a97e00640 1 -- 172.21.15.2:0/706306717 learned_addr learned my addr 172.21.15.2:0/706306717 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9d200640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ad960 0x7f1a980aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9dc00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a980ca050 0x7f1a980aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9d200640 1 -- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a980ca050 msgr2=0x7f1a980aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.293+0000 7f1a9d200640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a980ca050 0x7f1a980aae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a9d200640 1 -- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a980add30 msgr2=0x7f1a980aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a9d200640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a980add30 0x7f1a980aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a9d200640 1 -- 172.21.15.2:0/706306717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84009390 con 0x7f1a980ad960 2024-08-17T02:46:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a97e00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a980add30 0x7f1a980aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a9d200640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ad960 0x7f1a980aa390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c005840 tx=0x7f1a8c007b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a8be00640 1 -- 172.21.15.2:0/706306717 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c005b70 con 0x7f1a980ad960 2024-08-17T02:46:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a8be00640 1 -- 172.21.15.2:0/706306717 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c005cd0 con 0x7f1a980ad960 2024-08-17T02:46:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a8be00640 1 -- 172.21.15.2:0/706306717 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c007300 con 0x7f1a980ad960 2024-08-17T02:46:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a980a9b90 con 0x7f1a980ad960 2024-08-17T02:46:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.294+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a98144530 con 0x7f1a980ad960 2024-08-17T02:46:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.296+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a98068170 con 0x7f1a980ad960 2024-08-17T02:46:10.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.296+0000 7f1a8be00640 1 -- 172.21.15.2:0/706306717 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1a8c01b3b0 con 0x7f1a980ad960 2024-08-17T02:46:10.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.297+0000 7f1a8be00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1a78065150 0x7f1a78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.297+0000 7f1a8be00640 1 -- 172.21.15.2:0/706306717 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1a8c081480 con 0x7f1a980ad960 2024-08-17T02:46:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.297+0000 7f1a97e00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1a78065150 0x7f1a78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.298+0000 7f1a97e00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1a78065150 0x7f1a78067600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a981524a0 tx=0x7f1a84032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.301+0000 7f1a8be00640 1 -- 172.21.15.2:0/706306717 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1a98068170 con 0x7f1a980ad960 2024-08-17T02:46:10.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.492+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1a98063fb0 con 0x7f1a980ad960 2024-08-17T02:46:10.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.550+0000 7f1a8be00640 1 -- 172.21.15.2:0/706306717 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1a8c04f8a0 con 0x7f1a980ad960 2024-08-17T02:46:10.552 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:10.552 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-17T02:46:10.552 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:46:10.552 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-08-17T02:46:10.552 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-08-17T02:46:10.552 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:46:10.552 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-17T02:46:10.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1a78065150 msgr2=0x7f1a78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1a78065150 0x7f1a78067600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a981524a0 tx=0x7f1a84032000 comp rx=0 tx=0).stop 2024-08-17T02:46:10.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ad960 msgr2=0x7f1a980aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ad960 0x7f1a980aa390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c005840 tx=0x7f1a8c007b60 comp rx=0 tx=0).stop 2024-08-17T02:46:10.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 shutdown_connections 2024-08-17T02:46:10.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1a78065150 0x7f1a78067600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1a980ca050 0x7f1a980aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a980add30 0x7f1a980aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 --2- 172.21.15.2:0/706306717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a980ad960 0x7f1a980aa390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 >> 172.21.15.2:0/706306717 conn(0x7f1a98066e60 msgr2=0x7f1a98154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 shutdown_connections 2024-08-17T02:46:10.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.553+0000 7f1a9fc00640 1 -- 172.21.15.2:0/706306717 wait complete. 2024-08-17T02:46:10.569 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:46:10.569 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:46:10.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.726+0000 7f5729400640 1 Processor -- start 2024-08-17T02:46:10.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.726+0000 7f5729400640 1 -- start start 2024-08-17T02:46:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5729400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5724159120 0x7f57240afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5729400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57240b2110 0x7f57240b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5729400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57240cb6c0 con 0x7f5724158d50 2024-08-17T02:46:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5729400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57240b0570 con 0x7f5724159120 2024-08-17T02:46:10.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5729400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57240caab0 con 0x7f57240b2110 2024-08-17T02:46:10.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5721e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5724159120 0x7f57240afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5722800640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5724158d50 0x7f57240b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:57350/0 (socket says 172.21.15.2:57350) 2024-08-17T02:46:10.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5722800640 1 -- 172.21.15.2:0/1656241505 learned_addr learned my addr 172.21.15.2:0/1656241505 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:10.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5723200640 1 --2- 172.21.15.2:0/1656241505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57240b2110 0x7f57240b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5721e00640 1 -- 172.21.15.2:0/1656241505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57240b2110 msgr2=0x7f57240b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:10.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5721e00640 1 --2- 172.21.15.2:0/1656241505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57240b2110 0x7f57240b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5721e00640 1 -- 172.21.15.2:0/1656241505 >> v1:172.21.15.26:6789/0 conn(0x7f5724158d50 legacy=0x7f57240b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.728+0000 7f5721e00640 1 -- 172.21.15.2:0/1656241505 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57240cad90 con 0x7f5724159120 2024-08-17T02:46:10.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.730+0000 7f5721e00640 1 --2- 172.21.15.2:0/1656241505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724159120 0x7f57240afaf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5710009850 tx=0x7f57100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143bd22e75d8e359 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.730+0000 7f5721400640 1 -- 172.21.15.2:0/1656241505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571002ad00 con 0x7f5724159120 2024-08-17T02:46:10.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.730+0000 7f5721400640 1 -- 172.21.15.2:0/1656241505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571002ae60 con 0x7f5724159120 2024-08-17T02:46:10.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.730+0000 7f5721400640 1 -- 172.21.15.2:0/1656241505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710032670 con 0x7f5724159120 2024-08-17T02:46:10.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.730+0000 7f5729400640 1 -- 172.21.15.2:0/1656241505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724159120 msgr2=0x7f57240afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.730+0000 7f5729400640 1 --2- 172.21.15.2:0/1656241505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724159120 0x7f57240afaf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5710009850 tx=0x7f57100090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.731+0000 7f5729400640 1 -- 172.21.15.2:0/1656241505 shutdown_connections 2024-08-17T02:46:10.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.731+0000 7f5729400640 1 --2- 172.21.15.2:0/1656241505 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f57240b2110 0x7f57240b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.731+0000 7f5729400640 1 --2- 172.21.15.2:0/1656241505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724159120 0x7f57240afaf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.731+0000 7f5729400640 1 -- 172.21.15.2:0/1656241505 >> 172.21.15.2:0/1656241505 conn(0x7f572406e590 msgr2=0x7f572406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:10.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.731+0000 7f5729400640 1 -- 172.21.15.2:0/1656241505 shutdown_connections 2024-08-17T02:46:10.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.731+0000 7f5729400640 1 -- 172.21.15.2:0/1656241505 wait complete. 2024-08-17T02:46:10.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.732+0000 7f5729400640 1 Processor -- start 2024-08-17T02:46:10.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.732+0000 7f5729400640 1 -- start start 2024-08-17T02:46:10.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5729400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57240b2110 0x7f572416c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5729400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724158d50 0x7f57240c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5729400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5724159120 0x7f57240cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5729400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572416d100 con 0x7f5724158d50 2024-08-17T02:46:10.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5729400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572416c860 con 0x7f57240b2110 2024-08-17T02:46:10.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5729400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572416cb40 con 0x7f5724159120 2024-08-17T02:46:10.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5721e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724158d50 0x7f57240c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5723200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5724159120 0x7f57240cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5722800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57240b2110 0x7f572416c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5721e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724158d50 0x7f57240c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38370/0 (socket says 172.21.15.2:38370) 2024-08-17T02:46:10.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.733+0000 7f5721e00640 1 -- 172.21.15.2:0/4100877796 learned_addr learned my addr 172.21.15.2:0/4100877796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:10.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5723200640 1 -- 172.21.15.2:0/4100877796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57240b2110 msgr2=0x7f572416c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5723200640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57240b2110 0x7f572416c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5723200640 1 -- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724158d50 msgr2=0x7f57240c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:10.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5723200640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724158d50 0x7f57240c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:10.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5723200640 1 -- 172.21.15.2:0/4100877796 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5710009390 con 0x7f5724159120 2024-08-17T02:46:10.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5722800640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57240b2110 0x7f572416c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:10.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5721e00640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724158d50 0x7f57240c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:10.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5723200640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5724159120 0x7f57240cd860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f571c009e50 tx=0x7f571c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f571a000640 1 -- 172.21.15.2:0/4100877796 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c00cd40 con 0x7f5724159120 2024-08-17T02:46:10.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f571a000640 1 -- 172.21.15.2:0/4100877796 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c00f040 con 0x7f5724159120 2024-08-17T02:46:10.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f571a000640 1 -- 172.21.15.2:0/4100877796 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0146d0 con 0x7f5724159120 2024-08-17T02:46:10.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.734+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572416ce20 con 0x7f5724159120 2024-08-17T02:46:10.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.735+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57240c91a0 con 0x7f5724159120 2024-08-17T02:46:10.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.736+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5724063fb0 con 0x7f5724159120 2024-08-17T02:46:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.737+0000 7f571a000640 1 -- 172.21.15.2:0/4100877796 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f571c014a40 con 0x7f5724159120 2024-08-17T02:46:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.737+0000 7f571a000640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5704065150 0x7f5704067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.737+0000 7f571a000640 1 -- 172.21.15.2:0/4100877796 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f571c082da0 con 0x7f5724159120 2024-08-17T02:46:10.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.738+0000 7f5722800640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5704065150 0x7f5704067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.738+0000 7f5722800640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5704065150 0x7f5704067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5714007810 tx=0x7f5714007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:10.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.743+0000 7f571a000640 1 -- 172.21.15.2:0/4100877796 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f571c051280 con 0x7f5724159120 2024-08-17T02:46:10.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:10.924+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f57240b59c0 con 0x7f5724159120 2024-08-17T02:46:11.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.735+0000 7f571a000640 1 -- 172.21.15.2:0/4100877796 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f571c0180b0 con 0x7f5724159120 2024-08-17T02:46:11.736 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.743+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5704065150 msgr2=0x7f5704067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.743+0000 7f5729400640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5704065150 0x7f5704067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5714007810 tx=0x7f5714007e20 comp rx=0 tx=0).stop 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.743+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5724159120 msgr2=0x7f57240cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.743+0000 7f5729400640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5724159120 0x7f57240cd860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f571c009e50 tx=0x7f571c00b040 comp rx=0 tx=0).stop 2024-08-17T02:46:11.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.743+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 shutdown_connections 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.744+0000 7f5729400640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5704065150 0x7f5704067600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.744+0000 7f5729400640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5724159120 0x7f57240cd860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.744+0000 7f5729400640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5724158d50 0x7f57240c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.744+0000 7f5729400640 1 --2- 172.21.15.2:0/4100877796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57240b2110 0x7f572416c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.744+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 >> 172.21.15.2:0/4100877796 conn(0x7f572406e590 msgr2=0x7f57240684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.744+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 shutdown_connections 2024-08-17T02:46:11.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.744+0000 7f5729400640 1 -- 172.21.15.2:0/4100877796 wait complete. 2024-08-17T02:46:11.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:46:11.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.925+0000 7f822d600640 1 Processor -- start 2024-08-17T02:46:11.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.925+0000 7f822d600640 1 -- start start 2024-08-17T02:46:11.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.926+0000 7f822d600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 0x7f82280b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.926+0000 7f822d600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280c92b0 con 0x7f82280afca0 2024-08-17T02:46:11.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.926+0000 7f822d600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280ad480 con 0x7f82280acf10 2024-08-17T02:46:11.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.926+0000 7f822d600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82280b0980 con 0x7f82281590b0 2024-08-17T02:46:11.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8226a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f82280afca0 0x7f82281589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:49254/0 (socket says 172.21.15.2:49254) 2024-08-17T02:46:11.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8226a00640 1 -- 172.21.15.2:0/1688485960 learned_addr learned my addr 172.21.15.2:0/1688485960 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8226000640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 0x7f82280b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551326836 0 0) 0x7f82280c92b0 con 0x7f82280afca0 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f820c0034e0 con 0x7f82280afca0 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860971227 0 0) 0x7f820c0034e0 con 0x7f82280afca0 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 msgr2=0x7f82280b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 0x7f82280b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 >> v1:172.21.15.26:6789/0 conn(0x7f82280acf10 legacy=0x7f82280c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280ad760 con 0x7f82280afca0 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f8218001470 con 0x7f82280afca0 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 >> v1:172.21.15.2:6789/0 conn(0x7f82280afca0 legacy=0x7f82281589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.927+0000 7f8225600640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f820c003a00 0x7f820c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8225600640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c004780 0x7f820c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8225600640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 0x7f820c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c00bb60 con 0x7f820c003a00 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c00bca0 con 0x7f820c004780 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c00e070 con 0x7f82281590b0 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8226a00640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f820c003a00 0x7f820c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8226000640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c004780 0x7f820c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8227400640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 0x7f820c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8226a00640 1 -- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 msgr2=0x7f820c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8226a00640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 0x7f820c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8226a00640 1 -- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c004780 msgr2=0x7f820c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:11.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8226a00640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c004780 0x7f820c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8226a00640 1 -- 172.21.15.2:0/1688485960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0034e0 con 0x7f820c003a00 2024-08-17T02:46:11.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.928+0000 7f8227400640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f82281590b0 0x7f820c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:11.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.929+0000 7f8226a00640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f820c003a00 0x7f820c003e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f821800c160 tx=0x7f82280683f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d5da2e207752bd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.929+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218005890 con 0x7f820c003a00 2024-08-17T02:46:11.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821802d070 con 0x7f820c003a00 2024-08-17T02:46:11.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f8225600640 1 -- 172.21.15.2:0/1688485960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218005a50 con 0x7f820c003a00 2024-08-17T02:46:11.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f822d600640 1 -- 172.21.15.2:0/1688485960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f820c003a00 msgr2=0x7f820c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f822d600640 1 --2- 172.21.15.2:0/1688485960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f820c003a00 0x7f820c003e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f821800c160 tx=0x7f82280683f0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f8227400640 1 -- 172.21.15.2:0/1688485960 reap_dead start 2024-08-17T02:46:11.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f822d600640 1 -- 172.21.15.2:0/1688485960 shutdown_connections 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f822d600640 1 -- 172.21.15.2:0/1688485960 >> 172.21.15.2:0/1688485960 conn(0x7f8228066e60 msgr2=0x7f8228067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f822d600640 1 -- 172.21.15.2:0/1688485960 shutdown_connections 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.930+0000 7f822d600640 1 -- 172.21.15.2:0/1688485960 wait complete. 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.932+0000 7f822d600640 1 Processor -- start 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.932+0000 7f822d600640 1 -- start start 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.932+0000 7f822d600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c003a00 0x7f822814b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.932+0000 7f822d600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82280c7780 0x7f82280c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.932+0000 7f822d600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f822814e900 0x7f822814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f822d600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280c8130 con 0x7f82280c7780 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f822d600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822814f5f0 con 0x7f820c003a00 2024-08-17T02:46:11.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f822d600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822814f8d0 con 0x7f822814e900 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82280c7780 0x7f82280c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82280c7780 0x7f82280c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38388/0 (socket says 172.21.15.2:38388) 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226000640 1 -- 172.21.15.2:0/534971411 learned_addr learned my addr 172.21.15.2:0/534971411 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226a00640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c003a00 0x7f822814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8227400640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f822814e900 0x7f822814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226000640 1 -- 172.21.15.2:0/534971411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f822814e900 msgr2=0x7f822814ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226000640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f822814e900 0x7f822814ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226000640 1 -- 172.21.15.2:0/534971411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c003a00 msgr2=0x7f822814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226000640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c003a00 0x7f822814b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.933+0000 7f8226000640 1 -- 172.21.15.2:0/534971411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822816a250 con 0x7f82280c7780 2024-08-17T02:46:11.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.934+0000 7f8226000640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82280c7780 0x7f82280c7bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8214011b40 tx=0x7f82140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.934+0000 7f821e000640 1 -- 172.21.15.2:0/534971411 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821400faa0 con 0x7f82280c7780 2024-08-17T02:46:11.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.934+0000 7f821e000640 1 -- 172.21.15.2:0/534971411 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821400fc00 con 0x7f82280c7780 2024-08-17T02:46:11.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.934+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822816a530 con 0x7f82280c7780 2024-08-17T02:46:11.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.934+0000 7f821e000640 1 -- 172.21.15.2:0/534971411 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214014440 con 0x7f82280c7780 2024-08-17T02:46:11.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.934+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822814f2b0 con 0x7f82280c7780 2024-08-17T02:46:11.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.935+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822816a9b0 con 0x7f82280c7780 2024-08-17T02:46:11.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.936+0000 7f821e000640 1 -- 172.21.15.2:0/534971411 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8214014830 con 0x7f82280c7780 2024-08-17T02:46:11.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.937+0000 7f821e000640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8208065150 0x7f8208067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:11.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.937+0000 7f821e000640 1 -- 172.21.15.2:0/534971411 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f8214018030 con 0x7f82280c7780 2024-08-17T02:46:11.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.937+0000 7f8226a00640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8208065150 0x7f8208067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:11.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.938+0000 7f8226a00640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8208065150 0x7f8208067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8218032000 tx=0x7f8218033000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:11.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:11.942+0000 7f821e000640 1 -- 172.21.15.2:0/534971411 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8214050e60 con 0x7f82280c7780 2024-08-17T02:46:12.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.123+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8228063fb0 con 0x7f82280c7780 2024-08-17T02:46:12.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.740+0000 7f821e000640 1 -- 172.21.15.2:0/534971411 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8214022020 con 0x7f82280c7780 2024-08-17T02:46:12.743 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-08-17T02:46:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.751+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8208065150 msgr2=0x7f8208067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.751+0000 7f822d600640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8208065150 0x7f8208067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8218032000 tx=0x7f8218033000 comp rx=0 tx=0).stop 2024-08-17T02:46:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.751+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82280c7780 msgr2=0x7f82280c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.751+0000 7f822d600640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82280c7780 0x7f82280c7bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8214011b40 tx=0x7f82140090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.752+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 shutdown_connections 2024-08-17T02:46:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.753+0000 7f822d600640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8208065150 0x7f8208067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.753+0000 7f822d600640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f822814e900 0x7f822814ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.753+0000 7f822d600640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82280c7780 0x7f82280c7bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.753+0000 7f822d600640 1 --2- 172.21.15.2:0/534971411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f820c003a00 0x7f822814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.753+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 >> 172.21.15.2:0/534971411 conn(0x7f8228066e60 msgr2=0x7f82280c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:12.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.753+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 shutdown_connections 2024-08-17T02:46:12.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.754+0000 7f822d600640 1 -- 172.21.15.2:0/534971411 wait complete. 2024-08-17T02:46:12.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:46:12.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.938+0000 7fdf7b000640 1 Processor -- start 2024-08-17T02:46:12.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.938+0000 7fdf7b000640 1 -- start start 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.939+0000 7fdf7b000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdf740ad960 0x7fdf7415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.939+0000 7fdf7b000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf74156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.939+0000 7fdf7b000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7415b5e0 con 0x7fdf740ca050 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.939+0000 7fdf7b000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf740cb160 con 0x7fdf740ad960 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.939+0000 7fdf7b000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740b0d10 con 0x7fdf740add30 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.939+0000 7fdf73e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdf740ad960 0x7fdf7415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.939+0000 7fdf73400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdf740ca050 0x7fdf74156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44014/0 (socket says 172.21.15.2:44014) 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.939+0000 7fdf73400640 1 -- 172.21.15.2:0/3030754703 learned_addr learned my addr 172.21.15.2:0/3030754703 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:12.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.940+0000 7fdf79000640 1 --2- 172.21.15.2:0/3030754703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf74156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.940+0000 7fdf73e00640 1 -- 172.21.15.2:0/3030754703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 msgr2=0x7fdf74156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.940+0000 7fdf73e00640 1 --2- 172.21.15.2:0/3030754703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf74156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.940+0000 7fdf73e00640 1 -- 172.21.15.2:0/3030754703 >> v1:172.21.15.2:6789/0 conn(0x7fdf740ca050 legacy=0x7fdf74156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.940+0000 7fdf72a00640 1 -- 172.21.15.2:0/3030754703 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524093499 0 0) 0x7fdf60001110 con 0x7fdf740ca050 2024-08-17T02:46:12.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.940+0000 7fdf73e00640 1 -- 172.21.15.2:0/3030754703 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740ca550 con 0x7fdf740ad960 2024-08-17T02:46:12.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.941+0000 7fdf73e00640 1 --2- 172.21.15.2:0/3030754703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ad960 0x7fdf7415b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009850 tx=0x7fdf640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986175f7eb8c6989 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.941+0000 7fdf72a00640 1 -- 172.21.15.2:0/3030754703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6402ae10 con 0x7fdf740ad960 2024-08-17T02:46:12.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.941+0000 7fdf72a00640 1 -- 172.21.15.2:0/3030754703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf64032440 con 0x7fdf740ad960 2024-08-17T02:46:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.941+0000 7fdf72a00640 1 -- 172.21.15.2:0/3030754703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640327e0 con 0x7fdf740ad960 2024-08-17T02:46:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.942+0000 7fdf7b000640 1 -- 172.21.15.2:0/3030754703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ad960 msgr2=0x7fdf7415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.942+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3030754703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ad960 0x7fdf7415b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009850 tx=0x7fdf640090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.942+0000 7fdf7b000640 1 -- 172.21.15.2:0/3030754703 shutdown_connections 2024-08-17T02:46:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.942+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3030754703 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf74156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.942+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3030754703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ad960 0x7fdf7415b0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.942+0000 7fdf7b000640 1 -- 172.21.15.2:0/3030754703 >> 172.21.15.2:0/3030754703 conn(0x7fdf74066e60 msgr2=0x7fdf74067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:12.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.942+0000 7fdf7b000640 1 -- 172.21.15.2:0/3030754703 shutdown_connections 2024-08-17T02:46:12.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.942+0000 7fdf7b000640 1 -- 172.21.15.2:0/3030754703 wait complete. 2024-08-17T02:46:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.943+0000 7fdf7b000640 1 Processor -- start 2024-08-17T02:46:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.944+0000 7fdf7b000640 1 -- start start 2024-08-17T02:46:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.944+0000 7fdf7b000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf740ad960 0x7fdf740ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.944+0000 7fdf7b000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf7414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.944+0000 7fdf7b000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ca050 0x7fdf740a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.944+0000 7fdf7b000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74158010 con 0x7fdf740ca050 2024-08-17T02:46:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.944+0000 7fdf7b000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7416a160 con 0x7fdf740ad960 2024-08-17T02:46:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.944+0000 7fdf7b000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74158890 con 0x7fdf740add30 2024-08-17T02:46:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ca050 0x7fdf740a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ca050 0x7fdf740a9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44026/0 (socket says 172.21.15.2:44026) 2024-08-17T02:46:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 -- 172.21.15.2:0/3313070545 learned_addr learned my addr 172.21.15.2:0/3313070545 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf73400640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf7414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf73e00640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf740ad960 0x7fdf740ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 -- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 msgr2=0x7fdf7414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf7414b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 -- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf740ad960 msgr2=0x7fdf740ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf740ad960 0x7fdf740ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 -- 172.21.15.2:0/3313070545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64009390 con 0x7fdf740ca050 2024-08-17T02:46:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf73400640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf7414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.945+0000 7fdf79000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ca050 0x7fdf740a9c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009fa0 tx=0x7fdf6c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.946+0000 7fdf6b400640 1 -- 172.21.15.2:0/3313070545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c00ee60 con 0x7fdf740ca050 2024-08-17T02:46:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.946+0000 7fdf6b400640 1 -- 172.21.15.2:0/3313070545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c014420 con 0x7fdf740ca050 2024-08-17T02:46:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.946+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf74169e80 con 0x7fdf740ca050 2024-08-17T02:46:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.946+0000 7fdf6b400640 1 -- 172.21.15.2:0/3313070545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0147e0 con 0x7fdf740ca050 2024-08-17T02:46:12.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.946+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf74158520 con 0x7fdf740ca050 2024-08-17T02:46:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.947+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf74158a00 con 0x7fdf740ca050 2024-08-17T02:46:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.948+0000 7fdf6b400640 1 -- 172.21.15.2:0/3313070545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdf6c014b50 con 0x7fdf740ca050 2024-08-17T02:46:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.949+0000 7fdf6b400640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdf54065150 0x7fdf54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:12.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.949+0000 7fdf6b400640 1 -- 172.21.15.2:0/3313070545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fdf6c082c30 con 0x7fdf740ca050 2024-08-17T02:46:12.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.949+0000 7fdf73e00640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdf54065150 0x7fdf54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:12.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.949+0000 7fdf73e00640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdf54065150 0x7fdf54067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf64034000 tx=0x7fdf64032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:12.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:12.953+0000 7fdf6b400640 1 -- 172.21.15.2:0/3313070545 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdf6c050cb0 con 0x7fdf740ca050 2024-08-17T02:46:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.174+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdf74063fb0 con 0x7fdf740ca050 2024-08-17T02:46:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.758+0000 7fdf6b400640 1 -- 172.21.15.2:0/3313070545 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdf6c0542d0 con 0x7fdf740ca050 2024-08-17T02:46:13.759 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:46:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.762+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdf54065150 msgr2=0x7fdf54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.762+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdf54065150 0x7fdf54067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf64034000 tx=0x7fdf64032000 comp rx=0 tx=0).stop 2024-08-17T02:46:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.762+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ca050 msgr2=0x7fdf740a9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.762+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ca050 0x7fdf740a9c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009fa0 tx=0x7fdf6c009900 comp rx=0 tx=0).stop 2024-08-17T02:46:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.764+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 shutdown_connections 2024-08-17T02:46:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.764+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf740ca050 0x7fdf740a9c10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.764+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdf54065150 0x7fdf54067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.764+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdf740add30 0x7fdf7414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.764+0000 7fdf7b000640 1 --2- 172.21.15.2:0/3313070545 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf740ad960 0x7fdf740ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.764+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 >> 172.21.15.2:0/3313070545 conn(0x7fdf74066e60 msgr2=0x7fdf741523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:13.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.765+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 shutdown_connections 2024-08-17T02:46:13.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.765+0000 7fdf7b000640 1 -- 172.21.15.2:0/3313070545 wait complete. 2024-08-17T02:46:13.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.946+0000 7fa549c00640 1 Processor -- start 2024-08-17T02:46:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.947+0000 7fa549c00640 1 -- start start 2024-08-17T02:46:13.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa549c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa549c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa5440af130 0x7fa5440ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa549c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5440afd20 con 0x7fa5440b2370 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa549c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5440affe0 con 0x7fa5440af130 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa549c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440b02c0 con 0x7fa544158b90 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa543400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa5440af130 0x7fa5440ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa53a000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa5440b2370 0x7fa5440aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44030/0 (socket says 172.21.15.2:44030) 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa53a000640 1 -- 172.21.15.2:0/2809045852 learned_addr learned my addr 172.21.15.2:0/2809045852 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa542a00640 1 --2- 172.21.15.2:0/2809045852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa543400640 1 -- 172.21.15.2:0/2809045852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 msgr2=0x7fa5440b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa543400640 1 --2- 172.21.15.2:0/2809045852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa543400640 1 -- 172.21.15.2:0/2809045852 >> v1:172.21.15.2:6789/0 conn(0x7fa5440b2370 legacy=0x7fa5440aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa543400640 1 -- 172.21.15.2:0/2809045852 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5440ca3c0 con 0x7fa5440af130 2024-08-17T02:46:13.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa542a00640 1 --2- 172.21.15.2:0/2809045852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:13.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.948+0000 7fa542000640 1 -- 172.21.15.2:0/2809045852 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672623526 0 0) 0x7fa5440afd20 con 0x7fa5440b2370 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.949+0000 7fa543400640 1 --2- 172.21.15.2:0/2809045852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440af130 0x7fa5440ca8e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009e60 tx=0x7fa53c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45f19280d6027e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa542000640 1 -- 172.21.15.2:0/2809045852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c007550 con 0x7fa5440af130 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa542000640 1 -- 172.21.15.2:0/2809045852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c02d050 con 0x7fa5440af130 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa542000640 1 -- 172.21.15.2:0/2809045852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0078e0 con 0x7fa5440af130 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa549c00640 1 -- 172.21.15.2:0/2809045852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440af130 msgr2=0x7fa5440ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa549c00640 1 --2- 172.21.15.2:0/2809045852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440af130 0x7fa5440ca8e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009e60 tx=0x7fa53c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa549c00640 1 -- 172.21.15.2:0/2809045852 shutdown_connections 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa549c00640 1 --2- 172.21.15.2:0/2809045852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440af130 0x7fa5440ca8e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa549c00640 1 --2- 172.21.15.2:0/2809045852 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa549c00640 1 -- 172.21.15.2:0/2809045852 >> 172.21.15.2:0/2809045852 conn(0x7fa54406e590 msgr2=0x7fa54406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa549c00640 1 -- 172.21.15.2:0/2809045852 shutdown_connections 2024-08-17T02:46:13.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.950+0000 7fa549c00640 1 -- 172.21.15.2:0/2809045852 wait complete. 2024-08-17T02:46:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.952+0000 7fa549c00640 1 Processor -- start 2024-08-17T02:46:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.952+0000 7fa549c00640 1 -- start start 2024-08-17T02:46:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa549c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5440af130 0x7fa54414a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa549c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440b2370 0x7fa54415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa549c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa549c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54414a670 con 0x7fa5440b2370 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa549c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440c7220 con 0x7fa5440af130 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa549c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440c7500 con 0x7fa544158b90 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa53a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440b2370 0x7fa54415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa53a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440b2370 0x7fa54415bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44040/0 (socket says 172.21.15.2:44040) 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa53a000640 1 -- 172.21.15.2:0/3756857463 learned_addr learned my addr 172.21.15.2:0/3756857463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa543400640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa542a00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5440af130 0x7fa54414a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa53a000640 1 -- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 msgr2=0x7fa5440cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa53a000640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa53a000640 1 -- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5440af130 msgr2=0x7fa54414a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa53a000640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5440af130 0x7fa54414a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa53a000640 1 -- 172.21.15.2:0/3756857463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c009a20 con 0x7fa5440b2370 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.953+0000 7fa542a00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5440af130 0x7fa54414a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.954+0000 7fa53a000640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440b2370 0x7fa54415bfb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c5e0 tx=0x7fa52c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.954+0000 7fa53aa00640 1 -- 172.21.15.2:0/3756857463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c005aa0 con 0x7fa5440b2370 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.954+0000 7fa53aa00640 1 -- 172.21.15.2:0/3756857463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c005c00 con 0x7fa5440b2370 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.954+0000 7fa53aa00640 1 -- 172.21.15.2:0/3756857463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0070f0 con 0x7fa5440b2370 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.954+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5440c77e0 con 0x7fa5440b2370 2024-08-17T02:46:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.954+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54415c4f0 con 0x7fa5440b2370 2024-08-17T02:46:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.955+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa544063fb0 con 0x7fa5440b2370 2024-08-17T02:46:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.956+0000 7fa53aa00640 1 -- 172.21.15.2:0/3756857463 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa52c007520 con 0x7fa5440b2370 2024-08-17T02:46:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.957+0000 7fa53aa00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa520065150 0x7fa520067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.957+0000 7fa53aa00640 1 -- 172.21.15.2:0/3756857463 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa52c082050 con 0x7fa5440b2370 2024-08-17T02:46:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.957+0000 7fa542a00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa520065150 0x7fa520067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.957+0000 7fa542a00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa520065150 0x7fa520067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa534006e70 tx=0x7fa534008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:13.961+0000 7fa53aa00640 1 -- 172.21.15.2:0/3756857463 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa52c0500f0 con 0x7fa5440b2370 2024-08-17T02:46:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.146+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa544067690 con 0x7fa5440b2370 2024-08-17T02:46:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.147+0000 7fa53aa00640 1 -- 172.21.15.2:0/3756857463 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fa52c053710 con 0x7fa5440b2370 2024-08-17T02:46:14.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:14.149 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:13.175786+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.149+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa520065150 msgr2=0x7fa520067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.149+0000 7fa549c00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa520065150 0x7fa520067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa534006e70 tx=0x7fa534008040 comp rx=0 tx=0).stop 2024-08-17T02:46:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.149+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440b2370 msgr2=0x7fa54415bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.149+0000 7fa549c00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440b2370 0x7fa54415bfb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c5e0 tx=0x7fa52c007d60 comp rx=0 tx=0).stop 2024-08-17T02:46:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.149+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 shutdown_connections 2024-08-17T02:46:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.149+0000 7fa549c00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa520065150 0x7fa520067600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.149+0000 7fa549c00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa544158b90 0x7fa5440cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.149+0000 7fa549c00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5440b2370 0x7fa54415bfb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.150+0000 7fa549c00640 1 --2- 172.21.15.2:0/3756857463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5440af130 0x7fa54414a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.150+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 >> 172.21.15.2:0/3756857463 conn(0x7fa54406e590 msgr2=0x7fa5440b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:14.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.150+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 shutdown_connections 2024-08-17T02:46:14.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.150+0000 7fa549c00640 1 -- 172.21.15.2:0/3756857463 wait complete. 2024-08-17T02:46:14.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:14.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.318+0000 7fd8d6c00640 1 Processor -- start 2024-08-17T02:46:14.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.319+0000 7fd8d6c00640 1 -- start start 2024-08-17T02:46:14.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d6c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d0069840 0x7fd8d00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d6c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd8d00cd550 0x7fd8d015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d6c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd8d00cbe10 0x7fd8d015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d6c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d015c9d0 con 0x7fd8d00cd550 2024-08-17T02:46:14.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d6c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d015a200 con 0x7fd8d00cbe10 2024-08-17T02:46:14.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d6c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00b0830 con 0x7fd8d0069840 2024-08-17T02:46:14.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d4e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd8d00cd550 0x7fd8d015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d4e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd8d00cd550 0x7fd8d015ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44054/0 (socket says 172.21.15.2:44054) 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d4e00640 1 -- 172.21.15.2:0/3484814202 learned_addr learned my addr 172.21.15.2:0/3484814202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.320+0000 7fd8d5800640 1 --2- 172.21.15.2:0/3484814202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d0069840 0x7fd8d00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.321+0000 7fd8d4e00640 1 -- 172.21.15.2:0/3484814202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d0069840 msgr2=0x7fd8d00cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.321+0000 7fd8d4e00640 1 --2- 172.21.15.2:0/3484814202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d0069840 0x7fd8d00cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.321+0000 7fd8d4e00640 1 -- 172.21.15.2:0/3484814202 >> v2:172.21.15.26:3300/0 conn(0x7fd8d00cbe10 msgr2=0x7fd8d015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.321+0000 7fd8d6200640 1 --2- 172.21.15.2:0/3484814202 >> v2:172.21.15.26:3300/0 conn(0x7fd8d00cbe10 0x7fd8d015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.321+0000 7fd8d4e00640 1 --2- 172.21.15.2:0/3484814202 >> v2:172.21.15.26:3300/0 conn(0x7fd8d00cbe10 0x7fd8d015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.321+0000 7fd8d4e00640 1 -- 172.21.15.2:0/3484814202 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00b0b10 con 0x7fd8d00cd550 2024-08-17T02:46:14.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.321+0000 7fd8d6200640 1 --2- 172.21.15.2:0/3484814202 >> v2:172.21.15.26:3300/0 conn(0x7fd8d00cbe10 0x7fd8d015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:14.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.322+0000 7fd8d4e00640 1 --2- 172.21.15.2:0/3484814202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d00cd550 0x7fd8d015ce60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00ca040 tx=0x7fd8bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1238877331a75495 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.322+0000 7fd8cfe00640 1 -- 172.21.15.2:0/3484814202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc02add0 con 0x7fd8d00cd550 2024-08-17T02:46:14.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.322+0000 7fd8cfe00640 1 -- 172.21.15.2:0/3484814202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc032440 con 0x7fd8d00cd550 2024-08-17T02:46:14.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.322+0000 7fd8cfe00640 1 -- 172.21.15.2:0/3484814202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc032820 con 0x7fd8d00cd550 2024-08-17T02:46:14.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.322+0000 7fd8d6c00640 1 -- 172.21.15.2:0/3484814202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d00cd550 msgr2=0x7fd8d015ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.322+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/3484814202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d00cd550 0x7fd8d015ce60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00ca040 tx=0x7fd8bc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.323+0000 7fd8d6c00640 1 -- 172.21.15.2:0/3484814202 shutdown_connections 2024-08-17T02:46:14.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.323+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/3484814202 >> v2:172.21.15.26:3300/0 conn(0x7fd8d00cbe10 0x7fd8d015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.323+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/3484814202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d00cd550 0x7fd8d015ce60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.323+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/3484814202 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d0069840 0x7fd8d00cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.323+0000 7fd8d6c00640 1 -- 172.21.15.2:0/3484814202 >> 172.21.15.2:0/3484814202 conn(0x7fd8d0066e60 msgr2=0x7fd8d0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:14.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.323+0000 7fd8d6c00640 1 -- 172.21.15.2:0/3484814202 shutdown_connections 2024-08-17T02:46:14.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.323+0000 7fd8d6c00640 1 -- 172.21.15.2:0/3484814202 wait complete. 2024-08-17T02:46:14.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.324+0000 7fd8d6c00640 1 Processor -- start 2024-08-17T02:46:14.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.324+0000 7fd8d6c00640 1 -- start start 2024-08-17T02:46:14.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d6c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d0069840 0x7fd8d0144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d6c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d00cbe10 0x7fd8d00aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d6c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d006c440 0x7fd8d006c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d6c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d006cdf0 con 0x7fd8d0069840 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d6c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0157d90 con 0x7fd8d006c440 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d6c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00ab140 con 0x7fd8d00cbe10 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d5800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d0069840 0x7fd8d0144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d5800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d0069840 0x7fd8d0144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44060/0 (socket says 172.21.15.2:44060) 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.325+0000 7fd8d5800640 1 -- 172.21.15.2:0/1723038769 learned_addr learned my addr 172.21.15.2:0/1723038769 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d4e00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d00cbe10 0x7fd8d00aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d6200640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d006c440 0x7fd8d006c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d5800640 1 -- 172.21.15.2:0/1723038769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d00cbe10 msgr2=0x7fd8d00aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d5800640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d00cbe10 0x7fd8d00aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d5800640 1 -- 172.21.15.2:0/1723038769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d006c440 msgr2=0x7fd8d006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d5800640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d006c440 0x7fd8d006c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d5800640 1 -- 172.21.15.2:0/1723038769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc009450 con 0x7fd8d0069840 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d5800640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d0069840 0x7fd8d0144740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400c880 tx=0x7fd8c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8ccc00640 1 -- 172.21.15.2:0/1723038769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400ce10 con 0x7fd8d0069840 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8ccc00640 1 -- 172.21.15.2:0/1723038769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c4007830 con 0x7fd8d0069840 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8ccc00640 1 -- 172.21.15.2:0/1723038769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4007bf0 con 0x7fd8d0069840 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.326+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d0156ea0 con 0x7fd8d0069840 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.327+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d0157460 con 0x7fd8d0069840 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.327+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d0070720 con 0x7fd8d0069840 2024-08-17T02:46:14.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.328+0000 7fd8ccc00640 1 -- 172.21.15.2:0/1723038769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd8c4007d50 con 0x7fd8d0069840 2024-08-17T02:46:14.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.329+0000 7fd8ccc00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd8b0065150 0x7fd8b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.329+0000 7fd8ccc00640 1 -- 172.21.15.2:0/1723038769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8c4082510 con 0x7fd8d0069840 2024-08-17T02:46:14.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.329+0000 7fd8d4e00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd8b0065150 0x7fd8b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.330+0000 7fd8d4e00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd8b0065150 0x7fd8b0067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc034000 tx=0x7fd8bc032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.334+0000 7fd8ccc00640 1 -- 172.21.15.2:0/1723038769 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8c40505e0 con 0x7fd8d0069840 2024-08-17T02:46:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.518+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8d009b470 con 0x7fd8d0069840 2024-08-17T02:46:14.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.518+0000 7fd8ccc00640 1 -- 172.21.15.2:0/1723038769 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fd8c4053c00 con 0x7fd8d0069840 2024-08-17T02:46:14.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:14.520 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:13.175786+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd8b0065150 msgr2=0x7fd8b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd8b0065150 0x7fd8b0067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc034000 tx=0x7fd8bc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d0069840 msgr2=0x7fd8d0144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d0069840 0x7fd8d0144740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400c880 tx=0x7fd8c4008040 comp rx=0 tx=0).stop 2024-08-17T02:46:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 shutdown_connections 2024-08-17T02:46:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8d006c440 0x7fd8d006c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd8b0065150 0x7fd8b0067600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd8d00cbe10 0x7fd8d00aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 --2- 172.21.15.2:0/1723038769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d0069840 0x7fd8d0144740 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.520+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 >> 172.21.15.2:0/1723038769 conn(0x7fd8d0066e60 msgr2=0x7fd8d00cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.521+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 shutdown_connections 2024-08-17T02:46:14.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.521+0000 7fd8d6c00640 1 -- 172.21.15.2:0/1723038769 wait complete. 2024-08-17T02:46:14.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:46:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.690+0000 7f0432a00640 1 Processor -- start 2024-08-17T02:46:14.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.690+0000 7f0432a00640 1 -- start start 2024-08-17T02:46:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.691+0000 7f0432a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c0afca0 0x7f042c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.691+0000 7f0432a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f042c0acf10 0x7f042c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f0432a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042c15a4e0 con 0x7f042c1589a0 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f0432a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c0b0980 con 0x7f042c0acf10 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f0432a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0c92b0 con 0x7f042c0afca0 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f042b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f042c0acf10 0x7f042c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f042b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f042c0acf10 0x7f042c159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44072/0 (socket says 172.21.15.2:44072) 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f042b400640 1 -- 172.21.15.2:0/864067802 learned_addr learned my addr 172.21.15.2:0/864067802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f042be00640 1 --2- 172.21.15.2:0/864067802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c0afca0 0x7f042c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f042b400640 1 -- 172.21.15.2:0/864067802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c0afca0 msgr2=0x7f042c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f042b400640 1 --2- 172.21.15.2:0/864067802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c0afca0 0x7f042c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f042b400640 1 -- 172.21.15.2:0/864067802 >> v1:172.21.15.26:6789/0 conn(0x7f042c1589a0 legacy=0x7f042c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.692+0000 7f042b400640 1 -- 172.21.15.2:0/864067802 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c0ad480 con 0x7f042c0acf10 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.693+0000 7f042b400640 1 --2- 172.21.15.2:0/864067802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0acf10 0x7f042c159fa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0418009940 tx=0x7f04180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939708f47340171c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f042aa00640 1 -- 172.21.15.2:0/864067802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041802ae40 con 0x7f042c0acf10 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f042aa00640 1 -- 172.21.15.2:0/864067802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0418032440 con 0x7f042c0acf10 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f042aa00640 1 -- 172.21.15.2:0/864067802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418032820 con 0x7f042c0acf10 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f0432a00640 1 -- 172.21.15.2:0/864067802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0acf10 msgr2=0x7f042c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f0432a00640 1 --2- 172.21.15.2:0/864067802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0acf10 0x7f042c159fa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0418009940 tx=0x7f04180091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f0432a00640 1 -- 172.21.15.2:0/864067802 shutdown_connections 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f0432a00640 1 --2- 172.21.15.2:0/864067802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0acf10 0x7f042c159fa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f0432a00640 1 --2- 172.21.15.2:0/864067802 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c0afca0 0x7f042c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f0432a00640 1 -- 172.21.15.2:0/864067802 >> 172.21.15.2:0/864067802 conn(0x7f042c066e60 msgr2=0x7f042c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f0432a00640 1 -- 172.21.15.2:0/864067802 shutdown_connections 2024-08-17T02:46:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.694+0000 7f0432a00640 1 -- 172.21.15.2:0/864067802 wait complete. 2024-08-17T02:46:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.696+0000 7f0432a00640 1 Processor -- start 2024-08-17T02:46:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.696+0000 7f0432a00640 1 -- start start 2024-08-17T02:46:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f0432a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f042c0acf10 0x7f042c0a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f0432a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0afca0 0x7f042c16ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f0432a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c1589a0 0x7f042c1440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f0432a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c16d430 con 0x7f042c0afca0 2024-08-17T02:46:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f0432a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c16d710 con 0x7f042c0acf10 2024-08-17T02:46:14.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f0432a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c15b910 con 0x7f042c1589a0 2024-08-17T02:46:14.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0afca0 0x7f042c16ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0afca0 0x7f042c16ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44082/0 (socket says 172.21.15.2:44082) 2024-08-17T02:46:14.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042b400640 1 -- 172.21.15.2:0/896259898 learned_addr learned my addr 172.21.15.2:0/896259898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:14.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042be00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f042c0acf10 0x7f042c0a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f0430a00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c1589a0 0x7f042c1440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042b400640 1 -- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c1589a0 msgr2=0x7f042c1440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042b400640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c1589a0 0x7f042c1440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042b400640 1 -- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f042c0acf10 msgr2=0x7f042c0a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042b400640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f042c0acf10 0x7f042c0a5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042b400640 1 -- 172.21.15.2:0/896259898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009450 con 0x7f042c0afca0 2024-08-17T02:46:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f042be00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f042c0acf10 0x7f042c0a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.697+0000 7f0430a00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c1589a0 0x7f042c1440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:14.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.698+0000 7f042b400640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0afca0 0x7f042c16ca70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0418035040 tx=0x7f0418032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.698+0000 7f0423400640 1 -- 172.21.15.2:0/896259898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418031c80 con 0x7f042c0afca0 2024-08-17T02:46:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.698+0000 7f0423400640 1 -- 172.21.15.2:0/896259898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0418031e40 con 0x7f042c0afca0 2024-08-17T02:46:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.698+0000 7f0423400640 1 -- 172.21.15.2:0/896259898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041803d670 con 0x7f042c0afca0 2024-08-17T02:46:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.698+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c15bbf0 con 0x7f042c0afca0 2024-08-17T02:46:14.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.698+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c16a700 con 0x7f042c0afca0 2024-08-17T02:46:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.699+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c15be30 con 0x7f042c0afca0 2024-08-17T02:46:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.700+0000 7f0423400640 1 -- 172.21.15.2:0/896259898 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0418039040 con 0x7f042c0afca0 2024-08-17T02:46:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.701+0000 7f0423400640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f040c065150 0x7f040c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.701+0000 7f0423400640 1 -- 172.21.15.2:0/896259898 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f041802ae40 con 0x7f042c0afca0 2024-08-17T02:46:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.701+0000 7f042be00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f040c065150 0x7f040c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:14.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.702+0000 7f042be00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f040c065150 0x7f040c067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f041c009cf0 tx=0x7f041c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:14.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.705+0000 7f0423400640 1 -- 172.21.15.2:0/896259898 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f042c15be30 con 0x7f042c0afca0 2024-08-17T02:46:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:14.927+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f042c15bde0 con 0x7f042c0afca0 2024-08-17T02:46:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.760+0000 7f0423400640 1 -- 172.21.15.2:0/896259898 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f04180703d0 con 0x7f042c0afca0 2024-08-17T02:46:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f040c065150 msgr2=0x7f040c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f040c065150 0x7f040c067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f041c009cf0 tx=0x7f041c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0afca0 msgr2=0x7f042c16ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0afca0 0x7f042c16ca70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0418035040 tx=0x7f0418032000 comp rx=0 tx=0).stop 2024-08-17T02:46:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 shutdown_connections 2024-08-17T02:46:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f040c065150 0x7f040c067600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f042c1589a0 0x7f042c1440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f042c0afca0 0x7f042c16ca70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 --2- 172.21.15.2:0/896259898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f042c0acf10 0x7f042c0a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 >> 172.21.15.2:0/896259898 conn(0x7f042c066e60 msgr2=0x7f042c0caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 shutdown_connections 2024-08-17T02:46:15.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.763+0000 7f0432a00640 1 -- 172.21.15.2:0/896259898 wait complete. 2024-08-17T02:46:15.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:46:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.940+0000 7f7dbbe00640 1 Processor -- start 2024-08-17T02:46:15.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.940+0000 7f7dbbe00640 1 -- start start 2024-08-17T02:46:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.942+0000 7f7dbbe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7dbc0b1850 0x7f7dbc0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.942+0000 7f7dbbe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0ce770 con 0x7f7dbc0d0650 2024-08-17T02:46:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.942+0000 7f7dbbe00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0ce9b0 con 0x7f7dbc1585a0 2024-08-17T02:46:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.942+0000 7f7dbbe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc0cec90 con 0x7f7dbc0b1850 2024-08-17T02:46:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.942+0000 7f7dbaa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7dbc0b1850 0x7f7dbc0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.942+0000 7f7db3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7dbc0d0650 0x7f7dbc0ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44032/0 (socket says 172.21.15.2:44032) 2024-08-17T02:46:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.942+0000 7f7db3e00640 1 -- 172.21.15.2:0/497703762 learned_addr learned my addr 172.21.15.2:0/497703762 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.942+0000 7f7dba000640 1 -- 172.21.15.2:0/497703762 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016768756 0 0) 0x7f7da4001110 con 0x7f7dbc0d0650 2024-08-17T02:46:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.943+0000 7f7dba000640 1 -- 172.21.15.2:0/497703762 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7da00034e0 con 0x7f7dbc0d0650 2024-08-17T02:46:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.943+0000 7f7dbaa00640 1 -- 172.21.15.2:0/497703762 >> v1:172.21.15.26:6789/0 conn(0x7f7dbc1585a0 legacy=0x7f7dbc1589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.943+0000 7f7dbaa00640 1 -- 172.21.15.2:0/497703762 >> v1:172.21.15.2:6789/0 conn(0x7f7dbc0d0650 legacy=0x7f7dbc0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.943+0000 7f7dbaa00640 1 -- 172.21.15.2:0/497703762 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc0cef70 con 0x7f7dbc0b1850 2024-08-17T02:46:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.944+0000 7f7dbaa00640 1 --2- 172.21.15.2:0/497703762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0b1850 0x7f7dbc0b1c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009850 tx=0x7f7dac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d83dcb50215348 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.944+0000 7f7dba000640 1 -- 172.21.15.2:0/497703762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac02ae20 con 0x7f7dbc0b1850 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.944+0000 7f7dba000640 1 -- 172.21.15.2:0/497703762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac032440 con 0x7f7dbc0b1850 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.944+0000 7f7dba000640 1 -- 172.21.15.2:0/497703762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0327c0 con 0x7f7dbc0b1850 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.944+0000 7f7dbbe00640 1 -- 172.21.15.2:0/497703762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0b1850 msgr2=0x7f7dbc0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.944+0000 7f7dbbe00640 1 --2- 172.21.15.2:0/497703762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0b1850 0x7f7dbc0b1c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009850 tx=0x7f7dac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.945+0000 7f7dbbe00640 1 -- 172.21.15.2:0/497703762 shutdown_connections 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.945+0000 7f7dbbe00640 1 --2- 172.21.15.2:0/497703762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0b1850 0x7f7dbc0b1c20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.945+0000 7f7dbbe00640 1 -- 172.21.15.2:0/497703762 >> 172.21.15.2:0/497703762 conn(0x7f7dbc06e590 msgr2=0x7f7dbc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.945+0000 7f7dbbe00640 1 -- 172.21.15.2:0/497703762 shutdown_connections 2024-08-17T02:46:15.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.945+0000 7f7dbbe00640 1 -- 172.21.15.2:0/497703762 wait complete. 2024-08-17T02:46:15.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.946+0000 7f7dbbe00640 1 Processor -- start 2024-08-17T02:46:15.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.946+0000 7f7dbbe00640 1 -- start start 2024-08-17T02:46:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dbc0b1850 0x7f7dbc13b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0d0650 0x7f7dbc154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dbc1585a0 0x7f7dbc152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7dbbe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc155df0 con 0x7f7dbc0d0650 2024-08-17T02:46:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7dbbe00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc156040 con 0x7f7dbc1585a0 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7dbbe00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc156320 con 0x7f7dbc0b1850 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7db3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0d0650 0x7f7dbc154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7db3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0d0650 0x7f7dbc154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44088/0 (socket says 172.21.15.2:44088) 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7db3e00640 1 -- 172.21.15.2:0/4005520062 learned_addr learned my addr 172.21.15.2:0/4005520062 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7dbaa00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dbc0b1850 0x7f7dbc13b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.947+0000 7f7dbb400640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dbc1585a0 0x7f7dbc152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db3e00640 1 -- 172.21.15.2:0/4005520062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dbc0b1850 msgr2=0x7f7dbc13b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db3e00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dbc0b1850 0x7f7dbc13b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db3e00640 1 -- 172.21.15.2:0/4005520062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dbc1585a0 msgr2=0x7f7dbc152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db3e00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dbc1585a0 0x7f7dbc152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:15.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db3e00640 1 -- 172.21.15.2:0/4005520062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac009390 con 0x7f7dbc0d0650 2024-08-17T02:46:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db3e00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0d0650 0x7f7dbc154a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c7c0 tx=0x7f7da4007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db2000640 1 -- 172.21.15.2:0/4005520062 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400ce90 con 0x7f7dbc0d0650 2024-08-17T02:46:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db2000640 1 -- 172.21.15.2:0/4005520062 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da4005870 con 0x7f7dbc0d0650 2024-08-17T02:46:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7db2000640 1 -- 172.21.15.2:0/4005520062 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4005c90 con 0x7f7dbc0d0650 2024-08-17T02:46:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc156600 con 0x7f7dbc0d0650 2024-08-17T02:46:15.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.948+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc13ba40 con 0x7f7dbc0d0650 2024-08-17T02:46:15.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.950+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc070720 con 0x7f7dbc0d0650 2024-08-17T02:46:15.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.950+0000 7f7db2000640 1 -- 172.21.15.2:0/4005520062 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7da4007300 con 0x7f7dbc0d0650 2024-08-17T02:46:15.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.951+0000 7f7db2000640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d98065150 0x7f7d98067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:15.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.951+0000 7f7db2000640 1 -- 172.21.15.2:0/4005520062 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7da4081c60 con 0x7f7dbc0d0650 2024-08-17T02:46:15.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.951+0000 7f7dbaa00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d98065150 0x7f7d98067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:15.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.952+0000 7f7dbaa00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d98065150 0x7f7d98067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7dac034000 tx=0x7f7dac032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:15.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:15.955+0000 7f7db2000640 1 -- 172.21.15.2:0/4005520062 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7da404fe50 con 0x7f7dbc0d0650 2024-08-17T02:46:16.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.175+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7dbc0ce770 con 0x7f7dbc0d0650 2024-08-17T02:46:16.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.765+0000 7f7db2000640 1 -- 172.21.15.2:0/4005520062 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7dbc0ce770 con 0x7f7dbc0d0650 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d98065150 msgr2=0x7f7d98067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d98065150 0x7f7d98067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7dac034000 tx=0x7f7dac032000 comp rx=0 tx=0).stop 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0d0650 msgr2=0x7f7dbc154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0d0650 0x7f7dbc154a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c7c0 tx=0x7f7da4007be0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 shutdown_connections 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7dbc1585a0 0x7f7dbc152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dbc0d0650 0x7f7dbc154a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d98065150 0x7f7d98067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 --2- 172.21.15.2:0/4005520062 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7dbc0b1850 0x7f7dbc13b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 >> 172.21.15.2:0/4005520062 conn(0x7f7dbc06e590 msgr2=0x7f7dbc0ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 shutdown_connections 2024-08-17T02:46:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.767+0000 7f7dbbe00640 1 -- 172.21.15.2:0/4005520062 wait complete. 2024-08-17T02:46:16.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.940+0000 7f970e000640 1 Processor -- start 2024-08-17T02:46:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.940+0000 7f970e000640 1 -- start start 2024-08-17T02:46:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.941+0000 7f970e000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ad960 0x7f970815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.941+0000 7f970e000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97080ca050 0x7f9708156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.941+0000 7f970e000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970815b5e0 con 0x7f97080add30 2024-08-17T02:46:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.941+0000 7f970e000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97080cb160 con 0x7f97080ca050 2024-08-17T02:46:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.941+0000 7f970e000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080b0d10 con 0x7f97080ad960 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.941+0000 7f9706a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97080ca050 0x7f9708156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.942+0000 7f9706a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97080ca050 0x7f9708156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44096/0 (socket says 172.21.15.2:44096) 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.942+0000 7f9706a00640 1 -- 172.21.15.2:0/3536794510 learned_addr learned my addr 172.21.15.2:0/3536794510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.942+0000 7f9707400640 1 --2- 172.21.15.2:0/3536794510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ad960 0x7f970815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.942+0000 7f9706a00640 1 -- 172.21.15.2:0/3536794510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ad960 msgr2=0x7f970815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.942+0000 7f9706a00640 1 --2- 172.21.15.2:0/3536794510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ad960 0x7f970815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.942+0000 7f9706a00640 1 -- 172.21.15.2:0/3536794510 >> v1:172.21.15.26:6789/0 conn(0x7f97080add30 legacy=0x7f9708156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.942+0000 7f9706a00640 1 -- 172.21.15.2:0/3536794510 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080ca550 con 0x7f97080ca050 2024-08-17T02:46:16.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.942+0000 7f9707400640 1 --2- 172.21.15.2:0/3536794510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ad960 0x7f970815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.943+0000 7f9706a00640 1 --2- 172.21.15.2:0/3536794510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ca050 0x7f9708156420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009910 tx=0x7f96f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc54bba28c85d6f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.943+0000 7f9706000640 1 -- 172.21.15.2:0/3536794510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4032440 con 0x7f97080ca050 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.943+0000 7f9706000640 1 -- 172.21.15.2:0/3536794510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f40325a0 con 0x7f97080ca050 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.943+0000 7f9706000640 1 -- 172.21.15.2:0/3536794510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4032980 con 0x7f97080ca050 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.944+0000 7f970e000640 1 -- 172.21.15.2:0/3536794510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ca050 msgr2=0x7f9708156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.944+0000 7f970e000640 1 --2- 172.21.15.2:0/3536794510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ca050 0x7f9708156420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009910 tx=0x7f96f40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.944+0000 7f970e000640 1 -- 172.21.15.2:0/3536794510 shutdown_connections 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.944+0000 7f970e000640 1 --2- 172.21.15.2:0/3536794510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ca050 0x7f9708156420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.944+0000 7f970e000640 1 --2- 172.21.15.2:0/3536794510 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ad960 0x7f970815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.944+0000 7f970e000640 1 -- 172.21.15.2:0/3536794510 >> 172.21.15.2:0/3536794510 conn(0x7f9708066e60 msgr2=0x7f9708067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:16.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.944+0000 7f970e000640 1 -- 172.21.15.2:0/3536794510 shutdown_connections 2024-08-17T02:46:16.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.944+0000 7f970e000640 1 -- 172.21.15.2:0/3536794510 wait complete. 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.945+0000 7f970e000640 1 Processor -- start 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.946+0000 7f970e000640 1 -- start start 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.946+0000 7f970e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ad960 0x7f970814b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.946+0000 7f970e000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080add30 0x7f97080ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.946+0000 7f970e000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ca050 0x7f970806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.946+0000 7f970e000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970814b6a0 con 0x7f97080ad960 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.946+0000 7f970e000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080ac4e0 con 0x7f97080add30 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.946+0000 7f970e000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080ac7c0 con 0x7f97080ca050 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ad960 0x7f970814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ad960 0x7f970814b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44106/0 (socket says 172.21.15.2:44106) 2024-08-17T02:46:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 -- 172.21.15.2:0/4245440766 learned_addr learned my addr 172.21.15.2:0/4245440766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707e00640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ca050 0x7f970806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9706a00640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080add30 0x7f97080ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 -- 172.21.15.2:0/4245440766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ca050 msgr2=0x7f970806afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ca050 0x7f970806afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 -- 172.21.15.2:0/4245440766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080add30 msgr2=0x7f97080ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080add30 0x7f97080ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:16.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 -- 172.21.15.2:0/4245440766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4009450 con 0x7f97080ad960 2024-08-17T02:46:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.947+0000 7f9707400640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ad960 0x7f970814b160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96f800d890 tx=0x7f96f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.948+0000 7f96fea00640 1 -- 172.21.15.2:0/4245440766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800de80 con 0x7f97080ad960 2024-08-17T02:46:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.948+0000 7f96fea00640 1 -- 172.21.15.2:0/4245440766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f800b8d0 con 0x7f97080ad960 2024-08-17T02:46:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.948+0000 7f96fea00640 1 -- 172.21.15.2:0/4245440766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800bc90 con 0x7f97080ad960 2024-08-17T02:46:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.948+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97080acaa0 con 0x7f97080ad960 2024-08-17T02:46:16.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.948+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970814ef10 con 0x7f97080ad960 2024-08-17T02:46:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.949+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9708063fb0 con 0x7f97080ad960 2024-08-17T02:46:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.950+0000 7f96fea00640 1 -- 172.21.15.2:0/4245440766 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f96f801e460 con 0x7f97080ad960 2024-08-17T02:46:16.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.950+0000 7f96fea00640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f96e8065150 0x7f96e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:16.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.950+0000 7f96fea00640 1 -- 172.21.15.2:0/4245440766 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96f8082ad0 con 0x7f97080ad960 2024-08-17T02:46:16.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.951+0000 7f9706a00640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f96e8065150 0x7f96e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:16.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.951+0000 7f9706a00640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f96e8065150 0x7f96e8067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f96f4034000 tx=0x7f96f4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:16.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:16.955+0000 7f96fea00640 1 -- 172.21.15.2:0/4245440766 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f96f8050ba0 con 0x7f97080ad960 2024-08-17T02:46:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.182+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9708151d80 con 0x7f97080ad960 2024-08-17T02:46:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.182+0000 7f96fea00640 1 -- 172.21.15.2:0/4245440766 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f96f80541c0 con 0x7f97080ad960 2024-08-17T02:46:17.184 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:17.184 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:13.176093+0000","modified":"2024-08-17T02:46:16.759354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:17.184 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-08-17T02:46:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f96e8065150 msgr2=0x7f96e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f96e8065150 0x7f96e8067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f96f4034000 tx=0x7f96f4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ad960 msgr2=0x7f970814b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ad960 0x7f970814b160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96f800d890 tx=0x7f96f8008040 comp rx=0 tx=0).stop 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 shutdown_connections 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f96e8065150 0x7f96e8067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97080ca050 0x7f970806afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97080add30 0x7f97080ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 --2- 172.21.15.2:0/4245440766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97080ad960 0x7f970814b160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 >> 172.21.15.2:0/4245440766 conn(0x7f9708066e60 msgr2=0x7f9708155000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 shutdown_connections 2024-08-17T02:46:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.185+0000 7f970e000640 1 -- 172.21.15.2:0/4245440766 wait complete. 2024-08-17T02:46:17.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:17.268 INFO:tasks.ceph.mds.d.smithi026.stderr:2024-08-17T02:46:17.267+0000 7fabc4000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:46:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.351+0000 7f1c59c00640 1 Processor -- start 2024-08-17T02:46:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.351+0000 7f1c59c00640 1 -- start start 2024-08-17T02:46:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.352+0000 7f1c59c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1c5406dee0 0x7f1c54163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.352+0000 7f1c59c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c540aed90 con 0x7f1c540ae860 2024-08-17T02:46:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.352+0000 7f1c59c00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c540af070 con 0x7f1c54158a20 2024-08-17T02:46:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.352+0000 7f1c59c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c540af350 con 0x7f1c5406dee0 2024-08-17T02:46:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.353+0000 7f1c4a000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1c540ae860 0x7f1c5406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44042/0 (socket says 172.21.15.2:44042) 2024-08-17T02:46:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.353+0000 7f1c4a000640 1 -- 172.21.15.2:0/2674207741 learned_addr learned my addr 172.21.15.2:0/2674207741 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.353+0000 7f1c53400640 1 --2- 172.21.15.2:0/2674207741 >> v2:172.21.15.26:3300/0 conn(0x7f1c5406dee0 0x7f1c54163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.353+0000 7f1c52000640 1 -- 172.21.15.2:0/2674207741 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384923866 0 0) 0x7f1c540aed90 con 0x7f1c540ae860 2024-08-17T02:46:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.353+0000 7f1c52000640 1 -- 172.21.15.2:0/2674207741 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c380034e0 con 0x7f1c540ae860 2024-08-17T02:46:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.353+0000 7f1c52000640 1 -- 172.21.15.2:0/2674207741 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764626046 0 0) 0x7f1c540af070 con 0x7f1c54158a20 2024-08-17T02:46:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.354+0000 7f1c52000640 1 -- 172.21.15.2:0/2674207741 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c540aed90 con 0x7f1c54158a20 2024-08-17T02:46:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.354+0000 7f1c52000640 1 -- 172.21.15.2:0/2674207741 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382294859 0 0) 0x7f1c380034e0 con 0x7f1c540ae860 2024-08-17T02:46:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.354+0000 7f1c53400640 1 -- 172.21.15.2:0/2674207741 >> v1:172.21.15.26:6789/0 conn(0x7f1c54158a20 legacy=0x7f1c540a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.354+0000 7f1c53400640 1 -- 172.21.15.2:0/2674207741 >> v1:172.21.15.2:6789/0 conn(0x7f1c540ae860 legacy=0x7f1c5406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.354+0000 7f1c53400640 1 -- 172.21.15.2:0/2674207741 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540af630 con 0x7f1c5406dee0 2024-08-17T02:46:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.355+0000 7f1c53400640 1 --2- 172.21.15.2:0/2674207741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c5406dee0 0x7f1c54163c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009e60 tx=0x7f1c4c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ce0a7956eb2a30c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.355+0000 7f1c52000640 1 -- 172.21.15.2:0/2674207741 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c001470 con 0x7f1c5406dee0 2024-08-17T02:46:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.355+0000 7f1c52000640 1 -- 172.21.15.2:0/2674207741 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c02d050 con 0x7f1c5406dee0 2024-08-17T02:46:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.355+0000 7f1c52000640 1 -- 172.21.15.2:0/2674207741 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c031630 con 0x7f1c5406dee0 2024-08-17T02:46:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.355+0000 7f1c59c00640 1 -- 172.21.15.2:0/2674207741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c5406dee0 msgr2=0x7f1c54163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.355+0000 7f1c59c00640 1 --2- 172.21.15.2:0/2674207741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c5406dee0 0x7f1c54163c40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009e60 tx=0x7f1c4c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.356+0000 7f1c59c00640 1 -- 172.21.15.2:0/2674207741 shutdown_connections 2024-08-17T02:46:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.356+0000 7f1c59c00640 1 --2- 172.21.15.2:0/2674207741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c5406dee0 0x7f1c54163c40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.356+0000 7f1c59c00640 1 -- 172.21.15.2:0/2674207741 >> 172.21.15.2:0/2674207741 conn(0x7f1c54066e60 msgr2=0x7f1c54067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.356+0000 7f1c59c00640 1 -- 172.21.15.2:0/2674207741 shutdown_connections 2024-08-17T02:46:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.356+0000 7f1c59c00640 1 -- 172.21.15.2:0/2674207741 wait complete. 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.357+0000 7f1c59c00640 1 Processor -- start 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.357+0000 7f1c59c00640 1 -- start start 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c59c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5406dee0 0x7f1c54169350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c59c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540ae860 0x7f1c540ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c59c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c54158a20 0x7f1c541574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c59c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540ac1e0 con 0x7f1c5406dee0 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c59c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540ab380 con 0x7f1c540ae860 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c59c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540ab5d0 con 0x7f1c54158a20 2024-08-17T02:46:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5406dee0 0x7f1c54169350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5406dee0 0x7f1c54169350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44120/0 (socket says 172.21.15.2:44120) 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c52a00640 1 -- 172.21.15.2:0/903397275 learned_addr learned my addr 172.21.15.2:0/903397275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c4a000640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540ae860 0x7f1c540ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.358+0000 7f1c53400640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c54158a20 0x7f1c541574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c52a00640 1 -- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c54158a20 msgr2=0x7f1c541574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c52a00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c54158a20 0x7f1c541574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c52a00640 1 -- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540ae860 msgr2=0x7f1c540ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c52a00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540ae860 0x7f1c540ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c52a00640 1 -- 172.21.15.2:0/903397275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c009a20 con 0x7f1c5406dee0 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c4a000640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540ae860 0x7f1c540ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c52a00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5406dee0 0x7f1c54169350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c4e0 tx=0x7f1c44007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c4aa00640 1 -- 172.21.15.2:0/903397275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44016070 con 0x7f1c5406dee0 2024-08-17T02:46:17.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c4aa00640 1 -- 172.21.15.2:0/903397275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c44011590 con 0x7f1c5406dee0 2024-08-17T02:46:17.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c540ab8b0 con 0x7f1c5406dee0 2024-08-17T02:46:17.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c4aa00640 1 -- 172.21.15.2:0/903397275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44011950 con 0x7f1c5406dee0 2024-08-17T02:46:17.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.359+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c540abe70 con 0x7f1c5406dee0 2024-08-17T02:46:17.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.360+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c54063fb0 con 0x7f1c5406dee0 2024-08-17T02:46:17.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.361+0000 7f1c4aa00640 1 -- 172.21.15.2:0/903397275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1c44012420 con 0x7f1c5406dee0 2024-08-17T02:46:17.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.362+0000 7f1c4aa00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1c30065150 0x7f1c30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.362+0000 7f1c4aa00640 1 -- 172.21.15.2:0/903397275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c44081fc0 con 0x7f1c5406dee0 2024-08-17T02:46:17.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.362+0000 7f1c4a000640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1c30065150 0x7f1c30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.363+0000 7f1c4a000640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1c30065150 0x7f1c30067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0011e0 tx=0x7f1c3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.365+0000 7f1c4aa00640 1 -- 172.21.15.2:0/903397275 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1c4404ffe0 con 0x7f1c5406dee0 2024-08-17T02:46:17.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.548+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c5406e4c0 con 0x7f1c5406dee0 2024-08-17T02:46:17.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.548+0000 7f1c4aa00640 1 -- 172.21.15.2:0/903397275 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f1c44053600 con 0x7f1c5406dee0 2024-08-17T02:46:17.550 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:17.550 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.550+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1c30065150 msgr2=0x7f1c30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.550+0000 7f1c59c00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1c30065150 0x7f1c30067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0011e0 tx=0x7f1c3c009040 comp rx=0 tx=0).stop 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.550+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5406dee0 msgr2=0x7f1c54169350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.550+0000 7f1c59c00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5406dee0 0x7f1c54169350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c4e0 tx=0x7f1c44007d80 comp rx=0 tx=0).stop 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.551+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 shutdown_connections 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.551+0000 7f1c59c00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1c30065150 0x7f1c30067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.551+0000 7f1c59c00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1c54158a20 0x7f1c541574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.551+0000 7f1c59c00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c540ae860 0x7f1c540ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.551+0000 7f1c59c00640 1 --2- 172.21.15.2:0/903397275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c5406dee0 0x7f1c54169350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.551+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 >> 172.21.15.2:0/903397275 conn(0x7f1c54066e60 msgr2=0x7f1c54069b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.551+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 shutdown_connections 2024-08-17T02:46:17.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.551+0000 7f1c59c00640 1 -- 172.21.15.2:0/903397275 wait complete. 2024-08-17T02:46:17.568 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:46:17.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:17.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.718+0000 7fde00a00640 1 Processor -- start 2024-08-17T02:46:17.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.718+0000 7fde00a00640 1 -- start start 2024-08-17T02:46:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.719+0000 7fde00a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fddfc15a950 0x7fddfc0a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.719+0000 7fde00a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc0a9a90 con 0x7fddfc0a9630 2024-08-17T02:46:17.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fde00a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc067510 con 0x7fddfc158f20 2024-08-17T02:46:17.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fde00a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc063650 con 0x7fddfc15a950 2024-08-17T02:46:17.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddfa800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fddfc0a9630 0x7fddfc1592f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44048/0 (socket says 172.21.15.2:44048) 2024-08-17T02:46:17.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddfa800640 1 -- 172.21.15.2:0/2426084085 learned_addr learned my addr 172.21.15.2:0/2426084085 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:17.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddf9400640 1 --2- 172.21.15.2:0/2426084085 >> v2:172.21.15.2:3300/0 conn(0x7fddfc15a950 0x7fddfc0a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddf8a00640 1 -- 172.21.15.2:0/2426084085 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222718249 0 0) 0x7fddf4001490 con 0x7fddfc0a9630 2024-08-17T02:46:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddf8a00640 1 -- 172.21.15.2:0/2426084085 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde00034e0 con 0x7fddfc0a9630 2024-08-17T02:46:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddf8a00640 1 -- 172.21.15.2:0/2426084085 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652233184 0 0) 0x7fddfc067510 con 0x7fddfc158f20 2024-08-17T02:46:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddf8a00640 1 -- 172.21.15.2:0/2426084085 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf4001490 con 0x7fddfc158f20 2024-08-17T02:46:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddf9400640 1 -- 172.21.15.2:0/2426084085 >> v1:172.21.15.26:6789/0 conn(0x7fddfc158f20 legacy=0x7fddfc062f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddf9400640 1 -- 172.21.15.2:0/2426084085 >> v1:172.21.15.2:6789/0 conn(0x7fddfc0a9630 legacy=0x7fddfc1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.720+0000 7fddf9400640 1 -- 172.21.15.2:0/2426084085 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc066f00 con 0x7fddfc15a950 2024-08-17T02:46:17.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.721+0000 7fddf9400640 1 --2- 172.21.15.2:0/2426084085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc15a950 0x7fddfc0a90f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009850 tx=0x7fdde80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce09d1d09561050 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fddf8a00640 1 -- 172.21.15.2:0/2426084085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde802ae20 con 0x7fddfc15a950 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fddf8a00640 1 -- 172.21.15.2:0/2426084085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde8032440 con 0x7fddfc15a950 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fddf8a00640 1 -- 172.21.15.2:0/2426084085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde80327c0 con 0x7fddfc15a950 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fde00a00640 1 -- 172.21.15.2:0/2426084085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc15a950 msgr2=0x7fddfc0a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fde00a00640 1 --2- 172.21.15.2:0/2426084085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc15a950 0x7fddfc0a90f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009850 tx=0x7fdde80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fde00a00640 1 -- 172.21.15.2:0/2426084085 shutdown_connections 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fde00a00640 1 --2- 172.21.15.2:0/2426084085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc15a950 0x7fddfc0a90f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fde00a00640 1 -- 172.21.15.2:0/2426084085 >> 172.21.15.2:0/2426084085 conn(0x7fddfc06e5b0 msgr2=0x7fddfc0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fde00a00640 1 -- 172.21.15.2:0/2426084085 shutdown_connections 2024-08-17T02:46:17.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.722+0000 7fde00a00640 1 -- 172.21.15.2:0/2426084085 wait complete. 2024-08-17T02:46:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.724+0000 7fde00a00640 1 Processor -- start 2024-08-17T02:46:17.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.724+0000 7fde00a00640 1 -- start start 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fde00a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc0a9630 0x7fddfc13cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fde00a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc158f20 0x7fddfc13e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fde00a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc15a950 0x7fddfc13ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fde00a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc140040 con 0x7fddfc0a9630 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fde00a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc13f430 con 0x7fddfc15a950 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fde00a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc13f710 con 0x7fddfc158f20 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddf9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc0a9630 0x7fddfc13cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddf9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc0a9630 0x7fddfc13cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44138/0 (socket says 172.21.15.2:44138) 2024-08-17T02:46:17.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddf9e00640 1 -- 172.21.15.2:0/874044817 learned_addr learned my addr 172.21.15.2:0/874044817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddf9e00640 1 -- 172.21.15.2:0/874044817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc158f20 msgr2=0x7fddfc13e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddf9e00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc158f20 0x7fddfc13e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddfa800640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc15a950 0x7fddfc13ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddf9e00640 1 -- 172.21.15.2:0/874044817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc15a950 msgr2=0x7fddfc13ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddf9e00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc15a950 0x7fddfc13ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddf9e00640 1 -- 172.21.15.2:0/874044817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8009390 con 0x7fddfc0a9630 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.725+0000 7fddfa800640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc15a950 0x7fddfc13ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.726+0000 7fddf9e00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc0a9630 0x7fddfc13cf80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c590 tx=0x7fddec007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.726+0000 7fddf1600640 1 -- 172.21.15.2:0/874044817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec012630 con 0x7fddfc0a9630 2024-08-17T02:46:17.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.726+0000 7fddf1600640 1 -- 172.21.15.2:0/874044817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0127b0 con 0x7fddfc0a9630 2024-08-17T02:46:17.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.726+0000 7fddf1600640 1 -- 172.21.15.2:0/874044817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec012bb0 con 0x7fddfc0a9630 2024-08-17T02:46:17.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.726+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc13f9f0 con 0x7fddfc0a9630 2024-08-17T02:46:17.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.726+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc13f100 con 0x7fddfc0a9630 2024-08-17T02:46:17.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.727+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc095f20 con 0x7fddfc0a9630 2024-08-17T02:46:17.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.728+0000 7fddf1600640 1 -- 172.21.15.2:0/874044817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fddec01a3b0 con 0x7fddfc0a9630 2024-08-17T02:46:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.729+0000 7fddf1600640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdddc065150 0x7fdddc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.729+0000 7fddf1600640 1 -- 172.21.15.2:0/874044817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddec082440 con 0x7fddfc0a9630 2024-08-17T02:46:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.729+0000 7fddf9400640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdddc065150 0x7fdddc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.729+0000 7fddf9400640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdddc065150 0x7fdddc067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdde8034000 tx=0x7fdde8032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.732+0000 7fddf1600640 1 -- 172.21.15.2:0/874044817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fddec050460 con 0x7fddfc0a9630 2024-08-17T02:46:17.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.911+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddfc140180 con 0x7fdddc065150 2024-08-17T02:46:17.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.919+0000 7fddf1600640 1 -- 172.21.15.2:0/874044817 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264660 (secure 0 0 0) 0x7fdde8032640 con 0x7fdddc065150 2024-08-17T02:46:17.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:17.925 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:46:17.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdddc065150 msgr2=0x7fdddc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdddc065150 0x7fdddc067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdde8034000 tx=0x7fdde8032000 comp rx=0 tx=0).stop 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc0a9630 msgr2=0x7fddfc13cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc0a9630 0x7fddfc13cf80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fddec00c590 tx=0x7fddec007d80 comp rx=0 tx=0).stop 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 shutdown_connections 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddfc15a950 0x7fddfc13ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdddc065150 0x7fdddc067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fddfc158f20 0x7fddfc13e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 --2- 172.21.15.2:0/874044817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddfc0a9630 0x7fddfc13cf80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 >> 172.21.15.2:0/874044817 conn(0x7fddfc06e5b0 msgr2=0x7fddfc1592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 shutdown_connections 2024-08-17T02:46:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:17.923+0000 7fde00a00640 1 -- 172.21.15.2:0/874044817 wait complete. 2024-08-17T02:46:17.940 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:46:17.015058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415056,"kb_used_data":2908,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752559664,"statfs":{"total":773094113280,"available":770621095936,"internally_reserved":0,"allocated":2977792,"data_stored":1781628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.282753"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783449+0000","last_change":"2024-08-17T02:46:13.782069+0000","last_active":"2024-08-17T02:46:13.783449+0000","last_peered":"2024-08-17T02:46:13.783449+0000","last_clean":"2024-08-17T02:46:13.783449+0000","last_became_active":"2024-08-17T02:46:13.780634+0000","last_became_peered":"2024-08-17T02:46:13.780634+0000","last_unstale":"2024-08-17T02:46:13.783449+0000","last_undegraded":"2024-08-17T02:46:13.783449+0000","last_fullsized":"2024-08-17T02:46:13.783449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:48.296428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788581+0000","last_change":"2024-08-17T02:46:13.787373+0000","last_active":"2024-08-17T02:46:13.788581+0000","last_peered":"2024-08-17T02:46:13.788581+0000","last_clean":"2024-08-17T02:46:13.788581+0000","last_became_active":"2024-08-17T02:46:13.785874+0000","last_became_peered":"2024-08-17T02:46:13.785874+0000","last_unstale":"2024-08-17T02:46:13.788581+0000","last_undegraded":"2024-08-17T02:46:13.788581+0000","last_fullsized":"2024-08-17T02:46:13.788581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.771809+0000","last_change":"2024-08-17T02:46:13.756970+0000","last_active":"2024-08-17T02:46:13.771809+0000","last_peered":"2024-08-17T02:46:13.771809+0000","last_clean":"2024-08-17T02:46:13.771809+0000","last_became_active":"2024-08-17T02:46:13.756661+0000","last_became_peered":"2024-08-17T02:46:13.756661+0000","last_unstale":"2024-08-17T02:46:13.771809+0000","last_undegraded":"2024-08-17T02:46:13.771809+0000","last_fullsized":"2024-08-17T02:46:13.771809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763017+0000","last_change":"2024-08-17T02:46:13.760375+0000","last_active":"2024-08-17T02:46:13.763017+0000","last_peered":"2024-08-17T02:46:13.763017+0000","last_clean":"2024-08-17T02:46:13.763017+0000","last_became_active":"2024-08-17T02:46:13.759323+0000","last_became_peered":"2024-08-17T02:46:13.759323+0000","last_unstale":"2024-08-17T02:46:13.763017+0000","last_undegraded":"2024-08-17T02:46:13.763017+0000","last_fullsized":"2024-08-17T02:46:13.763017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:53.437116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787628+0000","last_change":"2024-08-17T02:46:13.778338+0000","last_active":"2024-08-17T02:46:13.787628+0000","last_peered":"2024-08-17T02:46:13.787628+0000","last_clean":"2024-08-17T02:46:13.787628+0000","last_became_active":"2024-08-17T02:46:13.771574+0000","last_became_peered":"2024-08-17T02:46:13.771574+0000","last_unstale":"2024-08-17T02:46:13.787628+0000","last_undegraded":"2024-08-17T02:46:13.787628+0000","last_fullsized":"2024-08-17T02:46:13.787628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:53.437116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777529+0000","last_change":"2024-08-17T02:46:13.774672+0000","last_active":"2024-08-17T02:46:13.777529+0000","last_peered":"2024-08-17T02:46:13.777529+0000","last_clean":"2024-08-17T02:46:13.777529+0000","last_became_active":"2024-08-17T02:46:13.774417+0000","last_became_peered":"2024-08-17T02:46:13.774417+0000","last_unstale":"2024-08-17T02:46:13.777529+0000","last_undegraded":"2024-08-17T02:46:13.777529+0000","last_fullsized":"2024-08-17T02:46:13.777529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777974+0000","last_change":"2024-08-17T02:46:13.777018+0000","last_active":"2024-08-17T02:46:13.777974+0000","last_peered":"2024-08-17T02:46:13.777974+0000","last_clean":"2024-08-17T02:46:13.777974+0000","last_became_active":"2024-08-17T02:46:13.776494+0000","last_became_peered":"2024-08-17T02:46:13.776494+0000","last_unstale":"2024-08-17T02:46:13.777974+0000","last_undegraded":"2024-08-17T02:46:13.777974+0000","last_fullsized":"2024-08-17T02:46:13.777974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:13.882288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777982+0000","last_change":"2024-08-17T02:46:13.772303+0000","last_active":"2024-08-17T02:46:13.777982+0000","last_peered":"2024-08-17T02:46:13.777982+0000","last_clean":"2024-08-17T02:46:13.777982+0000","last_became_active":"2024-08-17T02:46:13.770496+0000","last_became_peered":"2024-08-17T02:46:13.770496+0000","last_unstale":"2024-08-17T02:46:13.777982+0000","last_undegraded":"2024-08-17T02:46:13.777982+0000","last_fullsized":"2024-08-17T02:46:13.777982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783745+0000","last_change":"2024-08-17T02:46:13.782542+0000","last_active":"2024-08-17T02:46:13.783745+0000","last_peered":"2024-08-17T02:46:13.783745+0000","last_clean":"2024-08-17T02:46:13.783745+0000","last_became_active":"2024-08-17T02:46:13.781512+0000","last_became_peered":"2024-08-17T02:46:13.781512+0000","last_unstale":"2024-08-17T02:46:13.783745+0000","last_undegraded":"2024-08-17T02:46:13.783745+0000","last_fullsized":"2024-08-17T02:46:13.783745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:31.909156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774645+0000","last_change":"2024-08-17T02:46:13.772207+0000","last_active":"2024-08-17T02:46:13.774645+0000","last_peered":"2024-08-17T02:46:13.774645+0000","last_clean":"2024-08-17T02:46:13.774645+0000","last_became_active":"2024-08-17T02:46:13.771965+0000","last_became_peered":"2024-08-17T02:46:13.771965+0000","last_unstale":"2024-08-17T02:46:13.774645+0000","last_undegraded":"2024-08-17T02:46:13.774645+0000","last_fullsized":"2024-08-17T02:46:13.774645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774903+0000","last_change":"2024-08-17T02:46:13.772803+0000","last_active":"2024-08-17T02:46:13.774903+0000","last_peered":"2024-08-17T02:46:13.774903+0000","last_clean":"2024-08-17T02:46:13.774903+0000","last_became_active":"2024-08-17T02:46:13.772356+0000","last_became_peered":"2024-08-17T02:46:13.772356+0000","last_unstale":"2024-08-17T02:46:13.774903+0000","last_undegraded":"2024-08-17T02:46:13.774903+0000","last_fullsized":"2024-08-17T02:46:13.774903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774317+0000","last_change":"2024-08-17T02:46:13.765594+0000","last_active":"2024-08-17T02:46:13.774317+0000","last_peered":"2024-08-17T02:46:13.774317+0000","last_clean":"2024-08-17T02:46:13.774317+0000","last_became_active":"2024-08-17T02:46:13.765142+0000","last_became_peered":"2024-08-17T02:46:13.765142+0000","last_unstale":"2024-08-17T02:46:13.774317+0000","last_undegraded":"2024-08-17T02:46:13.774317+0000","last_fullsized":"2024-08-17T02:46:13.774317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:17.516179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764835+0000","last_change":"2024-08-17T02:46:13.762927+0000","last_active":"2024-08-17T02:46:13.764835+0000","last_peered":"2024-08-17T02:46:13.764835+0000","last_clean":"2024-08-17T02:46:13.764835+0000","last_became_active":"2024-08-17T02:46:13.762593+0000","last_became_peered":"2024-08-17T02:46:13.762593+0000","last_unstale":"2024-08-17T02:46:13.764835+0000","last_undegraded":"2024-08-17T02:46:13.764835+0000","last_fullsized":"2024-08-17T02:46:13.764835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786511+0000","last_change":"2024-08-17T02:46:13.779226+0000","last_active":"2024-08-17T02:46:13.786511+0000","last_peered":"2024-08-17T02:46:13.786511+0000","last_clean":"2024-08-17T02:46:13.786511+0000","last_became_active":"2024-08-17T02:46:13.778514+0000","last_became_peered":"2024-08-17T02:46:13.778514+0000","last_unstale":"2024-08-17T02:46:13.786511+0000","last_undegraded":"2024-08-17T02:46:13.786511+0000","last_fullsized":"2024-08-17T02:46:13.786511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775996+0000","last_change":"2024-08-17T02:46:13.764824+0000","last_active":"2024-08-17T02:46:13.775996+0000","last_peered":"2024-08-17T02:46:13.775996+0000","last_clean":"2024-08-17T02:46:13.775996+0000","last_became_active":"2024-08-17T02:46:13.764423+0000","last_became_peered":"2024-08-17T02:46:13.764423+0000","last_unstale":"2024-08-17T02:46:13.775996+0000","last_undegraded":"2024-08-17T02:46:13.775996+0000","last_fullsized":"2024-08-17T02:46:13.775996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.762356+0000","last_change":"2024-08-17T02:46:13.758109+0000","last_active":"2024-08-17T02:46:13.762356+0000","last_peered":"2024-08-17T02:46:13.762356+0000","last_clean":"2024-08-17T02:46:13.762356+0000","last_became_active":"2024-08-17T02:46:13.757727+0000","last_became_peered":"2024-08-17T02:46:13.757727+0000","last_unstale":"2024-08-17T02:46:13.762356+0000","last_undegraded":"2024-08-17T02:46:13.762356+0000","last_fullsized":"2024-08-17T02:46:13.762356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:29.582747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775780+0000","last_change":"2024-08-17T02:46:13.770315+0000","last_active":"2024-08-17T02:46:13.775780+0000","last_peered":"2024-08-17T02:46:13.775780+0000","last_clean":"2024-08-17T02:46:13.775780+0000","last_became_active":"2024-08-17T02:46:13.770058+0000","last_became_peered":"2024-08-17T02:46:13.770058+0000","last_unstale":"2024-08-17T02:46:13.775780+0000","last_undegraded":"2024-08-17T02:46:13.775780+0000","last_fullsized":"2024-08-17T02:46:13.775780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:13.882288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.765237+0000","last_change":"2024-08-17T02:46:13.762473+0000","last_active":"2024-08-17T02:46:13.765237+0000","last_peered":"2024-08-17T02:46:13.765237+0000","last_clean":"2024-08-17T02:46:13.765237+0000","last_became_active":"2024-08-17T02:46:13.762210+0000","last_became_peered":"2024-08-17T02:46:13.762210+0000","last_unstale":"2024-08-17T02:46:13.765237+0000","last_undegraded":"2024-08-17T02:46:13.765237+0000","last_fullsized":"2024-08-17T02:46:13.765237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:28.991722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781197+0000","last_change":"2024-08-17T02:46:13.774494+0000","last_active":"2024-08-17T02:46:13.781197+0000","last_peered":"2024-08-17T02:46:13.781197+0000","last_clean":"2024-08-17T02:46:13.781197+0000","last_became_active":"2024-08-17T02:46:13.774173+0000","last_became_peered":"2024-08-17T02:46:13.774173+0000","last_unstale":"2024-08-17T02:46:13.781197+0000","last_undegraded":"2024-08-17T02:46:13.781197+0000","last_fullsized":"2024-08-17T02:46:13.781197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:10.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774059+0000","last_change":"2024-08-17T02:46:13.766560+0000","last_active":"2024-08-17T02:46:13.774059+0000","last_peered":"2024-08-17T02:46:13.774059+0000","last_clean":"2024-08-17T02:46:13.774059+0000","last_became_active":"2024-08-17T02:46:13.765745+0000","last_became_peered":"2024-08-17T02:46:13.765745+0000","last_unstale":"2024-08-17T02:46:13.774059+0000","last_undegraded":"2024-08-17T02:46:13.774059+0000","last_fullsized":"2024-08-17T02:46:13.774059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776545+0000","last_change":"2024-08-17T02:46:13.765254+0000","last_active":"2024-08-17T02:46:13.776545+0000","last_peered":"2024-08-17T02:46:13.776545+0000","last_clean":"2024-08-17T02:46:13.776545+0000","last_became_active":"2024-08-17T02:46:13.756647+0000","last_became_peered":"2024-08-17T02:46:13.756647+0000","last_unstale":"2024-08-17T02:46:13.776545+0000","last_undegraded":"2024-08-17T02:46:13.776545+0000","last_fullsized":"2024-08-17T02:46:13.776545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.770703+0000","last_change":"2024-08-17T02:46:13.765508+0000","last_active":"2024-08-17T02:46:13.770703+0000","last_peered":"2024-08-17T02:46:13.770703+0000","last_clean":"2024-08-17T02:46:13.770703+0000","last_became_active":"2024-08-17T02:46:13.765136+0000","last_became_peered":"2024-08-17T02:46:13.765136+0000","last_unstale":"2024-08-17T02:46:13.770703+0000","last_undegraded":"2024-08-17T02:46:13.770703+0000","last_fullsized":"2024-08-17T02:46:13.770703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:48.296428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.773564+0000","last_change":"2024-08-17T02:46:13.766938+0000","last_active":"2024-08-17T02:46:13.773564+0000","last_peered":"2024-08-17T02:46:13.773564+0000","last_clean":"2024-08-17T02:46:13.773564+0000","last_became_active":"2024-08-17T02:46:13.766711+0000","last_became_peered":"2024-08-17T02:46:13.766711+0000","last_unstale":"2024-08-17T02:46:13.773564+0000","last_undegraded":"2024-08-17T02:46:13.773564+0000","last_fullsized":"2024-08-17T02:46:13.773564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763233+0000","last_change":"2024-08-17T02:46:13.761055+0000","last_active":"2024-08-17T02:46:13.763233+0000","last_peered":"2024-08-17T02:46:13.763233+0000","last_clean":"2024-08-17T02:46:13.763233+0000","last_became_active":"2024-08-17T02:46:13.760766+0000","last_became_peered":"2024-08-17T02:46:13.760766+0000","last_unstale":"2024-08-17T02:46:13.763233+0000","last_undegraded":"2024-08-17T02:46:13.763233+0000","last_fullsized":"2024-08-17T02:46:13.763233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:10.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776693+0000","last_change":"2024-08-17T02:46:13.769437+0000","last_active":"2024-08-17T02:46:13.776693+0000","last_peered":"2024-08-17T02:46:13.776693+0000","last_clean":"2024-08-17T02:46:13.776693+0000","last_became_active":"2024-08-17T02:46:13.768078+0000","last_became_peered":"2024-08-17T02:46:13.768078+0000","last_unstale":"2024-08-17T02:46:13.776693+0000","last_undegraded":"2024-08-17T02:46:13.776693+0000","last_fullsized":"2024-08-17T02:46:13.776693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.782708+0000","last_change":"2024-08-17T02:46:13.780502+0000","last_active":"2024-08-17T02:46:13.782708+0000","last_peered":"2024-08-17T02:46:13.782708+0000","last_clean":"2024-08-17T02:46:13.782708+0000","last_became_active":"2024-08-17T02:46:13.780234+0000","last_became_peered":"2024-08-17T02:46:13.780234+0000","last_unstale":"2024-08-17T02:46:13.782708+0000","last_undegraded":"2024-08-17T02:46:13.782708+0000","last_fullsized":"2024-08-17T02:46:13.782708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776104+0000","last_change":"2024-08-17T02:46:13.765975+0000","last_active":"2024-08-17T02:46:13.776104+0000","last_peered":"2024-08-17T02:46:13.776104+0000","last_clean":"2024-08-17T02:46:13.776104+0000","last_became_active":"2024-08-17T02:46:13.765732+0000","last_became_peered":"2024-08-17T02:46:13.765732+0000","last_unstale":"2024-08-17T02:46:13.776104+0000","last_undegraded":"2024-08-17T02:46:13.776104+0000","last_fullsized":"2024-08-17T02:46:13.776104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781638+0000","last_change":"2024-08-17T02:46:13.768145+0000","last_active":"2024-08-17T02:46:13.781638+0000","last_peered":"2024-08-17T02:46:13.781638+0000","last_clean":"2024-08-17T02:46:13.781638+0000","last_became_active":"2024-08-17T02:46:13.767826+0000","last_became_peered":"2024-08-17T02:46:13.767826+0000","last_unstale":"2024-08-17T02:46:13.781638+0000","last_undegraded":"2024-08-17T02:46:13.781638+0000","last_fullsized":"2024-08-17T02:46:13.781638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787886+0000","last_change":"2024-08-17T02:46:13.773416+0000","last_active":"2024-08-17T02:46:13.787886+0000","last_peered":"2024-08-17T02:46:13.787886+0000","last_clean":"2024-08-17T02:46:13.787886+0000","last_became_active":"2024-08-17T02:46:13.773114+0000","last_became_peered":"2024-08-17T02:46:13.773114+0000","last_unstale":"2024-08-17T02:46:13.787886+0000","last_undegraded":"2024-08-17T02:46:13.787886+0000","last_fullsized":"2024-08-17T02:46:13.787886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:00.627300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.765708+0000","last_change":"2024-08-17T02:46:13.759659+0000","last_active":"2024-08-17T02:46:13.765708+0000","last_peered":"2024-08-17T02:46:13.765708+0000","last_clean":"2024-08-17T02:46:13.765708+0000","last_became_active":"2024-08-17T02:46:13.759333+0000","last_became_peered":"2024-08-17T02:46:13.759333+0000","last_unstale":"2024-08-17T02:46:13.765708+0000","last_undegraded":"2024-08-17T02:46:13.765708+0000","last_fullsized":"2024-08-17T02:46:13.765708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772382+0000","last_change":"2024-08-17T02:46:13.768988+0000","last_active":"2024-08-17T02:46:13.772382+0000","last_peered":"2024-08-17T02:46:13.772382+0000","last_clean":"2024-08-17T02:46:13.772382+0000","last_became_active":"2024-08-17T02:46:13.768739+0000","last_became_peered":"2024-08-17T02:46:13.768739+0000","last_unstale":"2024-08-17T02:46:13.772382+0000","last_undegraded":"2024-08-17T02:46:13.772382+0000","last_fullsized":"2024-08-17T02:46:13.772382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:43.094798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777504+0000","last_change":"2024-08-17T02:46:13.776020+0000","last_active":"2024-08-17T02:46:13.777504+0000","last_peered":"2024-08-17T02:46:13.777504+0000","last_clean":"2024-08-17T02:46:13.777504+0000","last_became_active":"2024-08-17T02:46:13.775579+0000","last_became_peered":"2024-08-17T02:46:13.775579+0000","last_unstale":"2024-08-17T02:46:13.777504+0000","last_undegraded":"2024-08-17T02:46:13.777504+0000","last_fullsized":"2024-08-17T02:46:13.777504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787097+0000","last_change":"2024-08-17T02:46:13.785306+0000","last_active":"2024-08-17T02:46:13.787097+0000","last_peered":"2024-08-17T02:46:13.787097+0000","last_clean":"2024-08-17T02:46:13.787097+0000","last_became_active":"2024-08-17T02:46:13.783412+0000","last_became_peered":"2024-08-17T02:46:13.783412+0000","last_unstale":"2024-08-17T02:46:13.787097+0000","last_undegraded":"2024-08-17T02:46:13.787097+0000","last_fullsized":"2024-08-17T02:46:13.787097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:29.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787958+0000","last_change":"2024-08-17T02:46:12.766141+0000","last_active":"2024-08-17T02:46:13.787958+0000","last_peered":"2024-08-17T02:46:13.787958+0000","last_clean":"2024-08-17T02:46:13.787958+0000","last_became_active":"2024-08-17T02:46:12.763492+0000","last_became_peered":"2024-08-17T02:46:12.763492+0000","last_unstale":"2024-08-17T02:46:13.787958+0000","last_undegraded":"2024-08-17T02:46:13.787958+0000","last_fullsized":"2024-08-17T02:46:13.787958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784653+0000","last_change":"2024-08-17T02:46:13.772658+0000","last_active":"2024-08-17T02:46:13.784653+0000","last_peered":"2024-08-17T02:46:13.784653+0000","last_clean":"2024-08-17T02:46:13.784653+0000","last_became_active":"2024-08-17T02:46:13.765586+0000","last_became_peered":"2024-08-17T02:46:13.765586+0000","last_unstale":"2024-08-17T02:46:13.784653+0000","last_undegraded":"2024-08-17T02:46:13.784653+0000","last_fullsized":"2024-08-17T02:46:13.784653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788422+0000","last_change":"2024-08-17T02:46:12.765654+0000","last_active":"2024-08-17T02:46:13.788422+0000","last_peered":"2024-08-17T02:46:13.788422+0000","last_clean":"2024-08-17T02:46:13.788422+0000","last_became_active":"2024-08-17T02:46:12.765358+0000","last_became_peered":"2024-08-17T02:46:12.765358+0000","last_unstale":"2024-08-17T02:46:13.788422+0000","last_undegraded":"2024-08-17T02:46:13.788422+0000","last_fullsized":"2024-08-17T02:46:13.788422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.746879+0000","last_change":"2024-08-17T02:46:12.757374+0000","last_active":"2024-08-17T02:46:13.746879+0000","last_peered":"2024-08-17T02:46:13.746879+0000","last_clean":"2024-08-17T02:46:13.746879+0000","last_became_active":"2024-08-17T02:46:12.757064+0000","last_became_peered":"2024-08-17T02:46:12.757064+0000","last_unstale":"2024-08-17T02:46:13.746879+0000","last_undegraded":"2024-08-17T02:46:13.746879+0000","last_fullsized":"2024-08-17T02:46:13.746879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:32.171597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.758714+0000","last_change":"2024-08-17T02:46:13.757800+0000","last_active":"2024-08-17T02:46:13.758714+0000","last_peered":"2024-08-17T02:46:13.758714+0000","last_clean":"2024-08-17T02:46:13.758714+0000","last_became_active":"2024-08-17T02:46:13.757609+0000","last_became_peered":"2024-08-17T02:46:13.757609+0000","last_unstale":"2024-08-17T02:46:13.758714+0000","last_undegraded":"2024-08-17T02:46:13.758714+0000","last_fullsized":"2024-08-17T02:46:13.758714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.752836+0000","last_change":"2024-08-17T02:46:12.771509+0000","last_active":"2024-08-17T02:46:13.752836+0000","last_peered":"2024-08-17T02:46:13.752836+0000","last_clean":"2024-08-17T02:46:13.752836+0000","last_became_active":"2024-08-17T02:46:12.765884+0000","last_became_peered":"2024-08-17T02:46:12.765884+0000","last_unstale":"2024-08-17T02:46:13.752836+0000","last_undegraded":"2024-08-17T02:46:13.752836+0000","last_fullsized":"2024-08-17T02:46:13.752836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772441+0000","last_change":"2024-08-17T02:46:13.760432+0000","last_active":"2024-08-17T02:46:13.772441+0000","last_peered":"2024-08-17T02:46:13.772441+0000","last_clean":"2024-08-17T02:46:13.772441+0000","last_became_active":"2024-08-17T02:46:13.757461+0000","last_became_peered":"2024-08-17T02:46:13.757461+0000","last_unstale":"2024-08-17T02:46:13.772441+0000","last_undegraded":"2024-08-17T02:46:13.772441+0000","last_fullsized":"2024-08-17T02:46:13.772441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.760005+0000","last_change":"2024-08-17T02:46:12.771440+0000","last_active":"2024-08-17T02:46:13.760005+0000","last_peered":"2024-08-17T02:46:13.760005+0000","last_clean":"2024-08-17T02:46:13.760005+0000","last_became_active":"2024-08-17T02:46:12.771171+0000","last_became_peered":"2024-08-17T02:46:12.771171+0000","last_unstale":"2024-08-17T02:46:13.760005+0000","last_undegraded":"2024-08-17T02:46:13.760005+0000","last_fullsized":"2024-08-17T02:46:13.760005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776159+0000","last_change":"2024-08-17T02:46:13.770867+0000","last_active":"2024-08-17T02:46:13.776159+0000","last_peered":"2024-08-17T02:46:13.776159+0000","last_clean":"2024-08-17T02:46:13.776159+0000","last_became_active":"2024-08-17T02:46:13.770367+0000","last_became_peered":"2024-08-17T02:46:13.770367+0000","last_unstale":"2024-08-17T02:46:13.776159+0000","last_undegraded":"2024-08-17T02:46:13.776159+0000","last_fullsized":"2024-08-17T02:46:13.776159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:59.549871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749408+0000","last_change":"2024-08-17T02:46:12.773955+0000","last_active":"2024-08-17T02:46:13.749408+0000","last_peered":"2024-08-17T02:46:13.749408+0000","last_clean":"2024-08-17T02:46:13.749408+0000","last_became_active":"2024-08-17T02:46:12.772243+0000","last_became_peered":"2024-08-17T02:46:12.772243+0000","last_unstale":"2024-08-17T02:46:13.749408+0000","last_undegraded":"2024-08-17T02:46:13.749408+0000","last_fullsized":"2024-08-17T02:46:13.749408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786276+0000","last_change":"2024-08-17T02:46:13.777529+0000","last_active":"2024-08-17T02:46:13.786276+0000","last_peered":"2024-08-17T02:46:13.786276+0000","last_clean":"2024-08-17T02:46:13.786276+0000","last_became_active":"2024-08-17T02:46:13.776596+0000","last_became_peered":"2024-08-17T02:46:13.776596+0000","last_unstale":"2024-08-17T02:46:13.786276+0000","last_undegraded":"2024-08-17T02:46:13.786276+0000","last_fullsized":"2024-08-17T02:46:13.786276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784145+0000","last_change":"2024-08-17T02:46:12.771541+0000","last_active":"2024-08-17T02:46:13.784145+0000","last_peered":"2024-08-17T02:46:13.784145+0000","last_clean":"2024-08-17T02:46:13.784145+0000","last_became_active":"2024-08-17T02:46:12.771307+0000","last_became_peered":"2024-08-17T02:46:12.771307+0000","last_unstale":"2024-08-17T02:46:13.784145+0000","last_undegraded":"2024-08-17T02:46:13.784145+0000","last_fullsized":"2024-08-17T02:46:13.784145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.771994+0000","last_change":"2024-08-17T02:46:13.765422+0000","last_active":"2024-08-17T02:46:13.771994+0000","last_peered":"2024-08-17T02:46:13.771994+0000","last_clean":"2024-08-17T02:46:13.771994+0000","last_became_active":"2024-08-17T02:46:13.764854+0000","last_became_peered":"2024-08-17T02:46:13.764854+0000","last_unstale":"2024-08-17T02:46:13.771994+0000","last_undegraded":"2024-08-17T02:46:13.771994+0000","last_fullsized":"2024-08-17T02:46:13.771994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:20.767461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.790295+0000","last_change":"2024-08-17T02:46:12.763643+0000","last_active":"2024-08-17T02:46:13.790295+0000","last_peered":"2024-08-17T02:46:13.790295+0000","last_clean":"2024-08-17T02:46:13.790295+0000","last_became_active":"2024-08-17T02:46:12.763196+0000","last_became_peered":"2024-08-17T02:46:12.763196+0000","last_unstale":"2024-08-17T02:46:13.790295+0000","last_undegraded":"2024-08-17T02:46:13.790295+0000","last_fullsized":"2024-08-17T02:46:13.790295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781185+0000","last_change":"2024-08-17T02:46:13.768744+0000","last_active":"2024-08-17T02:46:13.781185+0000","last_peered":"2024-08-17T02:46:13.781185+0000","last_clean":"2024-08-17T02:46:13.781185+0000","last_became_active":"2024-08-17T02:46:13.768433+0000","last_became_peered":"2024-08-17T02:46:13.768433+0000","last_unstale":"2024-08-17T02:46:13.781185+0000","last_undegraded":"2024-08-17T02:46:13.781185+0000","last_fullsized":"2024-08-17T02:46:13.781185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:30.671696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788049+0000","last_change":"2024-08-17T02:46:12.764570+0000","last_active":"2024-08-17T02:46:13.788049+0000","last_peered":"2024-08-17T02:46:13.788049+0000","last_clean":"2024-08-17T02:46:13.788049+0000","last_became_active":"2024-08-17T02:46:12.763764+0000","last_became_peered":"2024-08-17T02:46:12.763764+0000","last_unstale":"2024-08-17T02:46:13.788049+0000","last_undegraded":"2024-08-17T02:46:13.788049+0000","last_fullsized":"2024-08-17T02:46:13.788049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:32.171597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.778773+0000","last_change":"2024-08-17T02:46:13.764855+0000","last_active":"2024-08-17T02:46:13.778773+0000","last_peered":"2024-08-17T02:46:13.778773+0000","last_clean":"2024-08-17T02:46:13.778773+0000","last_became_active":"2024-08-17T02:46:13.764494+0000","last_became_peered":"2024-08-17T02:46:13.764494+0000","last_unstale":"2024-08-17T02:46:13.778773+0000","last_undegraded":"2024-08-17T02:46:13.778773+0000","last_fullsized":"2024-08-17T02:46:13.778773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:26.668711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749487+0000","last_change":"2024-08-17T02:46:12.763292+0000","last_active":"2024-08-17T02:46:13.749487+0000","last_peered":"2024-08-17T02:46:13.749487+0000","last_clean":"2024-08-17T02:46:13.749487+0000","last_became_active":"2024-08-17T02:46:12.762486+0000","last_became_peered":"2024-08-17T02:46:12.762486+0000","last_unstale":"2024-08-17T02:46:13.749487+0000","last_undegraded":"2024-08-17T02:46:13.749487+0000","last_fullsized":"2024-08-17T02:46:13.749487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788571+0000","last_change":"2024-08-17T02:46:13.787493+0000","last_active":"2024-08-17T02:46:13.788571+0000","last_peered":"2024-08-17T02:46:13.788571+0000","last_clean":"2024-08-17T02:46:13.788571+0000","last_became_active":"2024-08-17T02:46:13.778178+0000","last_became_peered":"2024-08-17T02:46:13.778178+0000","last_unstale":"2024-08-17T02:46:13.788571+0000","last_undegraded":"2024-08-17T02:46:13.788571+0000","last_fullsized":"2024-08-17T02:46:13.788571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:59.549871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.759786+0000","last_change":"2024-08-17T02:46:12.760312+0000","last_active":"2024-08-17T02:46:13.759786+0000","last_peered":"2024-08-17T02:46:13.759786+0000","last_clean":"2024-08-17T02:46:13.759786+0000","last_became_active":"2024-08-17T02:46:12.760019+0000","last_became_peered":"2024-08-17T02:46:12.760019+0000","last_unstale":"2024-08-17T02:46:13.759786+0000","last_undegraded":"2024-08-17T02:46:13.759786+0000","last_fullsized":"2024-08-17T02:46:13.759786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777485+0000","last_change":"2024-08-17T02:46:13.775855+0000","last_active":"2024-08-17T02:46:13.777485+0000","last_peered":"2024-08-17T02:46:13.777485+0000","last_clean":"2024-08-17T02:46:13.777485+0000","last_became_active":"2024-08-17T02:46:13.775232+0000","last_became_peered":"2024-08-17T02:46:13.775232+0000","last_unstale":"2024-08-17T02:46:13.777485+0000","last_undegraded":"2024-08-17T02:46:13.777485+0000","last_fullsized":"2024-08-17T02:46:13.777485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788359+0000","last_change":"2024-08-17T02:46:12.761768+0000","last_active":"2024-08-17T02:46:13.788359+0000","last_peered":"2024-08-17T02:46:13.788359+0000","last_clean":"2024-08-17T02:46:13.788359+0000","last_became_active":"2024-08-17T02:46:12.761478+0000","last_became_peered":"2024-08-17T02:46:12.761478+0000","last_unstale":"2024-08-17T02:46:13.788359+0000","last_undegraded":"2024-08-17T02:46:13.788359+0000","last_fullsized":"2024-08-17T02:46:13.788359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784569+0000","last_change":"2024-08-17T02:46:13.780280+0000","last_active":"2024-08-17T02:46:13.784569+0000","last_peered":"2024-08-17T02:46:13.784569+0000","last_clean":"2024-08-17T02:46:13.784569+0000","last_became_active":"2024-08-17T02:46:13.779454+0000","last_became_peered":"2024-08-17T02:46:13.779454+0000","last_unstale":"2024-08-17T02:46:13.784569+0000","last_undegraded":"2024-08-17T02:46:13.784569+0000","last_fullsized":"2024-08-17T02:46:13.784569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788136+0000","last_change":"2024-08-17T02:46:12.769206+0000","last_active":"2024-08-17T02:46:13.788136+0000","last_peered":"2024-08-17T02:46:13.788136+0000","last_clean":"2024-08-17T02:46:13.788136+0000","last_became_active":"2024-08-17T02:46:12.768891+0000","last_became_peered":"2024-08-17T02:46:12.768891+0000","last_unstale":"2024-08-17T02:46:13.788136+0000","last_undegraded":"2024-08-17T02:46:13.788136+0000","last_fullsized":"2024-08-17T02:46:13.788136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:59:55.270622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774129+0000","last_change":"2024-08-17T02:46:13.769837+0000","last_active":"2024-08-17T02:46:13.774129+0000","last_peered":"2024-08-17T02:46:13.774129+0000","last_clean":"2024-08-17T02:46:13.774129+0000","last_became_active":"2024-08-17T02:46:13.769478+0000","last_became_peered":"2024-08-17T02:46:13.769478+0000","last_unstale":"2024-08-17T02:46:13.774129+0000","last_undegraded":"2024-08-17T02:46:13.774129+0000","last_fullsized":"2024-08-17T02:46:13.774129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:47.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783670+0000","last_change":"2024-08-17T02:46:12.755672+0000","last_active":"2024-08-17T02:46:13.783670+0000","last_peered":"2024-08-17T02:46:13.783670+0000","last_clean":"2024-08-17T02:46:13.783670+0000","last_became_active":"2024-08-17T02:46:12.754437+0000","last_became_peered":"2024-08-17T02:46:12.754437+0000","last_unstale":"2024-08-17T02:46:13.783670+0000","last_undegraded":"2024-08-17T02:46:13.783670+0000","last_fullsized":"2024-08-17T02:46:13.783670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783726+0000","last_change":"2024-08-17T02:46:13.782246+0000","last_active":"2024-08-17T02:46:13.783726+0000","last_peered":"2024-08-17T02:46:13.783726+0000","last_clean":"2024-08-17T02:46:13.783726+0000","last_became_active":"2024-08-17T02:46:13.781368+0000","last_became_peered":"2024-08-17T02:46:13.781368+0000","last_unstale":"2024-08-17T02:46:13.783726+0000","last_undegraded":"2024-08-17T02:46:13.783726+0000","last_fullsized":"2024-08-17T02:46:13.783726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786712+0000","last_change":"2024-08-17T02:46:12.761505+0000","last_active":"2024-08-17T02:46:13.786712+0000","last_peered":"2024-08-17T02:46:13.786712+0000","last_clean":"2024-08-17T02:46:13.786712+0000","last_became_active":"2024-08-17T02:46:12.760373+0000","last_became_peered":"2024-08-17T02:46:12.760373+0000","last_unstale":"2024-08-17T02:46:13.786712+0000","last_undegraded":"2024-08-17T02:46:13.786712+0000","last_fullsized":"2024-08-17T02:46:13.786712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:16.510354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763000+0000","last_change":"2024-08-17T02:46:13.758103+0000","last_active":"2024-08-17T02:46:13.763000+0000","last_peered":"2024-08-17T02:46:13.763000+0000","last_clean":"2024-08-17T02:46:13.763000+0000","last_became_active":"2024-08-17T02:46:13.757785+0000","last_became_peered":"2024-08-17T02:46:13.757785+0000","last_unstale":"2024-08-17T02:46:13.763000+0000","last_undegraded":"2024-08-17T02:46:13.763000+0000","last_fullsized":"2024-08-17T02:46:13.763000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:47.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.751133+0000","last_change":"2024-08-17T02:46:12.773394+0000","last_active":"2024-08-17T02:46:13.751133+0000","last_peered":"2024-08-17T02:46:13.751133+0000","last_clean":"2024-08-17T02:46:13.751133+0000","last_became_active":"2024-08-17T02:46:12.773045+0000","last_became_peered":"2024-08-17T02:46:12.773045+0000","last_unstale":"2024-08-17T02:46:13.751133+0000","last_undegraded":"2024-08-17T02:46:13.751133+0000","last_fullsized":"2024-08-17T02:46:13.751133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783423+0000","last_change":"2024-08-17T02:46:13.782165+0000","last_active":"2024-08-17T02:46:13.783423+0000","last_peered":"2024-08-17T02:46:13.783423+0000","last_clean":"2024-08-17T02:46:13.783423+0000","last_became_active":"2024-08-17T02:46:13.781292+0000","last_became_peered":"2024-08-17T02:46:13.781292+0000","last_unstale":"2024-08-17T02:46:13.783423+0000","last_undegraded":"2024-08-17T02:46:13.783423+0000","last_fullsized":"2024-08-17T02:46:13.783423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:14.050922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756445+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:46:13.756445+0000","last_peered":"2024-08-17T02:46:13.756445+0000","last_clean":"2024-08-17T02:46:13.756445+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:46:13.756445+0000","last_undegraded":"2024-08-17T02:46:13.756445+0000","last_fullsized":"2024-08-17T02:46:13.756445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.747542+0000","last_change":"2024-08-17T02:46:12.761371+0000","last_active":"2024-08-17T02:46:13.747542+0000","last_peered":"2024-08-17T02:46:13.747542+0000","last_clean":"2024-08-17T02:46:13.747542+0000","last_became_active":"2024-08-17T02:46:12.761066+0000","last_became_peered":"2024-08-17T02:46:12.761066+0000","last_unstale":"2024-08-17T02:46:13.747542+0000","last_undegraded":"2024-08-17T02:46:13.747542+0000","last_fullsized":"2024-08-17T02:46:13.747542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.778045+0000","last_change":"2024-08-17T02:46:13.773410+0000","last_active":"2024-08-17T02:46:13.778045+0000","last_peered":"2024-08-17T02:46:13.778045+0000","last_clean":"2024-08-17T02:46:13.778045+0000","last_became_active":"2024-08-17T02:46:13.771934+0000","last_became_peered":"2024-08-17T02:46:13.771934+0000","last_unstale":"2024-08-17T02:46:13.778045+0000","last_undegraded":"2024-08-17T02:46:13.778045+0000","last_fullsized":"2024-08-17T02:46:13.778045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:29.582747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756352+0000","last_change":"2024-08-17T02:46:12.766920+0000","last_active":"2024-08-17T02:46:13.756352+0000","last_peered":"2024-08-17T02:46:13.756352+0000","last_clean":"2024-08-17T02:46:13.756352+0000","last_became_active":"2024-08-17T02:46:12.766386+0000","last_became_peered":"2024-08-17T02:46:12.766386+0000","last_unstale":"2024-08-17T02:46:13.756352+0000","last_undegraded":"2024-08-17T02:46:13.756352+0000","last_fullsized":"2024-08-17T02:46:13.756352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783602+0000","last_change":"2024-08-17T02:46:13.765726+0000","last_active":"2024-08-17T02:46:13.783602+0000","last_peered":"2024-08-17T02:46:13.783602+0000","last_clean":"2024-08-17T02:46:13.783602+0000","last_became_active":"2024-08-17T02:46:13.765377+0000","last_became_peered":"2024-08-17T02:46:13.765377+0000","last_unstale":"2024-08-17T02:46:13.783602+0000","last_undegraded":"2024-08-17T02:46:13.783602+0000","last_fullsized":"2024-08-17T02:46:13.783602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.750833+0000","last_change":"2024-08-17T02:46:12.754881+0000","last_active":"2024-08-17T02:46:13.750833+0000","last_peered":"2024-08-17T02:46:13.750833+0000","last_clean":"2024-08-17T02:46:13.750833+0000","last_became_active":"2024-08-17T02:46:12.753763+0000","last_became_peered":"2024-08-17T02:46:12.753763+0000","last_unstale":"2024-08-17T02:46:13.750833+0000","last_undegraded":"2024-08-17T02:46:13.750833+0000","last_fullsized":"2024-08-17T02:46:13.750833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772407+0000","last_change":"2024-08-17T02:46:13.759314+0000","last_active":"2024-08-17T02:46:13.772407+0000","last_peered":"2024-08-17T02:46:13.772407+0000","last_clean":"2024-08-17T02:46:13.772407+0000","last_became_active":"2024-08-17T02:46:13.759005+0000","last_became_peered":"2024-08-17T02:46:13.759005+0000","last_unstale":"2024-08-17T02:46:13.772407+0000","last_undegraded":"2024-08-17T02:46:13.772407+0000","last_fullsized":"2024-08-17T02:46:13.772407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749580+0000","last_change":"2024-08-17T02:46:12.764920+0000","last_active":"2024-08-17T02:46:13.749580+0000","last_peered":"2024-08-17T02:46:13.749580+0000","last_clean":"2024-08-17T02:46:13.749580+0000","last_became_active":"2024-08-17T02:46:12.764463+0000","last_became_peered":"2024-08-17T02:46:12.764463+0000","last_unstale":"2024-08-17T02:46:13.749580+0000","last_undegraded":"2024-08-17T02:46:13.749580+0000","last_fullsized":"2024-08-17T02:46:13.749580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.773750+0000","last_change":"2024-08-17T02:46:13.768129+0000","last_active":"2024-08-17T02:46:13.773750+0000","last_peered":"2024-08-17T02:46:13.773750+0000","last_clean":"2024-08-17T02:46:13.773750+0000","last_became_active":"2024-08-17T02:46:13.767922+0000","last_became_peered":"2024-08-17T02:46:13.767922+0000","last_unstale":"2024-08-17T02:46:13.773750+0000","last_undegraded":"2024-08-17T02:46:13.773750+0000","last_fullsized":"2024-08-17T02:46:13.773750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:28.991722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.752673+0000","last_change":"2024-08-17T02:46:12.768892+0000","last_active":"2024-08-17T02:46:13.752673+0000","last_peered":"2024-08-17T02:46:13.752673+0000","last_clean":"2024-08-17T02:46:13.752673+0000","last_became_active":"2024-08-17T02:46:12.768653+0000","last_became_peered":"2024-08-17T02:46:12.768653+0000","last_unstale":"2024-08-17T02:46:13.752673+0000","last_undegraded":"2024-08-17T02:46:13.752673+0000","last_fullsized":"2024-08-17T02:46:13.752673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776587+0000","last_change":"2024-08-17T02:46:13.768046+0000","last_active":"2024-08-17T02:46:13.776587+0000","last_peered":"2024-08-17T02:46:13.776587+0000","last_clean":"2024-08-17T02:46:13.776587+0000","last_became_active":"2024-08-17T02:46:13.767445+0000","last_became_peered":"2024-08-17T02:46:13.767445+0000","last_unstale":"2024-08-17T02:46:13.776587+0000","last_undegraded":"2024-08-17T02:46:13.776587+0000","last_fullsized":"2024-08-17T02:46:13.776587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.759052+0000","last_change":"2024-08-17T02:46:12.770898+0000","last_active":"2024-08-17T02:46:13.759052+0000","last_peered":"2024-08-17T02:46:13.759052+0000","last_clean":"2024-08-17T02:46:13.759052+0000","last_became_active":"2024-08-17T02:46:12.770596+0000","last_became_peered":"2024-08-17T02:46:12.770596+0000","last_unstale":"2024-08-17T02:46:13.759052+0000","last_undegraded":"2024-08-17T02:46:13.759052+0000","last_fullsized":"2024-08-17T02:46:13.759052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:27.985897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775335+0000","last_change":"2024-08-17T02:46:13.764756+0000","last_active":"2024-08-17T02:46:13.775335+0000","last_peered":"2024-08-17T02:46:13.775335+0000","last_clean":"2024-08-17T02:46:13.775335+0000","last_became_active":"2024-08-17T02:46:13.764423+0000","last_became_peered":"2024-08-17T02:46:13.764423+0000","last_unstale":"2024-08-17T02:46:13.775335+0000","last_undegraded":"2024-08-17T02:46:13.775335+0000","last_fullsized":"2024-08-17T02:46:13.775335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.757710+0000","last_change":"2024-08-17T02:46:12.770698+0000","last_active":"2024-08-17T02:46:13.757710+0000","last_peered":"2024-08-17T02:46:13.757710+0000","last_clean":"2024-08-17T02:46:13.757710+0000","last_became_active":"2024-08-17T02:46:12.770432+0000","last_became_peered":"2024-08-17T02:46:12.770432+0000","last_unstale":"2024-08-17T02:46:13.757710+0000","last_undegraded":"2024-08-17T02:46:13.757710+0000","last_fullsized":"2024-08-17T02:46:13.757710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787077+0000","last_change":"2024-08-17T02:46:13.785768+0000","last_active":"2024-08-17T02:46:13.787077+0000","last_peered":"2024-08-17T02:46:13.787077+0000","last_clean":"2024-08-17T02:46:13.787077+0000","last_became_active":"2024-08-17T02:46:13.784611+0000","last_became_peered":"2024-08-17T02:46:13.784611+0000","last_unstale":"2024-08-17T02:46:13.787077+0000","last_undegraded":"2024-08-17T02:46:13.787077+0000","last_fullsized":"2024-08-17T02:46:13.787077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786933+0000","last_change":"2024-08-17T02:46:12.766695+0000","last_active":"2024-08-17T02:46:13.786933+0000","last_peered":"2024-08-17T02:46:13.786933+0000","last_clean":"2024-08-17T02:46:13.786933+0000","last_became_active":"2024-08-17T02:46:12.766389+0000","last_became_peered":"2024-08-17T02:46:12.766389+0000","last_unstale":"2024-08-17T02:46:13.786933+0000","last_undegraded":"2024-08-17T02:46:13.786933+0000","last_fullsized":"2024-08-17T02:46:13.786933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.785500+0000","last_change":"2024-08-17T02:46:13.775750+0000","last_active":"2024-08-17T02:46:13.785500+0000","last_peered":"2024-08-17T02:46:13.785500+0000","last_clean":"2024-08-17T02:46:13.785500+0000","last_became_active":"2024-08-17T02:46:13.775487+0000","last_became_peered":"2024-08-17T02:46:13.775487+0000","last_unstale":"2024-08-17T02:46:13.785500+0000","last_undegraded":"2024-08-17T02:46:13.785500+0000","last_fullsized":"2024-08-17T02:46:13.785500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756242+0000","last_change":"2024-08-17T02:46:12.769354+0000","last_active":"2024-08-17T02:46:13.756242+0000","last_peered":"2024-08-17T02:46:13.756242+0000","last_clean":"2024-08-17T02:46:13.756242+0000","last_became_active":"2024-08-17T02:46:12.769061+0000","last_became_peered":"2024-08-17T02:46:12.769061+0000","last_unstale":"2024-08-17T02:46:13.756242+0000","last_undegraded":"2024-08-17T02:46:13.756242+0000","last_fullsized":"2024-08-17T02:46:13.756242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:16.510354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.760836+0000","last_change":"2024-08-17T02:46:13.758278+0000","last_active":"2024-08-17T02:46:13.760836+0000","last_peered":"2024-08-17T02:46:13.760836+0000","last_clean":"2024-08-17T02:46:13.760836+0000","last_became_active":"2024-08-17T02:46:13.758028+0000","last_became_peered":"2024-08-17T02:46:13.758028+0000","last_unstale":"2024-08-17T02:46:13.760836+0000","last_undegraded":"2024-08-17T02:46:13.760836+0000","last_fullsized":"2024-08-17T02:46:13.760836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:26.668711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.751025+0000","last_change":"2024-08-17T02:46:12.766160+0000","last_active":"2024-08-17T02:46:13.751025+0000","last_peered":"2024-08-17T02:46:13.751025+0000","last_clean":"2024-08-17T02:46:13.751025+0000","last_became_active":"2024-08-17T02:46:12.765813+0000","last_became_peered":"2024-08-17T02:46:12.765813+0000","last_unstale":"2024-08-17T02:46:13.751025+0000","last_undegraded":"2024-08-17T02:46:13.751025+0000","last_fullsized":"2024-08-17T02:46:13.751025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:19.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.767346+0000","last_change":"2024-08-17T02:46:13.765879+0000","last_active":"2024-08-17T02:46:13.767346+0000","last_peered":"2024-08-17T02:46:13.767346+0000","last_clean":"2024-08-17T02:46:13.767346+0000","last_became_active":"2024-08-17T02:46:13.765623+0000","last_became_peered":"2024-08-17T02:46:13.765623+0000","last_unstale":"2024-08-17T02:46:13.767346+0000","last_undegraded":"2024-08-17T02:46:13.767346+0000","last_fullsized":"2024-08-17T02:46:13.767346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756732+0000","last_change":"2024-08-17T02:46:12.761258+0000","last_active":"2024-08-17T02:46:13.756732+0000","last_peered":"2024-08-17T02:46:13.756732+0000","last_clean":"2024-08-17T02:46:13.756732+0000","last_became_active":"2024-08-17T02:46:12.760997+0000","last_became_peered":"2024-08-17T02:46:12.760997+0000","last_unstale":"2024-08-17T02:46:13.756732+0000","last_undegraded":"2024-08-17T02:46:13.756732+0000","last_fullsized":"2024-08-17T02:46:13.756732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786999+0000","last_change":"2024-08-17T02:46:13.780356+0000","last_active":"2024-08-17T02:46:13.786999+0000","last_peered":"2024-08-17T02:46:13.786999+0000","last_clean":"2024-08-17T02:46:13.786999+0000","last_became_active":"2024-08-17T02:46:13.779734+0000","last_became_peered":"2024-08-17T02:46:13.779734+0000","last_unstale":"2024-08-17T02:46:13.786999+0000","last_undegraded":"2024-08-17T02:46:13.786999+0000","last_fullsized":"2024-08-17T02:46:13.786999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787809+0000","last_change":"2024-08-17T02:46:12.765599+0000","last_active":"2024-08-17T02:46:13.787809+0000","last_peered":"2024-08-17T02:46:13.787809+0000","last_clean":"2024-08-17T02:46:13.787809+0000","last_became_active":"2024-08-17T02:46:12.765154+0000","last_became_peered":"2024-08-17T02:46:12.765154+0000","last_unstale":"2024-08-17T02:46:13.787809+0000","last_undegraded":"2024-08-17T02:46:13.787809+0000","last_fullsized":"2024-08-17T02:46:13.787809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772892+0000","last_change":"2024-08-17T02:46:13.765726+0000","last_active":"2024-08-17T02:46:13.772892+0000","last_peered":"2024-08-17T02:46:13.772892+0000","last_clean":"2024-08-17T02:46:13.772892+0000","last_became_active":"2024-08-17T02:46:13.765458+0000","last_became_peered":"2024-08-17T02:46:13.765458+0000","last_unstale":"2024-08-17T02:46:13.772892+0000","last_undegraded":"2024-08-17T02:46:13.772892+0000","last_fullsized":"2024-08-17T02:46:13.772892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763706+0000","last_change":"2024-08-17T02:46:13.762591+0000","last_active":"2024-08-17T02:46:13.763706+0000","last_peered":"2024-08-17T02:46:13.763706+0000","last_clean":"2024-08-17T02:46:13.763706+0000","last_became_active":"2024-08-17T02:46:13.762278+0000","last_became_peered":"2024-08-17T02:46:13.762278+0000","last_unstale":"2024-08-17T02:46:13.763706+0000","last_undegraded":"2024-08-17T02:46:13.763706+0000","last_fullsized":"2024-08-17T02:46:13.763706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788027+0000","last_change":"2024-08-17T02:46:12.775104+0000","last_active":"2024-08-17T02:46:13.788027+0000","last_peered":"2024-08-17T02:46:13.788027+0000","last_clean":"2024-08-17T02:46:13.788027+0000","last_became_active":"2024-08-17T02:46:12.774744+0000","last_became_peered":"2024-08-17T02:46:12.774744+0000","last_unstale":"2024-08-17T02:46:13.788027+0000","last_undegraded":"2024-08-17T02:46:13.788027+0000","last_fullsized":"2024-08-17T02:46:13.788027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:19.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764417+0000","last_change":"2024-08-17T02:46:13.763165+0000","last_active":"2024-08-17T02:46:13.764417+0000","last_peered":"2024-08-17T02:46:13.764417+0000","last_clean":"2024-08-17T02:46:13.764417+0000","last_became_active":"2024-08-17T02:46:13.762821+0000","last_became_peered":"2024-08-17T02:46:13.762821+0000","last_unstale":"2024-08-17T02:46:13.764417+0000","last_undegraded":"2024-08-17T02:46:13.764417+0000","last_fullsized":"2024-08-17T02:46:13.764417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:30.671696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784385+0000","last_change":"2024-08-17T02:46:12.768599+0000","last_active":"2024-08-17T02:46:13.784385+0000","last_peered":"2024-08-17T02:46:13.784385+0000","last_clean":"2024-08-17T02:46:13.784385+0000","last_became_active":"2024-08-17T02:46:12.768318+0000","last_became_peered":"2024-08-17T02:46:12.768318+0000","last_unstale":"2024-08-17T02:46:13.784385+0000","last_undegraded":"2024-08-17T02:46:13.784385+0000","last_fullsized":"2024-08-17T02:46:13.784385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:42.088973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777974+0000","last_change":"2024-08-17T02:46:13.772324+0000","last_active":"2024-08-17T02:46:13.777974+0000","last_peered":"2024-08-17T02:46:13.777974+0000","last_clean":"2024-08-17T02:46:13.777974+0000","last_became_active":"2024-08-17T02:46:13.771998+0000","last_became_peered":"2024-08-17T02:46:13.771998+0000","last_unstale":"2024-08-17T02:46:13.777974+0000","last_undegraded":"2024-08-17T02:46:13.777974+0000","last_fullsized":"2024-08-17T02:46:13.777974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787723+0000","last_change":"2024-08-17T02:46:12.762044+0000","last_active":"2024-08-17T02:46:13.787723+0000","last_peered":"2024-08-17T02:46:13.787723+0000","last_clean":"2024-08-17T02:46:13.787723+0000","last_became_active":"2024-08-17T02:46:12.761769+0000","last_became_peered":"2024-08-17T02:46:12.761769+0000","last_unstale":"2024-08-17T02:46:13.787723+0000","last_undegraded":"2024-08-17T02:46:13.787723+0000","last_fullsized":"2024-08-17T02:46:13.787723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:29.351136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764812+0000","last_change":"2024-08-17T02:46:13.762933+0000","last_active":"2024-08-17T02:46:13.764812+0000","last_peered":"2024-08-17T02:46:13.764812+0000","last_clean":"2024-08-17T02:46:13.764812+0000","last_became_active":"2024-08-17T02:46:13.762614+0000","last_became_peered":"2024-08-17T02:46:13.762614+0000","last_unstale":"2024-08-17T02:46:13.764812+0000","last_undegraded":"2024-08-17T02:46:13.764812+0000","last_fullsized":"2024-08-17T02:46:13.764812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786378+0000","last_change":"2024-08-17T02:46:12.767446+0000","last_active":"2024-08-17T02:46:13.786378+0000","last_peered":"2024-08-17T02:46:13.786378+0000","last_clean":"2024-08-17T02:46:13.786378+0000","last_became_active":"2024-08-17T02:46:12.767136+0000","last_became_peered":"2024-08-17T02:46:12.767136+0000","last_unstale":"2024-08-17T02:46:13.786378+0000","last_undegraded":"2024-08-17T02:46:13.786378+0000","last_fullsized":"2024-08-17T02:46:13.786378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:29.351136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":69025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:17.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.130+0000 7f9baca00640 1 Processor -- start 2024-08-17T02:46:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.130+0000 7f9baca00640 1 -- start start 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9baca00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80ad960 0x7f9ba815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9baca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9ba80ca050 0x7f9ba8156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9baca00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba815b5e0 con 0x7f9ba80add30 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9baca00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba80cb160 con 0x7f9ba80ca050 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9baca00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80b0d10 con 0x7f9ba80ad960 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9b9fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9ba80ca050 0x7f9ba8156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9b9fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9ba80ca050 0x7f9ba8156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44152/0 (socket says 172.21.15.2:44152) 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9b9fe00640 1 -- 172.21.15.2:0/3400929731 learned_addr learned my addr 172.21.15.2:0/3400929731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:18.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9ba5e00640 1 --2- 172.21.15.2:0/3400929731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80ad960 0x7f9ba815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9b9fe00640 1 -- 172.21.15.2:0/3400929731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80ad960 msgr2=0x7f9ba815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9b9fe00640 1 --2- 172.21.15.2:0/3400929731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80ad960 0x7f9ba815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9b9fe00640 1 -- 172.21.15.2:0/3400929731 >> v1:172.21.15.26:6789/0 conn(0x7f9ba80add30 legacy=0x7f9ba8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.132+0000 7f9b9fe00640 1 -- 172.21.15.2:0/3400929731 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80ca550 con 0x7f9ba80ca050 2024-08-17T02:46:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.133+0000 7f9b9fe00640 1 --2- 172.21.15.2:0/3400929731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba8156420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009910 tx=0x7f9b900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79885e5469b246d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9ba5400640 1 -- 172.21.15.2:0/3400929731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9002ae40 con 0x7f9ba80ca050 2024-08-17T02:46:18.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9ba5400640 1 -- 172.21.15.2:0/3400929731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b90032440 con 0x7f9ba80ca050 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9ba5400640 1 -- 172.21.15.2:0/3400929731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90032820 con 0x7f9ba80ca050 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9baca00640 1 -- 172.21.15.2:0/3400929731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 msgr2=0x7f9ba8156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9baca00640 1 --2- 172.21.15.2:0/3400929731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba8156420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009910 tx=0x7f9b900091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9baca00640 1 -- 172.21.15.2:0/3400929731 shutdown_connections 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9baca00640 1 --2- 172.21.15.2:0/3400929731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba8156420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9baca00640 1 --2- 172.21.15.2:0/3400929731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80ad960 0x7f9ba815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9baca00640 1 -- 172.21.15.2:0/3400929731 >> 172.21.15.2:0/3400929731 conn(0x7f9ba8066e60 msgr2=0x7f9ba8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9baca00640 1 -- 172.21.15.2:0/3400929731 shutdown_connections 2024-08-17T02:46:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.134+0000 7f9baca00640 1 -- 172.21.15.2:0/3400929731 wait complete. 2024-08-17T02:46:18.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.136+0000 7f9baca00640 1 Processor -- start 2024-08-17T02:46:18.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.136+0000 7f9baca00640 1 -- start start 2024-08-17T02:46:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9baca00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba80ad960 0x7f9ba81698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9baca00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80add30 0x7f9ba815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9baca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba81527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9baca00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8169e20 con 0x7f9ba80ca050 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9baca00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80a9e70 con 0x7f9ba80ad960 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9baca00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80a8de0 con 0x7f9ba80add30 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba81527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba81527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44160/0 (socket says 172.21.15.2:44160) 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba6800640 1 -- 172.21.15.2:0/2622460613 learned_addr learned my addr 172.21.15.2:0/2622460613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba5e00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba80ad960 0x7f9ba81698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba6800640 1 -- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80add30 msgr2=0x7f9ba815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9b9fe00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80add30 0x7f9ba815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba6800640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80add30 0x7f9ba815d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba6800640 1 -- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba80ad960 msgr2=0x7f9ba81698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba6800640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba80ad960 0x7f9ba81698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba6800640 1 -- 172.21.15.2:0/2622460613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90009450 con 0x7f9ba80ca050 2024-08-17T02:46:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9ba5e00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba80ad960 0x7f9ba81698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.137+0000 7f9b9fe00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80add30 0x7f9ba815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.138+0000 7f9ba6800640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba81527f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c8c0 tx=0x7f9ba0002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.138+0000 7f9b9d600640 1 -- 172.21.15.2:0/2622460613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000a7f0 con 0x7f9ba80ca050 2024-08-17T02:46:18.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.138+0000 7f9b9d600640 1 -- 172.21.15.2:0/2622460613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba000a970 con 0x7f9ba80ca050 2024-08-17T02:46:18.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.138+0000 7f9b9d600640 1 -- 172.21.15.2:0/2622460613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000ad30 con 0x7f9ba80ca050 2024-08-17T02:46:18.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.138+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba80a90c0 con 0x7f9ba80ca050 2024-08-17T02:46:18.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.138+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba80a9680 con 0x7f9ba80ca050 2024-08-17T02:46:18.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.139+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba80aa020 con 0x7f9ba80ca050 2024-08-17T02:46:18.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.140+0000 7f9b9d600640 1 -- 172.21.15.2:0/2622460613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ba0012630 con 0x7f9ba80ca050 2024-08-17T02:46:18.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.141+0000 7f9b9d600640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9b84065150 0x7f9b84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.141+0000 7f9b9d600640 1 -- 172.21.15.2:0/2622460613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ba00828c0 con 0x7f9ba80ca050 2024-08-17T02:46:18.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.141+0000 7f9ba5e00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9b84065150 0x7f9b84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.141+0000 7f9ba5e00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9b84065150 0x7f9b84067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b980099b0 tx=0x7f9b98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.144+0000 7f9b9d600640 1 -- 172.21.15.2:0/2622460613 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9ba80aa020 con 0x7f9ba80ca050 2024-08-17T02:46:18.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.322+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ba80aa020 con 0x7f9b84065150 2024-08-17T02:46:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.329+0000 7f9b9d600640 1 -- 172.21.15.2:0/2622460613 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264660 (secure 0 0 0) 0x7f9ba80aa020 con 0x7f9b84065150 2024-08-17T02:46:18.333 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:46:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9b84065150 msgr2=0x7f9b84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9b84065150 0x7f9b84067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b980099b0 tx=0x7f9b98008040 comp rx=0 tx=0).stop 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 msgr2=0x7f9ba81527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba81527f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c8c0 tx=0x7f9ba0002640 comp rx=0 tx=0).stop 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 shutdown_connections 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba80ca050 0x7f9ba81527f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9b84065150 0x7f9b84067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9ba80add30 0x7f9ba815d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 --2- 172.21.15.2:0/2622460613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ba80ad960 0x7f9ba81698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 >> 172.21.15.2:0/2622460613 conn(0x7f9ba8066e60 msgr2=0x7f9ba81551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 shutdown_connections 2024-08-17T02:46:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.333+0000 7f9baca00640 1 -- 172.21.15.2:0/2622460613 wait complete. 2024-08-17T02:46:18.349 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:46:17.015058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415056,"kb_used_data":2908,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752559664,"statfs":{"total":773094113280,"available":770621095936,"internally_reserved":0,"allocated":2977792,"data_stored":1781628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.282753"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783449+0000","last_change":"2024-08-17T02:46:13.782069+0000","last_active":"2024-08-17T02:46:13.783449+0000","last_peered":"2024-08-17T02:46:13.783449+0000","last_clean":"2024-08-17T02:46:13.783449+0000","last_became_active":"2024-08-17T02:46:13.780634+0000","last_became_peered":"2024-08-17T02:46:13.780634+0000","last_unstale":"2024-08-17T02:46:13.783449+0000","last_undegraded":"2024-08-17T02:46:13.783449+0000","last_fullsized":"2024-08-17T02:46:13.783449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:48.296428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788581+0000","last_change":"2024-08-17T02:46:13.787373+0000","last_active":"2024-08-17T02:46:13.788581+0000","last_peered":"2024-08-17T02:46:13.788581+0000","last_clean":"2024-08-17T02:46:13.788581+0000","last_became_active":"2024-08-17T02:46:13.785874+0000","last_became_peered":"2024-08-17T02:46:13.785874+0000","last_unstale":"2024-08-17T02:46:13.788581+0000","last_undegraded":"2024-08-17T02:46:13.788581+0000","last_fullsized":"2024-08-17T02:46:13.788581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.771809+0000","last_change":"2024-08-17T02:46:13.756970+0000","last_active":"2024-08-17T02:46:13.771809+0000","last_peered":"2024-08-17T02:46:13.771809+0000","last_clean":"2024-08-17T02:46:13.771809+0000","last_became_active":"2024-08-17T02:46:13.756661+0000","last_became_peered":"2024-08-17T02:46:13.756661+0000","last_unstale":"2024-08-17T02:46:13.771809+0000","last_undegraded":"2024-08-17T02:46:13.771809+0000","last_fullsized":"2024-08-17T02:46:13.771809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763017+0000","last_change":"2024-08-17T02:46:13.760375+0000","last_active":"2024-08-17T02:46:13.763017+0000","last_peered":"2024-08-17T02:46:13.763017+0000","last_clean":"2024-08-17T02:46:13.763017+0000","last_became_active":"2024-08-17T02:46:13.759323+0000","last_became_peered":"2024-08-17T02:46:13.759323+0000","last_unstale":"2024-08-17T02:46:13.763017+0000","last_undegraded":"2024-08-17T02:46:13.763017+0000","last_fullsized":"2024-08-17T02:46:13.763017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:53.437116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787628+0000","last_change":"2024-08-17T02:46:13.778338+0000","last_active":"2024-08-17T02:46:13.787628+0000","last_peered":"2024-08-17T02:46:13.787628+0000","last_clean":"2024-08-17T02:46:13.787628+0000","last_became_active":"2024-08-17T02:46:13.771574+0000","last_became_peered":"2024-08-17T02:46:13.771574+0000","last_unstale":"2024-08-17T02:46:13.787628+0000","last_undegraded":"2024-08-17T02:46:13.787628+0000","last_fullsized":"2024-08-17T02:46:13.787628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:53.437116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777529+0000","last_change":"2024-08-17T02:46:13.774672+0000","last_active":"2024-08-17T02:46:13.777529+0000","last_peered":"2024-08-17T02:46:13.777529+0000","last_clean":"2024-08-17T02:46:13.777529+0000","last_became_active":"2024-08-17T02:46:13.774417+0000","last_became_peered":"2024-08-17T02:46:13.774417+0000","last_unstale":"2024-08-17T02:46:13.777529+0000","last_undegraded":"2024-08-17T02:46:13.777529+0000","last_fullsized":"2024-08-17T02:46:13.777529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777974+0000","last_change":"2024-08-17T02:46:13.777018+0000","last_active":"2024-08-17T02:46:13.777974+0000","last_peered":"2024-08-17T02:46:13.777974+0000","last_clean":"2024-08-17T02:46:13.777974+0000","last_became_active":"2024-08-17T02:46:13.776494+0000","last_became_peered":"2024-08-17T02:46:13.776494+0000","last_unstale":"2024-08-17T02:46:13.777974+0000","last_undegraded":"2024-08-17T02:46:13.777974+0000","last_fullsized":"2024-08-17T02:46:13.777974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:13.882288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777982+0000","last_change":"2024-08-17T02:46:13.772303+0000","last_active":"2024-08-17T02:46:13.777982+0000","last_peered":"2024-08-17T02:46:13.777982+0000","last_clean":"2024-08-17T02:46:13.777982+0000","last_became_active":"2024-08-17T02:46:13.770496+0000","last_became_peered":"2024-08-17T02:46:13.770496+0000","last_unstale":"2024-08-17T02:46:13.777982+0000","last_undegraded":"2024-08-17T02:46:13.777982+0000","last_fullsized":"2024-08-17T02:46:13.777982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783745+0000","last_change":"2024-08-17T02:46:13.782542+0000","last_active":"2024-08-17T02:46:13.783745+0000","last_peered":"2024-08-17T02:46:13.783745+0000","last_clean":"2024-08-17T02:46:13.783745+0000","last_became_active":"2024-08-17T02:46:13.781512+0000","last_became_peered":"2024-08-17T02:46:13.781512+0000","last_unstale":"2024-08-17T02:46:13.783745+0000","last_undegraded":"2024-08-17T02:46:13.783745+0000","last_fullsized":"2024-08-17T02:46:13.783745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:31.909156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774645+0000","last_change":"2024-08-17T02:46:13.772207+0000","last_active":"2024-08-17T02:46:13.774645+0000","last_peered":"2024-08-17T02:46:13.774645+0000","last_clean":"2024-08-17T02:46:13.774645+0000","last_became_active":"2024-08-17T02:46:13.771965+0000","last_became_peered":"2024-08-17T02:46:13.771965+0000","last_unstale":"2024-08-17T02:46:13.774645+0000","last_undegraded":"2024-08-17T02:46:13.774645+0000","last_fullsized":"2024-08-17T02:46:13.774645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774903+0000","last_change":"2024-08-17T02:46:13.772803+0000","last_active":"2024-08-17T02:46:13.774903+0000","last_peered":"2024-08-17T02:46:13.774903+0000","last_clean":"2024-08-17T02:46:13.774903+0000","last_became_active":"2024-08-17T02:46:13.772356+0000","last_became_peered":"2024-08-17T02:46:13.772356+0000","last_unstale":"2024-08-17T02:46:13.774903+0000","last_undegraded":"2024-08-17T02:46:13.774903+0000","last_fullsized":"2024-08-17T02:46:13.774903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774317+0000","last_change":"2024-08-17T02:46:13.765594+0000","last_active":"2024-08-17T02:46:13.774317+0000","last_peered":"2024-08-17T02:46:13.774317+0000","last_clean":"2024-08-17T02:46:13.774317+0000","last_became_active":"2024-08-17T02:46:13.765142+0000","last_became_peered":"2024-08-17T02:46:13.765142+0000","last_unstale":"2024-08-17T02:46:13.774317+0000","last_undegraded":"2024-08-17T02:46:13.774317+0000","last_fullsized":"2024-08-17T02:46:13.774317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:17.516179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764835+0000","last_change":"2024-08-17T02:46:13.762927+0000","last_active":"2024-08-17T02:46:13.764835+0000","last_peered":"2024-08-17T02:46:13.764835+0000","last_clean":"2024-08-17T02:46:13.764835+0000","last_became_active":"2024-08-17T02:46:13.762593+0000","last_became_peered":"2024-08-17T02:46:13.762593+0000","last_unstale":"2024-08-17T02:46:13.764835+0000","last_undegraded":"2024-08-17T02:46:13.764835+0000","last_fullsized":"2024-08-17T02:46:13.764835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786511+0000","last_change":"2024-08-17T02:46:13.779226+0000","last_active":"2024-08-17T02:46:13.786511+0000","last_peered":"2024-08-17T02:46:13.786511+0000","last_clean":"2024-08-17T02:46:13.786511+0000","last_became_active":"2024-08-17T02:46:13.778514+0000","last_became_peered":"2024-08-17T02:46:13.778514+0000","last_unstale":"2024-08-17T02:46:13.786511+0000","last_undegraded":"2024-08-17T02:46:13.786511+0000","last_fullsized":"2024-08-17T02:46:13.786511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775996+0000","last_change":"2024-08-17T02:46:13.764824+0000","last_active":"2024-08-17T02:46:13.775996+0000","last_peered":"2024-08-17T02:46:13.775996+0000","last_clean":"2024-08-17T02:46:13.775996+0000","last_became_active":"2024-08-17T02:46:13.764423+0000","last_became_peered":"2024-08-17T02:46:13.764423+0000","last_unstale":"2024-08-17T02:46:13.775996+0000","last_undegraded":"2024-08-17T02:46:13.775996+0000","last_fullsized":"2024-08-17T02:46:13.775996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.762356+0000","last_change":"2024-08-17T02:46:13.758109+0000","last_active":"2024-08-17T02:46:13.762356+0000","last_peered":"2024-08-17T02:46:13.762356+0000","last_clean":"2024-08-17T02:46:13.762356+0000","last_became_active":"2024-08-17T02:46:13.757727+0000","last_became_peered":"2024-08-17T02:46:13.757727+0000","last_unstale":"2024-08-17T02:46:13.762356+0000","last_undegraded":"2024-08-17T02:46:13.762356+0000","last_fullsized":"2024-08-17T02:46:13.762356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:29.582747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775780+0000","last_change":"2024-08-17T02:46:13.770315+0000","last_active":"2024-08-17T02:46:13.775780+0000","last_peered":"2024-08-17T02:46:13.775780+0000","last_clean":"2024-08-17T02:46:13.775780+0000","last_became_active":"2024-08-17T02:46:13.770058+0000","last_became_peered":"2024-08-17T02:46:13.770058+0000","last_unstale":"2024-08-17T02:46:13.775780+0000","last_undegraded":"2024-08-17T02:46:13.775780+0000","last_fullsized":"2024-08-17T02:46:13.775780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:13.882288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.765237+0000","last_change":"2024-08-17T02:46:13.762473+0000","last_active":"2024-08-17T02:46:13.765237+0000","last_peered":"2024-08-17T02:46:13.765237+0000","last_clean":"2024-08-17T02:46:13.765237+0000","last_became_active":"2024-08-17T02:46:13.762210+0000","last_became_peered":"2024-08-17T02:46:13.762210+0000","last_unstale":"2024-08-17T02:46:13.765237+0000","last_undegraded":"2024-08-17T02:46:13.765237+0000","last_fullsized":"2024-08-17T02:46:13.765237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:28.991722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781197+0000","last_change":"2024-08-17T02:46:13.774494+0000","last_active":"2024-08-17T02:46:13.781197+0000","last_peered":"2024-08-17T02:46:13.781197+0000","last_clean":"2024-08-17T02:46:13.781197+0000","last_became_active":"2024-08-17T02:46:13.774173+0000","last_became_peered":"2024-08-17T02:46:13.774173+0000","last_unstale":"2024-08-17T02:46:13.781197+0000","last_undegraded":"2024-08-17T02:46:13.781197+0000","last_fullsized":"2024-08-17T02:46:13.781197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:10.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774059+0000","last_change":"2024-08-17T02:46:13.766560+0000","last_active":"2024-08-17T02:46:13.774059+0000","last_peered":"2024-08-17T02:46:13.774059+0000","last_clean":"2024-08-17T02:46:13.774059+0000","last_became_active":"2024-08-17T02:46:13.765745+0000","last_became_peered":"2024-08-17T02:46:13.765745+0000","last_unstale":"2024-08-17T02:46:13.774059+0000","last_undegraded":"2024-08-17T02:46:13.774059+0000","last_fullsized":"2024-08-17T02:46:13.774059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776545+0000","last_change":"2024-08-17T02:46:13.765254+0000","last_active":"2024-08-17T02:46:13.776545+0000","last_peered":"2024-08-17T02:46:13.776545+0000","last_clean":"2024-08-17T02:46:13.776545+0000","last_became_active":"2024-08-17T02:46:13.756647+0000","last_became_peered":"2024-08-17T02:46:13.756647+0000","last_unstale":"2024-08-17T02:46:13.776545+0000","last_undegraded":"2024-08-17T02:46:13.776545+0000","last_fullsized":"2024-08-17T02:46:13.776545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.770703+0000","last_change":"2024-08-17T02:46:13.765508+0000","last_active":"2024-08-17T02:46:13.770703+0000","last_peered":"2024-08-17T02:46:13.770703+0000","last_clean":"2024-08-17T02:46:13.770703+0000","last_became_active":"2024-08-17T02:46:13.765136+0000","last_became_peered":"2024-08-17T02:46:13.765136+0000","last_unstale":"2024-08-17T02:46:13.770703+0000","last_undegraded":"2024-08-17T02:46:13.770703+0000","last_fullsized":"2024-08-17T02:46:13.770703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:48.296428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.773564+0000","last_change":"2024-08-17T02:46:13.766938+0000","last_active":"2024-08-17T02:46:13.773564+0000","last_peered":"2024-08-17T02:46:13.773564+0000","last_clean":"2024-08-17T02:46:13.773564+0000","last_became_active":"2024-08-17T02:46:13.766711+0000","last_became_peered":"2024-08-17T02:46:13.766711+0000","last_unstale":"2024-08-17T02:46:13.773564+0000","last_undegraded":"2024-08-17T02:46:13.773564+0000","last_fullsized":"2024-08-17T02:46:13.773564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763233+0000","last_change":"2024-08-17T02:46:13.761055+0000","last_active":"2024-08-17T02:46:13.763233+0000","last_peered":"2024-08-17T02:46:13.763233+0000","last_clean":"2024-08-17T02:46:13.763233+0000","last_became_active":"2024-08-17T02:46:13.760766+0000","last_became_peered":"2024-08-17T02:46:13.760766+0000","last_unstale":"2024-08-17T02:46:13.763233+0000","last_undegraded":"2024-08-17T02:46:13.763233+0000","last_fullsized":"2024-08-17T02:46:13.763233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:10.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776693+0000","last_change":"2024-08-17T02:46:13.769437+0000","last_active":"2024-08-17T02:46:13.776693+0000","last_peered":"2024-08-17T02:46:13.776693+0000","last_clean":"2024-08-17T02:46:13.776693+0000","last_became_active":"2024-08-17T02:46:13.768078+0000","last_became_peered":"2024-08-17T02:46:13.768078+0000","last_unstale":"2024-08-17T02:46:13.776693+0000","last_undegraded":"2024-08-17T02:46:13.776693+0000","last_fullsized":"2024-08-17T02:46:13.776693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.782708+0000","last_change":"2024-08-17T02:46:13.780502+0000","last_active":"2024-08-17T02:46:13.782708+0000","last_peered":"2024-08-17T02:46:13.782708+0000","last_clean":"2024-08-17T02:46:13.782708+0000","last_became_active":"2024-08-17T02:46:13.780234+0000","last_became_peered":"2024-08-17T02:46:13.780234+0000","last_unstale":"2024-08-17T02:46:13.782708+0000","last_undegraded":"2024-08-17T02:46:13.782708+0000","last_fullsized":"2024-08-17T02:46:13.782708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776104+0000","last_change":"2024-08-17T02:46:13.765975+0000","last_active":"2024-08-17T02:46:13.776104+0000","last_peered":"2024-08-17T02:46:13.776104+0000","last_clean":"2024-08-17T02:46:13.776104+0000","last_became_active":"2024-08-17T02:46:13.765732+0000","last_became_peered":"2024-08-17T02:46:13.765732+0000","last_unstale":"2024-08-17T02:46:13.776104+0000","last_undegraded":"2024-08-17T02:46:13.776104+0000","last_fullsized":"2024-08-17T02:46:13.776104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781638+0000","last_change":"2024-08-17T02:46:13.768145+0000","last_active":"2024-08-17T02:46:13.781638+0000","last_peered":"2024-08-17T02:46:13.781638+0000","last_clean":"2024-08-17T02:46:13.781638+0000","last_became_active":"2024-08-17T02:46:13.767826+0000","last_became_peered":"2024-08-17T02:46:13.767826+0000","last_unstale":"2024-08-17T02:46:13.781638+0000","last_undegraded":"2024-08-17T02:46:13.781638+0000","last_fullsized":"2024-08-17T02:46:13.781638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787886+0000","last_change":"2024-08-17T02:46:13.773416+0000","last_active":"2024-08-17T02:46:13.787886+0000","last_peered":"2024-08-17T02:46:13.787886+0000","last_clean":"2024-08-17T02:46:13.787886+0000","last_became_active":"2024-08-17T02:46:13.773114+0000","last_became_peered":"2024-08-17T02:46:13.773114+0000","last_unstale":"2024-08-17T02:46:13.787886+0000","last_undegraded":"2024-08-17T02:46:13.787886+0000","last_fullsized":"2024-08-17T02:46:13.787886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:00.627300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.765708+0000","last_change":"2024-08-17T02:46:13.759659+0000","last_active":"2024-08-17T02:46:13.765708+0000","last_peered":"2024-08-17T02:46:13.765708+0000","last_clean":"2024-08-17T02:46:13.765708+0000","last_became_active":"2024-08-17T02:46:13.759333+0000","last_became_peered":"2024-08-17T02:46:13.759333+0000","last_unstale":"2024-08-17T02:46:13.765708+0000","last_undegraded":"2024-08-17T02:46:13.765708+0000","last_fullsized":"2024-08-17T02:46:13.765708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772382+0000","last_change":"2024-08-17T02:46:13.768988+0000","last_active":"2024-08-17T02:46:13.772382+0000","last_peered":"2024-08-17T02:46:13.772382+0000","last_clean":"2024-08-17T02:46:13.772382+0000","last_became_active":"2024-08-17T02:46:13.768739+0000","last_became_peered":"2024-08-17T02:46:13.768739+0000","last_unstale":"2024-08-17T02:46:13.772382+0000","last_undegraded":"2024-08-17T02:46:13.772382+0000","last_fullsized":"2024-08-17T02:46:13.772382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:43.094798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777504+0000","last_change":"2024-08-17T02:46:13.776020+0000","last_active":"2024-08-17T02:46:13.777504+0000","last_peered":"2024-08-17T02:46:13.777504+0000","last_clean":"2024-08-17T02:46:13.777504+0000","last_became_active":"2024-08-17T02:46:13.775579+0000","last_became_peered":"2024-08-17T02:46:13.775579+0000","last_unstale":"2024-08-17T02:46:13.777504+0000","last_undegraded":"2024-08-17T02:46:13.777504+0000","last_fullsized":"2024-08-17T02:46:13.777504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787097+0000","last_change":"2024-08-17T02:46:13.785306+0000","last_active":"2024-08-17T02:46:13.787097+0000","last_peered":"2024-08-17T02:46:13.787097+0000","last_clean":"2024-08-17T02:46:13.787097+0000","last_became_active":"2024-08-17T02:46:13.783412+0000","last_became_peered":"2024-08-17T02:46:13.783412+0000","last_unstale":"2024-08-17T02:46:13.787097+0000","last_undegraded":"2024-08-17T02:46:13.787097+0000","last_fullsized":"2024-08-17T02:46:13.787097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:29.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787958+0000","last_change":"2024-08-17T02:46:12.766141+0000","last_active":"2024-08-17T02:46:13.787958+0000","last_peered":"2024-08-17T02:46:13.787958+0000","last_clean":"2024-08-17T02:46:13.787958+0000","last_became_active":"2024-08-17T02:46:12.763492+0000","last_became_peered":"2024-08-17T02:46:12.763492+0000","last_unstale":"2024-08-17T02:46:13.787958+0000","last_undegraded":"2024-08-17T02:46:13.787958+0000","last_fullsized":"2024-08-17T02:46:13.787958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784653+0000","last_change":"2024-08-17T02:46:13.772658+0000","last_active":"2024-08-17T02:46:13.784653+0000","last_peered":"2024-08-17T02:46:13.784653+0000","last_clean":"2024-08-17T02:46:13.784653+0000","last_became_active":"2024-08-17T02:46:13.765586+0000","last_became_peered":"2024-08-17T02:46:13.765586+0000","last_unstale":"2024-08-17T02:46:13.784653+0000","last_undegraded":"2024-08-17T02:46:13.784653+0000","last_fullsized":"2024-08-17T02:46:13.784653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788422+0000","last_change":"2024-08-17T02:46:12.765654+0000","last_active":"2024-08-17T02:46:13.788422+0000","last_peered":"2024-08-17T02:46:13.788422+0000","last_clean":"2024-08-17T02:46:13.788422+0000","last_became_active":"2024-08-17T02:46:12.765358+0000","last_became_peered":"2024-08-17T02:46:12.765358+0000","last_unstale":"2024-08-17T02:46:13.788422+0000","last_undegraded":"2024-08-17T02:46:13.788422+0000","last_fullsized":"2024-08-17T02:46:13.788422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.746879+0000","last_change":"2024-08-17T02:46:12.757374+0000","last_active":"2024-08-17T02:46:13.746879+0000","last_peered":"2024-08-17T02:46:13.746879+0000","last_clean":"2024-08-17T02:46:13.746879+0000","last_became_active":"2024-08-17T02:46:12.757064+0000","last_became_peered":"2024-08-17T02:46:12.757064+0000","last_unstale":"2024-08-17T02:46:13.746879+0000","last_undegraded":"2024-08-17T02:46:13.746879+0000","last_fullsized":"2024-08-17T02:46:13.746879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:32.171597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.758714+0000","last_change":"2024-08-17T02:46:13.757800+0000","last_active":"2024-08-17T02:46:13.758714+0000","last_peered":"2024-08-17T02:46:13.758714+0000","last_clean":"2024-08-17T02:46:13.758714+0000","last_became_active":"2024-08-17T02:46:13.757609+0000","last_became_peered":"2024-08-17T02:46:13.757609+0000","last_unstale":"2024-08-17T02:46:13.758714+0000","last_undegraded":"2024-08-17T02:46:13.758714+0000","last_fullsized":"2024-08-17T02:46:13.758714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.752836+0000","last_change":"2024-08-17T02:46:12.771509+0000","last_active":"2024-08-17T02:46:13.752836+0000","last_peered":"2024-08-17T02:46:13.752836+0000","last_clean":"2024-08-17T02:46:13.752836+0000","last_became_active":"2024-08-17T02:46:12.765884+0000","last_became_peered":"2024-08-17T02:46:12.765884+0000","last_unstale":"2024-08-17T02:46:13.752836+0000","last_undegraded":"2024-08-17T02:46:13.752836+0000","last_fullsized":"2024-08-17T02:46:13.752836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772441+0000","last_change":"2024-08-17T02:46:13.760432+0000","last_active":"2024-08-17T02:46:13.772441+0000","last_peered":"2024-08-17T02:46:13.772441+0000","last_clean":"2024-08-17T02:46:13.772441+0000","last_became_active":"2024-08-17T02:46:13.757461+0000","last_became_peered":"2024-08-17T02:46:13.757461+0000","last_unstale":"2024-08-17T02:46:13.772441+0000","last_undegraded":"2024-08-17T02:46:13.772441+0000","last_fullsized":"2024-08-17T02:46:13.772441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.760005+0000","last_change":"2024-08-17T02:46:12.771440+0000","last_active":"2024-08-17T02:46:13.760005+0000","last_peered":"2024-08-17T02:46:13.760005+0000","last_clean":"2024-08-17T02:46:13.760005+0000","last_became_active":"2024-08-17T02:46:12.771171+0000","last_became_peered":"2024-08-17T02:46:12.771171+0000","last_unstale":"2024-08-17T02:46:13.760005+0000","last_undegraded":"2024-08-17T02:46:13.760005+0000","last_fullsized":"2024-08-17T02:46:13.760005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776159+0000","last_change":"2024-08-17T02:46:13.770867+0000","last_active":"2024-08-17T02:46:13.776159+0000","last_peered":"2024-08-17T02:46:13.776159+0000","last_clean":"2024-08-17T02:46:13.776159+0000","last_became_active":"2024-08-17T02:46:13.770367+0000","last_became_peered":"2024-08-17T02:46:13.770367+0000","last_unstale":"2024-08-17T02:46:13.776159+0000","last_undegraded":"2024-08-17T02:46:13.776159+0000","last_fullsized":"2024-08-17T02:46:13.776159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:59.549871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749408+0000","last_change":"2024-08-17T02:46:12.773955+0000","last_active":"2024-08-17T02:46:13.749408+0000","last_peered":"2024-08-17T02:46:13.749408+0000","last_clean":"2024-08-17T02:46:13.749408+0000","last_became_active":"2024-08-17T02:46:12.772243+0000","last_became_peered":"2024-08-17T02:46:12.772243+0000","last_unstale":"2024-08-17T02:46:13.749408+0000","last_undegraded":"2024-08-17T02:46:13.749408+0000","last_fullsized":"2024-08-17T02:46:13.749408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786276+0000","last_change":"2024-08-17T02:46:13.777529+0000","last_active":"2024-08-17T02:46:13.786276+0000","last_peered":"2024-08-17T02:46:13.786276+0000","last_clean":"2024-08-17T02:46:13.786276+0000","last_became_active":"2024-08-17T02:46:13.776596+0000","last_became_peered":"2024-08-17T02:46:13.776596+0000","last_unstale":"2024-08-17T02:46:13.786276+0000","last_undegraded":"2024-08-17T02:46:13.786276+0000","last_fullsized":"2024-08-17T02:46:13.786276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784145+0000","last_change":"2024-08-17T02:46:12.771541+0000","last_active":"2024-08-17T02:46:13.784145+0000","last_peered":"2024-08-17T02:46:13.784145+0000","last_clean":"2024-08-17T02:46:13.784145+0000","last_became_active":"2024-08-17T02:46:12.771307+0000","last_became_peered":"2024-08-17T02:46:12.771307+0000","last_unstale":"2024-08-17T02:46:13.784145+0000","last_undegraded":"2024-08-17T02:46:13.784145+0000","last_fullsized":"2024-08-17T02:46:13.784145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.771994+0000","last_change":"2024-08-17T02:46:13.765422+0000","last_active":"2024-08-17T02:46:13.771994+0000","last_peered":"2024-08-17T02:46:13.771994+0000","last_clean":"2024-08-17T02:46:13.771994+0000","last_became_active":"2024-08-17T02:46:13.764854+0000","last_became_peered":"2024-08-17T02:46:13.764854+0000","last_unstale":"2024-08-17T02:46:13.771994+0000","last_undegraded":"2024-08-17T02:46:13.771994+0000","last_fullsized":"2024-08-17T02:46:13.771994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:20.767461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.790295+0000","last_change":"2024-08-17T02:46:12.763643+0000","last_active":"2024-08-17T02:46:13.790295+0000","last_peered":"2024-08-17T02:46:13.790295+0000","last_clean":"2024-08-17T02:46:13.790295+0000","last_became_active":"2024-08-17T02:46:12.763196+0000","last_became_peered":"2024-08-17T02:46:12.763196+0000","last_unstale":"2024-08-17T02:46:13.790295+0000","last_undegraded":"2024-08-17T02:46:13.790295+0000","last_fullsized":"2024-08-17T02:46:13.790295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781185+0000","last_change":"2024-08-17T02:46:13.768744+0000","last_active":"2024-08-17T02:46:13.781185+0000","last_peered":"2024-08-17T02:46:13.781185+0000","last_clean":"2024-08-17T02:46:13.781185+0000","last_became_active":"2024-08-17T02:46:13.768433+0000","last_became_peered":"2024-08-17T02:46:13.768433+0000","last_unstale":"2024-08-17T02:46:13.781185+0000","last_undegraded":"2024-08-17T02:46:13.781185+0000","last_fullsized":"2024-08-17T02:46:13.781185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:30.671696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788049+0000","last_change":"2024-08-17T02:46:12.764570+0000","last_active":"2024-08-17T02:46:13.788049+0000","last_peered":"2024-08-17T02:46:13.788049+0000","last_clean":"2024-08-17T02:46:13.788049+0000","last_became_active":"2024-08-17T02:46:12.763764+0000","last_became_peered":"2024-08-17T02:46:12.763764+0000","last_unstale":"2024-08-17T02:46:13.788049+0000","last_undegraded":"2024-08-17T02:46:13.788049+0000","last_fullsized":"2024-08-17T02:46:13.788049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:32.171597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.778773+0000","last_change":"2024-08-17T02:46:13.764855+0000","last_active":"2024-08-17T02:46:13.778773+0000","last_peered":"2024-08-17T02:46:13.778773+0000","last_clean":"2024-08-17T02:46:13.778773+0000","last_became_active":"2024-08-17T02:46:13.764494+0000","last_became_peered":"2024-08-17T02:46:13.764494+0000","last_unstale":"2024-08-17T02:46:13.778773+0000","last_undegraded":"2024-08-17T02:46:13.778773+0000","last_fullsized":"2024-08-17T02:46:13.778773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:26.668711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749487+0000","last_change":"2024-08-17T02:46:12.763292+0000","last_active":"2024-08-17T02:46:13.749487+0000","last_peered":"2024-08-17T02:46:13.749487+0000","last_clean":"2024-08-17T02:46:13.749487+0000","last_became_active":"2024-08-17T02:46:12.762486+0000","last_became_peered":"2024-08-17T02:46:12.762486+0000","last_unstale":"2024-08-17T02:46:13.749487+0000","last_undegraded":"2024-08-17T02:46:13.749487+0000","last_fullsized":"2024-08-17T02:46:13.749487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788571+0000","last_change":"2024-08-17T02:46:13.787493+0000","last_active":"2024-08-17T02:46:13.788571+0000","last_peered":"2024-08-17T02:46:13.788571+0000","last_clean":"2024-08-17T02:46:13.788571+0000","last_became_active":"2024-08-17T02:46:13.778178+0000","last_became_peered":"2024-08-17T02:46:13.778178+0000","last_unstale":"2024-08-17T02:46:13.788571+0000","last_undegraded":"2024-08-17T02:46:13.788571+0000","last_fullsized":"2024-08-17T02:46:13.788571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:59.549871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.759786+0000","last_change":"2024-08-17T02:46:12.760312+0000","last_active":"2024-08-17T02:46:13.759786+0000","last_peered":"2024-08-17T02:46:13.759786+0000","last_clean":"2024-08-17T02:46:13.759786+0000","last_became_active":"2024-08-17T02:46:12.760019+0000","last_became_peered":"2024-08-17T02:46:12.760019+0000","last_unstale":"2024-08-17T02:46:13.759786+0000","last_undegraded":"2024-08-17T02:46:13.759786+0000","last_fullsized":"2024-08-17T02:46:13.759786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777485+0000","last_change":"2024-08-17T02:46:13.775855+0000","last_active":"2024-08-17T02:46:13.777485+0000","last_peered":"2024-08-17T02:46:13.777485+0000","last_clean":"2024-08-17T02:46:13.777485+0000","last_became_active":"2024-08-17T02:46:13.775232+0000","last_became_peered":"2024-08-17T02:46:13.775232+0000","last_unstale":"2024-08-17T02:46:13.777485+0000","last_undegraded":"2024-08-17T02:46:13.777485+0000","last_fullsized":"2024-08-17T02:46:13.777485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788359+0000","last_change":"2024-08-17T02:46:12.761768+0000","last_active":"2024-08-17T02:46:13.788359+0000","last_peered":"2024-08-17T02:46:13.788359+0000","last_clean":"2024-08-17T02:46:13.788359+0000","last_became_active":"2024-08-17T02:46:12.761478+0000","last_became_peered":"2024-08-17T02:46:12.761478+0000","last_unstale":"2024-08-17T02:46:13.788359+0000","last_undegraded":"2024-08-17T02:46:13.788359+0000","last_fullsized":"2024-08-17T02:46:13.788359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784569+0000","last_change":"2024-08-17T02:46:13.780280+0000","last_active":"2024-08-17T02:46:13.784569+0000","last_peered":"2024-08-17T02:46:13.784569+0000","last_clean":"2024-08-17T02:46:13.784569+0000","last_became_active":"2024-08-17T02:46:13.779454+0000","last_became_peered":"2024-08-17T02:46:13.779454+0000","last_unstale":"2024-08-17T02:46:13.784569+0000","last_undegraded":"2024-08-17T02:46:13.784569+0000","last_fullsized":"2024-08-17T02:46:13.784569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788136+0000","last_change":"2024-08-17T02:46:12.769206+0000","last_active":"2024-08-17T02:46:13.788136+0000","last_peered":"2024-08-17T02:46:13.788136+0000","last_clean":"2024-08-17T02:46:13.788136+0000","last_became_active":"2024-08-17T02:46:12.768891+0000","last_became_peered":"2024-08-17T02:46:12.768891+0000","last_unstale":"2024-08-17T02:46:13.788136+0000","last_undegraded":"2024-08-17T02:46:13.788136+0000","last_fullsized":"2024-08-17T02:46:13.788136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:59:55.270622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774129+0000","last_change":"2024-08-17T02:46:13.769837+0000","last_active":"2024-08-17T02:46:13.774129+0000","last_peered":"2024-08-17T02:46:13.774129+0000","last_clean":"2024-08-17T02:46:13.774129+0000","last_became_active":"2024-08-17T02:46:13.769478+0000","last_became_peered":"2024-08-17T02:46:13.769478+0000","last_unstale":"2024-08-17T02:46:13.774129+0000","last_undegraded":"2024-08-17T02:46:13.774129+0000","last_fullsized":"2024-08-17T02:46:13.774129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:47.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783670+0000","last_change":"2024-08-17T02:46:12.755672+0000","last_active":"2024-08-17T02:46:13.783670+0000","last_peered":"2024-08-17T02:46:13.783670+0000","last_clean":"2024-08-17T02:46:13.783670+0000","last_became_active":"2024-08-17T02:46:12.754437+0000","last_became_peered":"2024-08-17T02:46:12.754437+0000","last_unstale":"2024-08-17T02:46:13.783670+0000","last_undegraded":"2024-08-17T02:46:13.783670+0000","last_fullsized":"2024-08-17T02:46:13.783670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783726+0000","last_change":"2024-08-17T02:46:13.782246+0000","last_active":"2024-08-17T02:46:13.783726+0000","last_peered":"2024-08-17T02:46:13.783726+0000","last_clean":"2024-08-17T02:46:13.783726+0000","last_became_active":"2024-08-17T02:46:13.781368+0000","last_became_peered":"2024-08-17T02:46:13.781368+0000","last_unstale":"2024-08-17T02:46:13.783726+0000","last_undegraded":"2024-08-17T02:46:13.783726+0000","last_fullsized":"2024-08-17T02:46:13.783726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786712+0000","last_change":"2024-08-17T02:46:12.761505+0000","last_active":"2024-08-17T02:46:13.786712+0000","last_peered":"2024-08-17T02:46:13.786712+0000","last_clean":"2024-08-17T02:46:13.786712+0000","last_became_active":"2024-08-17T02:46:12.760373+0000","last_became_peered":"2024-08-17T02:46:12.760373+0000","last_unstale":"2024-08-17T02:46:13.786712+0000","last_undegraded":"2024-08-17T02:46:13.786712+0000","last_fullsized":"2024-08-17T02:46:13.786712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:16.510354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763000+0000","last_change":"2024-08-17T02:46:13.758103+0000","last_active":"2024-08-17T02:46:13.763000+0000","last_peered":"2024-08-17T02:46:13.763000+0000","last_clean":"2024-08-17T02:46:13.763000+0000","last_became_active":"2024-08-17T02:46:13.757785+0000","last_became_peered":"2024-08-17T02:46:13.757785+0000","last_unstale":"2024-08-17T02:46:13.763000+0000","last_undegraded":"2024-08-17T02:46:13.763000+0000","last_fullsized":"2024-08-17T02:46:13.763000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:47.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.751133+0000","last_change":"2024-08-17T02:46:12.773394+0000","last_active":"2024-08-17T02:46:13.751133+0000","last_peered":"2024-08-17T02:46:13.751133+0000","last_clean":"2024-08-17T02:46:13.751133+0000","last_became_active":"2024-08-17T02:46:12.773045+0000","last_became_peered":"2024-08-17T02:46:12.773045+0000","last_unstale":"2024-08-17T02:46:13.751133+0000","last_undegraded":"2024-08-17T02:46:13.751133+0000","last_fullsized":"2024-08-17T02:46:13.751133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783423+0000","last_change":"2024-08-17T02:46:13.782165+0000","last_active":"2024-08-17T02:46:13.783423+0000","last_peered":"2024-08-17T02:46:13.783423+0000","last_clean":"2024-08-17T02:46:13.783423+0000","last_became_active":"2024-08-17T02:46:13.781292+0000","last_became_peered":"2024-08-17T02:46:13.781292+0000","last_unstale":"2024-08-17T02:46:13.783423+0000","last_undegraded":"2024-08-17T02:46:13.783423+0000","last_fullsized":"2024-08-17T02:46:13.783423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:14.050922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756445+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:46:13.756445+0000","last_peered":"2024-08-17T02:46:13.756445+0000","last_clean":"2024-08-17T02:46:13.756445+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:46:13.756445+0000","last_undegraded":"2024-08-17T02:46:13.756445+0000","last_fullsized":"2024-08-17T02:46:13.756445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.747542+0000","last_change":"2024-08-17T02:46:12.761371+0000","last_active":"2024-08-17T02:46:13.747542+0000","last_peered":"2024-08-17T02:46:13.747542+0000","last_clean":"2024-08-17T02:46:13.747542+0000","last_became_active":"2024-08-17T02:46:12.761066+0000","last_became_peered":"2024-08-17T02:46:12.761066+0000","last_unstale":"2024-08-17T02:46:13.747542+0000","last_undegraded":"2024-08-17T02:46:13.747542+0000","last_fullsized":"2024-08-17T02:46:13.747542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.778045+0000","last_change":"2024-08-17T02:46:13.773410+0000","last_active":"2024-08-17T02:46:13.778045+0000","last_peered":"2024-08-17T02:46:13.778045+0000","last_clean":"2024-08-17T02:46:13.778045+0000","last_became_active":"2024-08-17T02:46:13.771934+0000","last_became_peered":"2024-08-17T02:46:13.771934+0000","last_unstale":"2024-08-17T02:46:13.778045+0000","last_undegraded":"2024-08-17T02:46:13.778045+0000","last_fullsized":"2024-08-17T02:46:13.778045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:29.582747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756352+0000","last_change":"2024-08-17T02:46:12.766920+0000","last_active":"2024-08-17T02:46:13.756352+0000","last_peered":"2024-08-17T02:46:13.756352+0000","last_clean":"2024-08-17T02:46:13.756352+0000","last_became_active":"2024-08-17T02:46:12.766386+0000","last_became_peered":"2024-08-17T02:46:12.766386+0000","last_unstale":"2024-08-17T02:46:13.756352+0000","last_undegraded":"2024-08-17T02:46:13.756352+0000","last_fullsized":"2024-08-17T02:46:13.756352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783602+0000","last_change":"2024-08-17T02:46:13.765726+0000","last_active":"2024-08-17T02:46:13.783602+0000","last_peered":"2024-08-17T02:46:13.783602+0000","last_clean":"2024-08-17T02:46:13.783602+0000","last_became_active":"2024-08-17T02:46:13.765377+0000","last_became_peered":"2024-08-17T02:46:13.765377+0000","last_unstale":"2024-08-17T02:46:13.783602+0000","last_undegraded":"2024-08-17T02:46:13.783602+0000","last_fullsized":"2024-08-17T02:46:13.783602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.750833+0000","last_change":"2024-08-17T02:46:12.754881+0000","last_active":"2024-08-17T02:46:13.750833+0000","last_peered":"2024-08-17T02:46:13.750833+0000","last_clean":"2024-08-17T02:46:13.750833+0000","last_became_active":"2024-08-17T02:46:12.753763+0000","last_became_peered":"2024-08-17T02:46:12.753763+0000","last_unstale":"2024-08-17T02:46:13.750833+0000","last_undegraded":"2024-08-17T02:46:13.750833+0000","last_fullsized":"2024-08-17T02:46:13.750833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772407+0000","last_change":"2024-08-17T02:46:13.759314+0000","last_active":"2024-08-17T02:46:13.772407+0000","last_peered":"2024-08-17T02:46:13.772407+0000","last_clean":"2024-08-17T02:46:13.772407+0000","last_became_active":"2024-08-17T02:46:13.759005+0000","last_became_peered":"2024-08-17T02:46:13.759005+0000","last_unstale":"2024-08-17T02:46:13.772407+0000","last_undegraded":"2024-08-17T02:46:13.772407+0000","last_fullsized":"2024-08-17T02:46:13.772407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749580+0000","last_change":"2024-08-17T02:46:12.764920+0000","last_active":"2024-08-17T02:46:13.749580+0000","last_peered":"2024-08-17T02:46:13.749580+0000","last_clean":"2024-08-17T02:46:13.749580+0000","last_became_active":"2024-08-17T02:46:12.764463+0000","last_became_peered":"2024-08-17T02:46:12.764463+0000","last_unstale":"2024-08-17T02:46:13.749580+0000","last_undegraded":"2024-08-17T02:46:13.749580+0000","last_fullsized":"2024-08-17T02:46:13.749580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.773750+0000","last_change":"2024-08-17T02:46:13.768129+0000","last_active":"2024-08-17T02:46:13.773750+0000","last_peered":"2024-08-17T02:46:13.773750+0000","last_clean":"2024-08-17T02:46:13.773750+0000","last_became_active":"2024-08-17T02:46:13.767922+0000","last_became_peered":"2024-08-17T02:46:13.767922+0000","last_unstale":"2024-08-17T02:46:13.773750+0000","last_undegraded":"2024-08-17T02:46:13.773750+0000","last_fullsized":"2024-08-17T02:46:13.773750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:28.991722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.752673+0000","last_change":"2024-08-17T02:46:12.768892+0000","last_active":"2024-08-17T02:46:13.752673+0000","last_peered":"2024-08-17T02:46:13.752673+0000","last_clean":"2024-08-17T02:46:13.752673+0000","last_became_active":"2024-08-17T02:46:12.768653+0000","last_became_peered":"2024-08-17T02:46:12.768653+0000","last_unstale":"2024-08-17T02:46:13.752673+0000","last_undegraded":"2024-08-17T02:46:13.752673+0000","last_fullsized":"2024-08-17T02:46:13.752673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776587+0000","last_change":"2024-08-17T02:46:13.768046+0000","last_active":"2024-08-17T02:46:13.776587+0000","last_peered":"2024-08-17T02:46:13.776587+0000","last_clean":"2024-08-17T02:46:13.776587+0000","last_became_active":"2024-08-17T02:46:13.767445+0000","last_became_peered":"2024-08-17T02:46:13.767445+0000","last_unstale":"2024-08-17T02:46:13.776587+0000","last_undegraded":"2024-08-17T02:46:13.776587+0000","last_fullsized":"2024-08-17T02:46:13.776587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.759052+0000","last_change":"2024-08-17T02:46:12.770898+0000","last_active":"2024-08-17T02:46:13.759052+0000","last_peered":"2024-08-17T02:46:13.759052+0000","last_clean":"2024-08-17T02:46:13.759052+0000","last_became_active":"2024-08-17T02:46:12.770596+0000","last_became_peered":"2024-08-17T02:46:12.770596+0000","last_unstale":"2024-08-17T02:46:13.759052+0000","last_undegraded":"2024-08-17T02:46:13.759052+0000","last_fullsized":"2024-08-17T02:46:13.759052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:27.985897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775335+0000","last_change":"2024-08-17T02:46:13.764756+0000","last_active":"2024-08-17T02:46:13.775335+0000","last_peered":"2024-08-17T02:46:13.775335+0000","last_clean":"2024-08-17T02:46:13.775335+0000","last_became_active":"2024-08-17T02:46:13.764423+0000","last_became_peered":"2024-08-17T02:46:13.764423+0000","last_unstale":"2024-08-17T02:46:13.775335+0000","last_undegraded":"2024-08-17T02:46:13.775335+0000","last_fullsized":"2024-08-17T02:46:13.775335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.757710+0000","last_change":"2024-08-17T02:46:12.770698+0000","last_active":"2024-08-17T02:46:13.757710+0000","last_peered":"2024-08-17T02:46:13.757710+0000","last_clean":"2024-08-17T02:46:13.757710+0000","last_became_active":"2024-08-17T02:46:12.770432+0000","last_became_peered":"2024-08-17T02:46:12.770432+0000","last_unstale":"2024-08-17T02:46:13.757710+0000","last_undegraded":"2024-08-17T02:46:13.757710+0000","last_fullsized":"2024-08-17T02:46:13.757710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787077+0000","last_change":"2024-08-17T02:46:13.785768+0000","last_active":"2024-08-17T02:46:13.787077+0000","last_peered":"2024-08-17T02:46:13.787077+0000","last_clean":"2024-08-17T02:46:13.787077+0000","last_became_active":"2024-08-17T02:46:13.784611+0000","last_became_peered":"2024-08-17T02:46:13.784611+0000","last_unstale":"2024-08-17T02:46:13.787077+0000","last_undegraded":"2024-08-17T02:46:13.787077+0000","last_fullsized":"2024-08-17T02:46:13.787077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786933+0000","last_change":"2024-08-17T02:46:12.766695+0000","last_active":"2024-08-17T02:46:13.786933+0000","last_peered":"2024-08-17T02:46:13.786933+0000","last_clean":"2024-08-17T02:46:13.786933+0000","last_became_active":"2024-08-17T02:46:12.766389+0000","last_became_peered":"2024-08-17T02:46:12.766389+0000","last_unstale":"2024-08-17T02:46:13.786933+0000","last_undegraded":"2024-08-17T02:46:13.786933+0000","last_fullsized":"2024-08-17T02:46:13.786933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.785500+0000","last_change":"2024-08-17T02:46:13.775750+0000","last_active":"2024-08-17T02:46:13.785500+0000","last_peered":"2024-08-17T02:46:13.785500+0000","last_clean":"2024-08-17T02:46:13.785500+0000","last_became_active":"2024-08-17T02:46:13.775487+0000","last_became_peered":"2024-08-17T02:46:13.775487+0000","last_unstale":"2024-08-17T02:46:13.785500+0000","last_undegraded":"2024-08-17T02:46:13.785500+0000","last_fullsized":"2024-08-17T02:46:13.785500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756242+0000","last_change":"2024-08-17T02:46:12.769354+0000","last_active":"2024-08-17T02:46:13.756242+0000","last_peered":"2024-08-17T02:46:13.756242+0000","last_clean":"2024-08-17T02:46:13.756242+0000","last_became_active":"2024-08-17T02:46:12.769061+0000","last_became_peered":"2024-08-17T02:46:12.769061+0000","last_unstale":"2024-08-17T02:46:13.756242+0000","last_undegraded":"2024-08-17T02:46:13.756242+0000","last_fullsized":"2024-08-17T02:46:13.756242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:16.510354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.760836+0000","last_change":"2024-08-17T02:46:13.758278+0000","last_active":"2024-08-17T02:46:13.760836+0000","last_peered":"2024-08-17T02:46:13.760836+0000","last_clean":"2024-08-17T02:46:13.760836+0000","last_became_active":"2024-08-17T02:46:13.758028+0000","last_became_peered":"2024-08-17T02:46:13.758028+0000","last_unstale":"2024-08-17T02:46:13.760836+0000","last_undegraded":"2024-08-17T02:46:13.760836+0000","last_fullsized":"2024-08-17T02:46:13.760836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:26.668711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.751025+0000","last_change":"2024-08-17T02:46:12.766160+0000","last_active":"2024-08-17T02:46:13.751025+0000","last_peered":"2024-08-17T02:46:13.751025+0000","last_clean":"2024-08-17T02:46:13.751025+0000","last_became_active":"2024-08-17T02:46:12.765813+0000","last_became_peered":"2024-08-17T02:46:12.765813+0000","last_unstale":"2024-08-17T02:46:13.751025+0000","last_undegraded":"2024-08-17T02:46:13.751025+0000","last_fullsized":"2024-08-17T02:46:13.751025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:19.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.767346+0000","last_change":"2024-08-17T02:46:13.765879+0000","last_active":"2024-08-17T02:46:13.767346+0000","last_peered":"2024-08-17T02:46:13.767346+0000","last_clean":"2024-08-17T02:46:13.767346+0000","last_became_active":"2024-08-17T02:46:13.765623+0000","last_became_peered":"2024-08-17T02:46:13.765623+0000","last_unstale":"2024-08-17T02:46:13.767346+0000","last_undegraded":"2024-08-17T02:46:13.767346+0000","last_fullsized":"2024-08-17T02:46:13.767346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756732+0000","last_change":"2024-08-17T02:46:12.761258+0000","last_active":"2024-08-17T02:46:13.756732+0000","last_peered":"2024-08-17T02:46:13.756732+0000","last_clean":"2024-08-17T02:46:13.756732+0000","last_became_active":"2024-08-17T02:46:12.760997+0000","last_became_peered":"2024-08-17T02:46:12.760997+0000","last_unstale":"2024-08-17T02:46:13.756732+0000","last_undegraded":"2024-08-17T02:46:13.756732+0000","last_fullsized":"2024-08-17T02:46:13.756732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786999+0000","last_change":"2024-08-17T02:46:13.780356+0000","last_active":"2024-08-17T02:46:13.786999+0000","last_peered":"2024-08-17T02:46:13.786999+0000","last_clean":"2024-08-17T02:46:13.786999+0000","last_became_active":"2024-08-17T02:46:13.779734+0000","last_became_peered":"2024-08-17T02:46:13.779734+0000","last_unstale":"2024-08-17T02:46:13.786999+0000","last_undegraded":"2024-08-17T02:46:13.786999+0000","last_fullsized":"2024-08-17T02:46:13.786999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787809+0000","last_change":"2024-08-17T02:46:12.765599+0000","last_active":"2024-08-17T02:46:13.787809+0000","last_peered":"2024-08-17T02:46:13.787809+0000","last_clean":"2024-08-17T02:46:13.787809+0000","last_became_active":"2024-08-17T02:46:12.765154+0000","last_became_peered":"2024-08-17T02:46:12.765154+0000","last_unstale":"2024-08-17T02:46:13.787809+0000","last_undegraded":"2024-08-17T02:46:13.787809+0000","last_fullsized":"2024-08-17T02:46:13.787809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772892+0000","last_change":"2024-08-17T02:46:13.765726+0000","last_active":"2024-08-17T02:46:13.772892+0000","last_peered":"2024-08-17T02:46:13.772892+0000","last_clean":"2024-08-17T02:46:13.772892+0000","last_became_active":"2024-08-17T02:46:13.765458+0000","last_became_peered":"2024-08-17T02:46:13.765458+0000","last_unstale":"2024-08-17T02:46:13.772892+0000","last_undegraded":"2024-08-17T02:46:13.772892+0000","last_fullsized":"2024-08-17T02:46:13.772892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763706+0000","last_change":"2024-08-17T02:46:13.762591+0000","last_active":"2024-08-17T02:46:13.763706+0000","last_peered":"2024-08-17T02:46:13.763706+0000","last_clean":"2024-08-17T02:46:13.763706+0000","last_became_active":"2024-08-17T02:46:13.762278+0000","last_became_peered":"2024-08-17T02:46:13.762278+0000","last_unstale":"2024-08-17T02:46:13.763706+0000","last_undegraded":"2024-08-17T02:46:13.763706+0000","last_fullsized":"2024-08-17T02:46:13.763706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788027+0000","last_change":"2024-08-17T02:46:12.775104+0000","last_active":"2024-08-17T02:46:13.788027+0000","last_peered":"2024-08-17T02:46:13.788027+0000","last_clean":"2024-08-17T02:46:13.788027+0000","last_became_active":"2024-08-17T02:46:12.774744+0000","last_became_peered":"2024-08-17T02:46:12.774744+0000","last_unstale":"2024-08-17T02:46:13.788027+0000","last_undegraded":"2024-08-17T02:46:13.788027+0000","last_fullsized":"2024-08-17T02:46:13.788027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:19.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764417+0000","last_change":"2024-08-17T02:46:13.763165+0000","last_active":"2024-08-17T02:46:13.764417+0000","last_peered":"2024-08-17T02:46:13.764417+0000","last_clean":"2024-08-17T02:46:13.764417+0000","last_became_active":"2024-08-17T02:46:13.762821+0000","last_became_peered":"2024-08-17T02:46:13.762821+0000","last_unstale":"2024-08-17T02:46:13.764417+0000","last_undegraded":"2024-08-17T02:46:13.764417+0000","last_fullsized":"2024-08-17T02:46:13.764417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:30.671696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784385+0000","last_change":"2024-08-17T02:46:12.768599+0000","last_active":"2024-08-17T02:46:13.784385+0000","last_peered":"2024-08-17T02:46:13.784385+0000","last_clean":"2024-08-17T02:46:13.784385+0000","last_became_active":"2024-08-17T02:46:12.768318+0000","last_became_peered":"2024-08-17T02:46:12.768318+0000","last_unstale":"2024-08-17T02:46:13.784385+0000","last_undegraded":"2024-08-17T02:46:13.784385+0000","last_fullsized":"2024-08-17T02:46:13.784385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:42.088973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777974+0000","last_change":"2024-08-17T02:46:13.772324+0000","last_active":"2024-08-17T02:46:13.777974+0000","last_peered":"2024-08-17T02:46:13.777974+0000","last_clean":"2024-08-17T02:46:13.777974+0000","last_became_active":"2024-08-17T02:46:13.771998+0000","last_became_peered":"2024-08-17T02:46:13.771998+0000","last_unstale":"2024-08-17T02:46:13.777974+0000","last_undegraded":"2024-08-17T02:46:13.777974+0000","last_fullsized":"2024-08-17T02:46:13.777974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787723+0000","last_change":"2024-08-17T02:46:12.762044+0000","last_active":"2024-08-17T02:46:13.787723+0000","last_peered":"2024-08-17T02:46:13.787723+0000","last_clean":"2024-08-17T02:46:13.787723+0000","last_became_active":"2024-08-17T02:46:12.761769+0000","last_became_peered":"2024-08-17T02:46:12.761769+0000","last_unstale":"2024-08-17T02:46:13.787723+0000","last_undegraded":"2024-08-17T02:46:13.787723+0000","last_fullsized":"2024-08-17T02:46:13.787723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:29.351136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764812+0000","last_change":"2024-08-17T02:46:13.762933+0000","last_active":"2024-08-17T02:46:13.764812+0000","last_peered":"2024-08-17T02:46:13.764812+0000","last_clean":"2024-08-17T02:46:13.764812+0000","last_became_active":"2024-08-17T02:46:13.762614+0000","last_became_peered":"2024-08-17T02:46:13.762614+0000","last_unstale":"2024-08-17T02:46:13.764812+0000","last_undegraded":"2024-08-17T02:46:13.764812+0000","last_fullsized":"2024-08-17T02:46:13.764812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786378+0000","last_change":"2024-08-17T02:46:12.767446+0000","last_active":"2024-08-17T02:46:13.786378+0000","last_peered":"2024-08-17T02:46:13.786378+0000","last_clean":"2024-08-17T02:46:13.786378+0000","last_became_active":"2024-08-17T02:46:12.767136+0000","last_became_peered":"2024-08-17T02:46:12.767136+0000","last_unstale":"2024-08-17T02:46:13.786378+0000","last_undegraded":"2024-08-17T02:46:13.786378+0000","last_fullsized":"2024-08-17T02:46:13.786378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:29.351136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":69025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:18.354 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:46:18.354 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:46:18.354 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:46:18.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:46:18.355 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:46:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.540+0000 7f7199c00640 1 Processor -- start 2024-08-17T02:46:18.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.540+0000 7f7199c00640 1 -- start start 2024-08-17T02:46:18.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.541+0000 7f7199c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f71940ad960 0x7f719415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.541+0000 7f7199c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f71940add30 0x7f7194156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.541+0000 7f7199c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719415b5e0 con 0x7f71940ca050 2024-08-17T02:46:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.541+0000 7f7199c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940cb160 con 0x7f71940add30 2024-08-17T02:46:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.541+0000 7f7199c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940b0d10 con 0x7f71940ad960 2024-08-17T02:46:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.541+0000 7f7192000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f71940ca050 0x7f7194156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44064/0 (socket says 172.21.15.2:44064) 2024-08-17T02:46:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.541+0000 7f7192000640 1 -- 172.21.15.2:0/300315223 learned_addr learned my addr 172.21.15.2:0/300315223 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.541+0000 7f7193400640 1 --2- 172.21.15.2:0/300315223 >> v2:172.21.15.2:3300/0 conn(0x7f71940add30 0x7f7194156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.542+0000 7f7192a00640 1 --2- 172.21.15.2:0/300315223 >> v2:172.21.15.26:3300/0 conn(0x7f71940ad960 0x7f719415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.542+0000 7f7193400640 1 -- 172.21.15.2:0/300315223 >> v2:172.21.15.26:3300/0 conn(0x7f71940ad960 msgr2=0x7f719415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.542+0000 7f7193400640 1 --2- 172.21.15.2:0/300315223 >> v2:172.21.15.26:3300/0 conn(0x7f71940ad960 0x7f719415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.542+0000 7f7193400640 1 -- 172.21.15.2:0/300315223 >> v1:172.21.15.2:6789/0 conn(0x7f71940ca050 legacy=0x7f7194156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.542+0000 7f7193400640 1 -- 172.21.15.2:0/300315223 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940ca550 con 0x7f71940add30 2024-08-17T02:46:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.542+0000 7f7191600640 1 -- 172.21.15.2:0/300315223 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595050133 0 0) 0x7f7180001110 con 0x7f71940ca050 2024-08-17T02:46:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.543+0000 7f7193400640 1 --2- 172.21.15.2:0/300315223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194156b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f71940cc910 tx=0x7f718c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851aed3b41301821 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.543+0000 7f7191600640 1 -- 172.21.15.2:0/300315223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c007550 con 0x7f71940add30 2024-08-17T02:46:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.543+0000 7f7191600640 1 -- 172.21.15.2:0/300315223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c02d050 con 0x7f71940add30 2024-08-17T02:46:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.543+0000 7f7191600640 1 -- 172.21.15.2:0/300315223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0078e0 con 0x7f71940add30 2024-08-17T02:46:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.544+0000 7f7199c00640 1 -- 172.21.15.2:0/300315223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 msgr2=0x7f7194156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.544+0000 7f7199c00640 1 --2- 172.21.15.2:0/300315223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194156b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f71940cc910 tx=0x7f718c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.544+0000 7f7199c00640 1 -- 172.21.15.2:0/300315223 shutdown_connections 2024-08-17T02:46:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.544+0000 7f7199c00640 1 --2- 172.21.15.2:0/300315223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194156b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.544+0000 7f7199c00640 1 --2- 172.21.15.2:0/300315223 >> v2:172.21.15.26:3300/0 conn(0x7f71940ad960 0x7f719415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.544+0000 7f7199c00640 1 -- 172.21.15.2:0/300315223 >> 172.21.15.2:0/300315223 conn(0x7f7194066e60 msgr2=0x7f7194067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.544+0000 7f7199c00640 1 -- 172.21.15.2:0/300315223 shutdown_connections 2024-08-17T02:46:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.544+0000 7f7199c00640 1 -- 172.21.15.2:0/300315223 wait complete. 2024-08-17T02:46:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.545+0000 7f7199c00640 1 Processor -- start 2024-08-17T02:46:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.546+0000 7f7199c00640 1 -- start start 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.546+0000 7f7199c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71940ad960 0x7f7194158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7199c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7199c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71940ca050 0x7f719415c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7199c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719416ac50 con 0x7f71940add30 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7199c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719416a040 con 0x7f71940ca050 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7199c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719416a320 con 0x7f71940ad960 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44188/0 (socket says 172.21.15.2:44188) 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 -- 172.21.15.2:0/822179514 learned_addr learned my addr 172.21.15.2:0/822179514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:18.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192a00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71940ad960 0x7f7194158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 -- 172.21.15.2:0/822179514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71940ad960 msgr2=0x7f7194158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71940ad960 0x7f7194158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 -- 172.21.15.2:0/822179514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71940ca050 msgr2=0x7f719415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71940ca050 0x7f719415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 -- 172.21.15.2:0/822179514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c009a20 con 0x7f71940add30 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192a00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71940ad960 0x7f7194158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.547+0000 7f7192000640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194152570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f718000c810 tx=0x7f7180007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.548+0000 7f718a000640 1 -- 172.21.15.2:0/822179514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180005870 con 0x7f71940add30 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.548+0000 7f718a000640 1 -- 172.21.15.2:0/822179514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71800059d0 con 0x7f71940add30 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.548+0000 7f718a000640 1 -- 172.21.15.2:0/822179514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180005dd0 con 0x7f71940add30 2024-08-17T02:46:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.548+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719416a600 con 0x7f71940add30 2024-08-17T02:46:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.548+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7194152ab0 con 0x7f71940add30 2024-08-17T02:46:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.549+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7194063fb0 con 0x7f71940add30 2024-08-17T02:46:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.550+0000 7f718a000640 1 -- 172.21.15.2:0/822179514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7180007300 con 0x7f71940add30 2024-08-17T02:46:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.550+0000 7f718a000640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7174065150 0x7f7174067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.551+0000 7f718a000640 1 -- 172.21.15.2:0/822179514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7180081db0 con 0x7f71940add30 2024-08-17T02:46:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.551+0000 7f7192a00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7174065150 0x7f7174067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.551+0000 7f7192a00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7174065150 0x7f7174067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7184006e70 tx=0x7f7184008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.554+0000 7f718a000640 1 -- 172.21.15.2:0/822179514 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7180086070 con 0x7f71940add30 2024-08-17T02:46:18.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.784+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f719416ad90 con 0x7f71940add30 2024-08-17T02:46:18.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.787+0000 7f718a000640 1 -- 172.21.15.2:0/822179514 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161023 (secure 0 0 0) 0x7f719416ad90 con 0x7f71940add30 2024-08-17T02:46:18.790 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7174065150 msgr2=0x7f7174067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7174065150 0x7f7174067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7184006e70 tx=0x7f7184008040 comp rx=0 tx=0).stop 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 msgr2=0x7f7194152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194152570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f718000c810 tx=0x7f7180007bc0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 shutdown_connections 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71940ca050 0x7f719415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940add30 0x7f7194152570 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7174065150 0x7f7174067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 --2- 172.21.15.2:0/822179514 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f71940ad960 0x7f7194158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.790+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 >> 172.21.15.2:0/822179514 conn(0x7f7194066e60 msgr2=0x7f7194154870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.791+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 shutdown_connections 2024-08-17T02:46:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.791+0000 7f7199c00640 1 -- 172.21.15.2:0/822179514 wait complete. 2024-08-17T02:46:18.806 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":36682},{"type":"v1","addr":"172.21.15.2:6833","nonce":36682}]},"active_addr":"172.21.15.2:6833/36682","active_change":"2024-08-17T02:45:59.002651+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1345310861}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":960487788}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3151326584}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1508952374}]}]} 2024-08-17T02:46:18.810 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:46:18.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:46:18.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:18.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.960+0000 7f2ab4200640 1 Processor -- start 2024-08-17T02:46:18.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.960+0000 7f2ab4200640 1 -- start start 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab4200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2aac0afca0 0x7f2aac0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab4200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac0c92b0 con 0x7f2aac0acf10 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab4200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac0ad480 con 0x7f2aac1590b0 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab4200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac0b0980 con 0x7f2aac0afca0 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab1800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2aac0afca0 0x7f2aac0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab0e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2aac0acf10 0x7f2aac1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44080/0 (socket says 172.21.15.2:44080) 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab0e00640 1 -- 172.21.15.2:0/4264968569 learned_addr learned my addr 172.21.15.2:0/4264968569 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab1800640 1 -- 172.21.15.2:0/4264968569 >> v1:172.21.15.26:6789/0 conn(0x7f2aac1590b0 legacy=0x7f2aac0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab1800640 1 -- 172.21.15.2:0/4264968569 >> v1:172.21.15.2:6789/0 conn(0x7f2aac0acf10 legacy=0x7f2aac1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.962+0000 7f2ab1800640 1 -- 172.21.15.2:0/4264968569 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac0ad760 con 0x7f2aac0afca0 2024-08-17T02:46:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.963+0000 7f2ab1800640 1 --2- 172.21.15.2:0/4264968569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0afca0 0x7f2aac0b0070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009850 tx=0x7f2aa00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b565632dd111fc8e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2aabe00640 1 -- 172.21.15.2:0/4264968569 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa002ae20 con 0x7f2aac0afca0 2024-08-17T02:46:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2aabe00640 1 -- 172.21.15.2:0/4264968569 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa0032440 con 0x7f2aac0afca0 2024-08-17T02:46:18.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2aabe00640 1 -- 172.21.15.2:0/4264968569 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0032820 con 0x7f2aac0afca0 2024-08-17T02:46:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2ab4200640 1 -- 172.21.15.2:0/4264968569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0afca0 msgr2=0x7f2aac0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2ab4200640 1 --2- 172.21.15.2:0/4264968569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0afca0 0x7f2aac0b0070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009850 tx=0x7f2aa00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2ab4200640 1 -- 172.21.15.2:0/4264968569 shutdown_connections 2024-08-17T02:46:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2ab4200640 1 --2- 172.21.15.2:0/4264968569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0afca0 0x7f2aac0b0070 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2ab4200640 1 -- 172.21.15.2:0/4264968569 >> 172.21.15.2:0/4264968569 conn(0x7f2aac066e60 msgr2=0x7f2aac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2ab4200640 1 -- 172.21.15.2:0/4264968569 shutdown_connections 2024-08-17T02:46:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.964+0000 7f2ab4200640 1 -- 172.21.15.2:0/4264968569 wait complete. 2024-08-17T02:46:18.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.966+0000 7f2ab4200640 1 Processor -- start 2024-08-17T02:46:18.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.966+0000 7f2ab4200640 1 -- start start 2024-08-17T02:46:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab4200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0acf10 0x7f2aac0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab4200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aac0afca0 0x7f2aac13f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab4200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2aac1590b0 0x7f2aac0c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab4200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac15df40 con 0x7f2aac0acf10 2024-08-17T02:46:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab4200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac15d330 con 0x7f2aac0afca0 2024-08-17T02:46:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab4200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac15d610 con 0x7f2aac1590b0 2024-08-17T02:46:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab1800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0acf10 0x7f2aac0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab1800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0acf10 0x7f2aac0c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44206/0 (socket says 172.21.15.2:44206) 2024-08-17T02:46:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab1800640 1 -- 172.21.15.2:0/1473371838 learned_addr learned my addr 172.21.15.2:0/1473371838 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab0e00640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aac0afca0 0x7f2aac13f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab2200640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2aac1590b0 0x7f2aac0c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab1800640 1 -- 172.21.15.2:0/1473371838 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2aac1590b0 msgr2=0x7f2aac0c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab1800640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2aac1590b0 0x7f2aac0c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab1800640 1 -- 172.21.15.2:0/1473371838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aac0afca0 msgr2=0x7f2aac13f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab1800640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aac0afca0 0x7f2aac13f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.967+0000 7f2ab1800640 1 -- 172.21.15.2:0/1473371838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0009390 con 0x7f2aac0acf10 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.968+0000 7f2ab1800640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0acf10 0x7f2aac0c50e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009360 tx=0x7f2aa0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.968+0000 7f2aa8c00640 1 -- 172.21.15.2:0/1473371838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0031de0 con 0x7f2aac0acf10 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.968+0000 7f2aa8c00640 1 -- 172.21.15.2:0/1473371838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa003d420 con 0x7f2aac0acf10 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.968+0000 7f2aa8c00640 1 -- 172.21.15.2:0/1473371838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa003d7e0 con 0x7f2aac0acf10 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.968+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac15d8f0 con 0x7f2aac0acf10 2024-08-17T02:46:18.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.968+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac0c5620 con 0x7f2aac0acf10 2024-08-17T02:46:18.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.969+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac063fb0 con 0x7f2aac0acf10 2024-08-17T02:46:18.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.970+0000 7f2aa8c00640 1 -- 172.21.15.2:0/1473371838 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2aa0039040 con 0x7f2aac0acf10 2024-08-17T02:46:18.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.971+0000 7f2aa8c00640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2a8c065150 0x7f2a8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:18.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.971+0000 7f2aa8c00640 1 -- 172.21.15.2:0/1473371838 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2aa00a2560 con 0x7f2aac0acf10 2024-08-17T02:46:18.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.971+0000 7f2ab0e00640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2a8c065150 0x7f2a8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:18.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.972+0000 7f2ab0e00640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2a8c065150 0x7f2a8c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a98007fd0 tx=0x7f2a98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:18.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:18.975+0000 7f2aa8c00640 1 -- 172.21.15.2:0/1473371838 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2aa0070580 con 0x7f2aac0acf10 2024-08-17T02:46:19.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.158+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2aac0accf0 con 0x7f2aac0acf10 2024-08-17T02:46:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.159+0000 7f2aa8c00640 1 -- 172.21.15.2:0/1473371838 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f2aa0073ba0 con 0x7f2aac0acf10 2024-08-17T02:46:19.160 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:19.160 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:19.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2a8c065150 msgr2=0x7f2a8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2a8c065150 0x7f2a8c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a98007fd0 tx=0x7f2a98009040 comp rx=0 tx=0).stop 2024-08-17T02:46:19.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0acf10 msgr2=0x7f2aac0c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0acf10 0x7f2aac0c50e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009360 tx=0x7f2aa0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:19.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 shutdown_connections 2024-08-17T02:46:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2a8c065150 0x7f2a8c067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2aac1590b0 0x7f2aac0c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2aac0afca0 0x7f2aac13f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 --2- 172.21.15.2:0/1473371838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aac0acf10 0x7f2aac0c50e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 >> 172.21.15.2:0/1473371838 conn(0x7f2aac066e60 msgr2=0x7f2aac15f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 shutdown_connections 2024-08-17T02:46:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.161+0000 7f2ab4200640 1 -- 172.21.15.2:0/1473371838 wait complete. 2024-08-17T02:46:19.177 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:46:19.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:19.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.328+0000 7f5429c00640 1 Processor -- start 2024-08-17T02:46:19.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.329+0000 7f5429c00640 1 -- start start 2024-08-17T02:46:19.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5429c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5424156f90 0x7f54240b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5429c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f542415a590 0x7f542413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5429c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542406d7c0 con 0x7f54240b0e30 2024-08-17T02:46:19.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5429c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542415ab30 con 0x7f5424156f90 2024-08-17T02:46:19.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5429c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542415ae10 con 0x7f542415a590 2024-08-17T02:46:19.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5423e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f54240b0e30 0x7f54240cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44094/0 (socket says 172.21.15.2:44094) 2024-08-17T02:46:19.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5423e00640 1 -- 172.21.15.2:0/4090179178 learned_addr learned my addr 172.21.15.2:0/4090179178 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:19.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f541be00640 1 --2- 172.21.15.2:0/4090179178 >> v2:172.21.15.2:3300/0 conn(0x7f5424156f90 0x7f54240b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5423400640 1 -- 172.21.15.2:0/4090179178 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477114549 0 0) 0x7f542406d7c0 con 0x7f54240b0e30 2024-08-17T02:46:19.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.330+0000 7f5429200640 1 --2- 172.21.15.2:0/4090179178 >> v2:172.21.15.26:3300/0 conn(0x7f542415a590 0x7f542413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.331+0000 7f5423400640 1 -- 172.21.15.2:0/4090179178 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54080034e0 con 0x7f54240b0e30 2024-08-17T02:46:19.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.331+0000 7f541be00640 1 -- 172.21.15.2:0/4090179178 >> v2:172.21.15.26:3300/0 conn(0x7f542415a590 msgr2=0x7f542413fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.331+0000 7f541be00640 1 --2- 172.21.15.2:0/4090179178 >> v2:172.21.15.26:3300/0 conn(0x7f542415a590 0x7f542413fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.331+0000 7f541be00640 1 -- 172.21.15.2:0/4090179178 >> v1:172.21.15.2:6789/0 conn(0x7f54240b0e30 legacy=0x7f54240cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.331+0000 7f541be00640 1 -- 172.21.15.2:0/4090179178 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542415b0f0 con 0x7f5424156f90 2024-08-17T02:46:19.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.331+0000 7f5429200640 1 --2- 172.21.15.2:0/4090179178 >> v2:172.21.15.26:3300/0 conn(0x7f542415a590 0x7f542413fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:19.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.332+0000 7f541be00640 1 --2- 172.21.15.2:0/4090179178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5424156f90 0x7f54240b1200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5424069f30 tx=0x7f540c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bff222b664518b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.332+0000 7f5423400640 1 -- 172.21.15.2:0/4090179178 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c02adb0 con 0x7f5424156f90 2024-08-17T02:46:19.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.332+0000 7f5423400640 1 -- 172.21.15.2:0/4090179178 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c032440 con 0x7f5424156f90 2024-08-17T02:46:19.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.332+0000 7f5423400640 1 -- 172.21.15.2:0/4090179178 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c032820 con 0x7f5424156f90 2024-08-17T02:46:19.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.333+0000 7f5429c00640 1 -- 172.21.15.2:0/4090179178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5424156f90 msgr2=0x7f54240b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.333+0000 7f5429c00640 1 --2- 172.21.15.2:0/4090179178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5424156f90 0x7f54240b1200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5424069f30 tx=0x7f540c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.333+0000 7f5429c00640 1 -- 172.21.15.2:0/4090179178 shutdown_connections 2024-08-17T02:46:19.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.333+0000 7f5429c00640 1 --2- 172.21.15.2:0/4090179178 >> v2:172.21.15.26:3300/0 conn(0x7f542415a590 0x7f542413fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.333+0000 7f5429c00640 1 --2- 172.21.15.2:0/4090179178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5424156f90 0x7f54240b1200 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.333+0000 7f5429c00640 1 -- 172.21.15.2:0/4090179178 >> 172.21.15.2:0/4090179178 conn(0x7f5424062af0 msgr2=0x7f5424062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.333+0000 7f5429c00640 1 -- 172.21.15.2:0/4090179178 shutdown_connections 2024-08-17T02:46:19.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.333+0000 7f5429c00640 1 -- 172.21.15.2:0/4090179178 wait complete. 2024-08-17T02:46:19.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.334+0000 7f5429c00640 1 Processor -- start 2024-08-17T02:46:19.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.334+0000 7f5429c00640 1 -- start start 2024-08-17T02:46:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54240b0e30 0x7f5424168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5424156f90 0x7f542413d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415a590 0x7f54240c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54241538a0 con 0x7f542415a590 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542413e7c0 con 0x7f54240b0e30 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542413dbb0 con 0x7f5424156f90 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415a590 0x7f54240c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415a590 0x7f54240c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44232/0 (socket says 172.21.15.2:44232) 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.335+0000 7f5429200640 1 -- 172.21.15.2:0/1156250311 learned_addr learned my addr 172.21.15.2:0/1156250311 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f541be00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5424156f90 0x7f542413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f5423e00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54240b0e30 0x7f5424168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f5429200640 1 -- 172.21.15.2:0/1156250311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5424156f90 msgr2=0x7f542413d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f5429200640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5424156f90 0x7f542413d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f5429200640 1 -- 172.21.15.2:0/1156250311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54240b0e30 msgr2=0x7f5424168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f5429200640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54240b0e30 0x7f5424168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f5429200640 1 -- 172.21.15.2:0/1156250311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c009390 con 0x7f542415a590 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f5429200640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415a590 0x7f54240c5670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f541c009fc0 tx=0x7f541c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f541b400640 1 -- 172.21.15.2:0/1156250311 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00de80 con 0x7f542415a590 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f541b400640 1 -- 172.21.15.2:0/1156250311 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00f040 con 0x7f542415a590 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542413de90 con 0x7f542415a590 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.336+0000 7f541b400640 1 -- 172.21.15.2:0/1156250311 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c015690 con 0x7f542415a590 2024-08-17T02:46:19.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.337+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542413e450 con 0x7f542415a590 2024-08-17T02:46:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.338+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542413e930 con 0x7f542415a590 2024-08-17T02:46:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.338+0000 7f541b400640 1 -- 172.21.15.2:0/1156250311 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f541c01e3b0 con 0x7f542415a590 2024-08-17T02:46:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.339+0000 7f541b400640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5400065150 0x7f5400067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.339+0000 7f541b400640 1 -- 172.21.15.2:0/1156250311 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f541c0829e0 con 0x7f542415a590 2024-08-17T02:46:19.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.339+0000 7f5423e00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5400065150 0x7f5400067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.340+0000 7f5423e00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5400065150 0x7f5400067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f54240c5260 tx=0x7f5414009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.343+0000 7f541b400640 1 -- 172.21.15.2:0/1156250311 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f541c050ab0 con 0x7f542415a590 2024-08-17T02:46:19.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.527+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5424070720 con 0x7f542415a590 2024-08-17T02:46:19.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.528+0000 7f541b400640 1 -- 172.21.15.2:0/1156250311 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f541c01f440 con 0x7f542415a590 2024-08-17T02:46:19.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:19.529 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.530+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5400065150 msgr2=0x7f5400067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.530+0000 7f5429c00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5400065150 0x7f5400067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f54240c5260 tx=0x7f5414009040 comp rx=0 tx=0).stop 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415a590 msgr2=0x7f54240c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415a590 0x7f54240c5670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f541c009fc0 tx=0x7f541c0099b0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 shutdown_connections 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f542415a590 0x7f54240c5670 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5400065150 0x7f5400067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5424156f90 0x7f542413d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 --2- 172.21.15.2:0/1156250311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54240b0e30 0x7f5424168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 >> 172.21.15.2:0/1156250311 conn(0x7f5424062af0 msgr2=0x7f5424154150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 shutdown_connections 2024-08-17T02:46:19.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.531+0000 7f5429c00640 1 -- 172.21.15.2:0/1156250311 wait complete. 2024-08-17T02:46:19.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:46:19.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:46:19.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:46:19.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:46:19.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:46:19.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:46:19.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:46:19.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:46:19.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.821+0000 7fdda5e00640 1 Processor -- start 2024-08-17T02:46:19.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.822+0000 7fdda5e00640 1 -- start start 2024-08-17T02:46:19.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.823+0000 7fdda5e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda0158dd0 0x7fdda006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7fdda5e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdda006ead0 0x7fdda00b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7fdda5e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda006ef10 con 0x7fdda0158a00 2024-08-17T02:46:19.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7fdda5e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda0159200 con 0x7fdda006ead0 2024-08-17T02:46:19.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7fdda5e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00cbc50 con 0x7fdda0158dd0 2024-08-17T02:46:19.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7fdda4a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdda0158a00 0x7fdda00cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44108/0 (socket says 172.21.15.2:44108) 2024-08-17T02:46:19.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7fdda4a00640 1 -- 172.21.15.2:0/3894711671 learned_addr learned my addr 172.21.15.2:0/3894711671 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:19.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7f6577200640 1 Processor -- start 2024-08-17T02:46:19.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7fdda5400640 1 --2- 172.21.15.2:0/3894711671 >> v2:172.21.15.26:3300/0 conn(0x7fdda006ead0 0x7fdda00b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7fdd9fe00640 1 --2- 172.21.15.2:0/3894711671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda0158dd0 0x7fdda006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.824+0000 7f6577200640 1 -- start start 2024-08-17T02:46:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.825+0000 7fdd9fe00640 1 -- 172.21.15.2:0/3894711671 >> v2:172.21.15.26:3300/0 conn(0x7fdda006ead0 msgr2=0x7fdda00b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.825+0000 7fdd9fe00640 1 --2- 172.21.15.2:0/3894711671 >> v2:172.21.15.26:3300/0 conn(0x7fdda006ead0 0x7fdda00b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.825+0000 7fdd9fe00640 1 -- 172.21.15.2:0/3894711671 >> v1:172.21.15.2:6789/0 conn(0x7fdda0158a00 legacy=0x7fdda00cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.825+0000 7fdd9fe00640 1 -- 172.21.15.2:0/3894711671 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda00cbf30 con 0x7fdda0158dd0 2024-08-17T02:46:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.825+0000 7fdda5400640 1 --2- 172.21.15.2:0/3894711671 >> v2:172.21.15.26:3300/0 conn(0x7fdda006ead0 0x7fdda00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:19.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.826+0000 7f6577200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6578158a00 0x7f6578158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.826+0000 7f17d1400640 1 Processor -- start 2024-08-17T02:46:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.826+0000 7f6577200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65780cb190 0x7f65780cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.826+0000 7fdd9fe00640 1 --2- 172.21.15.2:0/3894711671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda0158dd0 0x7fdda006e590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdda0159340 tx=0x7fdd8c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=922f857b130ce80c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f656fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65780cb190 0x7f65780cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f656fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65780cb190 0x7f65780cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44244/0 (socket says 172.21.15.2:44244) 2024-08-17T02:46:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f6577200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65780cbc50 con 0x7f657806e590 2024-08-17T02:46:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f6577200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65780cbf30 con 0x7f65780cb190 2024-08-17T02:46:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f6577200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780cc210 con 0x7f6578158a00 2024-08-17T02:46:19.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f656fe00640 1 -- 172.21.15.2:0/1636040181 learned_addr learned my addr 172.21.15.2:0/1636040181 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7fdd9f400640 1 -- 172.21.15.2:0/3894711671 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c02ace0 con 0x7fdda0158dd0 2024-08-17T02:46:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f17d1400640 1 -- start start 2024-08-17T02:46:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f656fe00640 1 -- 172.21.15.2:0/1636040181 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6578158a00 msgr2=0x7f6578158dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:46:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f656fe00640 1 --2- 172.21.15.2:0/1636040181 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6578158a00 0x7f6578158dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f656fe00640 1 -- 172.21.15.2:0/1636040181 >> v1:172.21.15.26:6789/0 conn(0x7f657806e590 legacy=0x7f65780683e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7f656fe00640 1 -- 172.21.15.2:0/1636040181 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780b2930 con 0x7f65780cb190 2024-08-17T02:46:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7fdd9f400640 1 -- 172.21.15.2:0/3894711671 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c02ae40 con 0x7fdda0158dd0 2024-08-17T02:46:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.827+0000 7fdd9f400640 1 -- 172.21.15.2:0/3894711671 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c032670 con 0x7fdda0158dd0 2024-08-17T02:46:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.829+0000 7fdda5e00640 1 -- 172.21.15.2:0/3894711671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda0158dd0 msgr2=0x7fdda006e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.829+0000 7f17d1400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17cc146940 0x7f17cc0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.829+0000 7f17d1400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0cd060 con 0x7f17cc0c6c40 2024-08-17T02:46:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.829+0000 7f17d1400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17cc0cd800 con 0x7f17cc146570 2024-08-17T02:46:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.829+0000 7f17d1400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17cc0cdae0 con 0x7f17cc146940 2024-08-17T02:46:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.829+0000 7fdda5e00640 1 --2- 172.21.15.2:0/3894711671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda0158dd0 0x7fdda006e590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdda0159340 tx=0x7fdd8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.829+0000 7f656fe00640 1 --2- 172.21.15.2:0/1636040181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65780cb190 0x7f65780cb5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6560009910 tx=0x7f65600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313c5ce81f01e00 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.829+0000 7f17d0a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f17cc0c6c40 0x7f17cc0cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44116/0 (socket says 172.21.15.2:44116) 2024-08-17T02:46:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.830+0000 7f6575400640 1 -- 172.21.15.2:0/1636040181 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656002add0 con 0x7f65780cb190 2024-08-17T02:46:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.830+0000 7f17cbe00640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f17cc146570 0x7f17cc0ca4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:46324/0 (socket says 172.21.15.2:46324) 2024-08-17T02:46:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.830+0000 7f17d0a00640 1 -- 172.21.15.2:0/911852763 learned_addr learned my addr 172.21.15.2:0/911852763 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.830+0000 7f17cb400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17cc146940 0x7f17cc0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.830+0000 7f6575400640 1 -- 172.21.15.2:0/1636040181 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6560032440 con 0x7f65780cb190 2024-08-17T02:46:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.830+0000 7f6575400640 1 -- 172.21.15.2:0/1636040181 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560032820 con 0x7f65780cb190 2024-08-17T02:46:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.830+0000 7f17cb400640 1 -- 172.21.15.2:0/911852763 >> v1:172.21.15.26:6789/0 conn(0x7f17cc146570 legacy=0x7f17cc0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.831+0000 7fdda5e00640 1 -- 172.21.15.2:0/3894711671 shutdown_connections 2024-08-17T02:46:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.831+0000 7fdda5e00640 1 --2- 172.21.15.2:0/3894711671 >> v2:172.21.15.26:3300/0 conn(0x7fdda006ead0 0x7fdda00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.831+0000 7fdda5e00640 1 --2- 172.21.15.2:0/3894711671 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda0158dd0 0x7fdda006e590 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.831+0000 7fdda5e00640 1 -- 172.21.15.2:0/3894711671 >> 172.21.15.2:0/3894711671 conn(0x7fdda00cfb80 msgr2=0x7fdda00cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.831+0000 7f17cb400640 1 -- 172.21.15.2:0/911852763 >> v1:172.21.15.2:6789/0 conn(0x7f17cc0c6c40 legacy=0x7f17cc0cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.831+0000 7f6577200640 1 -- 172.21.15.2:0/1636040181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65780cb190 msgr2=0x7f65780cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.831+0000 7f6577200640 1 --2- 172.21.15.2:0/1636040181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65780cb190 0x7f65780cb5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6560009910 tx=0x7f65600091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.832+0000 7f6577200640 1 -- 172.21.15.2:0/1636040181 shutdown_connections 2024-08-17T02:46:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.832+0000 7f6577200640 1 --2- 172.21.15.2:0/1636040181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65780cb190 0x7f65780cb5c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.832+0000 7f6577200640 1 --2- 172.21.15.2:0/1636040181 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6578158a00 0x7f6578158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.832+0000 7f6577200640 1 -- 172.21.15.2:0/1636040181 >> 172.21.15.2:0/1636040181 conn(0x7f65780cfb80 msgr2=0x7f65780cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.831+0000 7f17cb400640 1 -- 172.21.15.2:0/911852763 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0cddc0 con 0x7f17cc146940 2024-08-17T02:46:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.832+0000 7f6577200640 1 -- 172.21.15.2:0/1636040181 shutdown_connections 2024-08-17T02:46:19.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.832+0000 7f6577200640 1 -- 172.21.15.2:0/1636040181 wait complete. 2024-08-17T02:46:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.832+0000 7fdda5e00640 1 -- 172.21.15.2:0/3894711671 shutdown_connections 2024-08-17T02:46:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.833+0000 7fdda5e00640 1 -- 172.21.15.2:0/3894711671 wait complete. 2024-08-17T02:46:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.833+0000 7f17cb400640 1 --2- 172.21.15.2:0/911852763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146940 0x7f17cc0cc980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0097d0 tx=0x7f17bc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9865e79432f8564b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.833+0000 7f50e7200640 1 Processor -- start 2024-08-17T02:46:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.833+0000 7f17caa00640 1 -- 172.21.15.2:0/911852763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc02ac80 con 0x7f17cc146940 2024-08-17T02:46:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.834+0000 7f17caa00640 1 -- 172.21.15.2:0/911852763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc02ade0 con 0x7f17cc146940 2024-08-17T02:46:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.834+0000 7f17caa00640 1 -- 172.21.15.2:0/911852763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc032670 con 0x7f17cc146940 2024-08-17T02:46:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.835+0000 7f17d1400640 1 -- 172.21.15.2:0/911852763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146940 msgr2=0x7f17cc0cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.835+0000 7f17d1400640 1 --2- 172.21.15.2:0/911852763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146940 0x7f17cc0cc980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0097d0 tx=0x7f17bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.835+0000 7fde6f000640 1 Processor -- start 2024-08-17T02:46:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.835+0000 7f6577200640 1 Processor -- start 2024-08-17T02:46:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.835+0000 7f6577200640 1 -- start start 2024-08-17T02:46:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.835+0000 7fde6f000640 1 -- start start 2024-08-17T02:46:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.834+0000 7f50e7200640 1 -- start start 2024-08-17T02:46:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f50e7200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e80aae50 0x7f50e80ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f17d1400640 1 -- 172.21.15.2:0/911852763 shutdown_connections 2024-08-17T02:46:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f17d1400640 1 --2- 172.21.15.2:0/911852763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146940 0x7f17cc0cc980 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f17d1400640 1 -- 172.21.15.2:0/911852763 >> 172.21.15.2:0/911852763 conn(0x7f17cc087a80 msgr2=0x7f17cc06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f50e7200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f50e806e5f0 0x7f50e814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f50e7200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80ae2e0 con 0x7f50e8157e10 2024-08-17T02:46:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f50e7200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e8156030 con 0x7f50e806e5f0 2024-08-17T02:46:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f6577200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f657806e590 0x7f6578169590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f6577200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65780cb190 0x7f65780a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.835+0000 7fdda5e00640 1 Processor -- start 2024-08-17T02:46:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f6577200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6578158a00 0x7f65780a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f6577200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780a8640 con 0x7f6578158a00 2024-08-17T02:46:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f6577200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780c9ad0 con 0x7f65780cb190 2024-08-17T02:46:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f6577200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780a7d10 con 0x7f657806e590 2024-08-17T02:46:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f50e7200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8155160 con 0x7f50e80aae50 2024-08-17T02:46:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f50dfe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e80aae50 0x7f50e80ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f50dfe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e80aae50 0x7f50e80ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35404/0 (socket says 172.21.15.2:35404) 2024-08-17T02:46:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.836+0000 7f50dfe00640 1 -- 172.21.15.2:0/1057356956 learned_addr learned my addr 172.21.15.2:0/1057356956 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f50e6800640 1 --2- 172.21.15.2:0/1057356956 >> v2:172.21.15.26:3300/0 conn(0x7f50e806e5f0 0x7f50e814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7fe2ff000640 1 Processor -- start 2024-08-17T02:46:19.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f6575e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f657806e590 0x7f6578169590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f6575e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f657806e590 0x7f6578169590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35416/0 (socket says 172.21.15.2:35416) 2024-08-17T02:46:19.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f6575e00640 1 -- 172.21.15.2:0/1620159700 learned_addr learned my addr 172.21.15.2:0/1620159700 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f656fe00640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65780cb190 0x7f65780a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7fe2ff000640 1 -- start start 2024-08-17T02:46:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f17d1400640 1 -- 172.21.15.2:0/911852763 shutdown_connections 2024-08-17T02:46:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7f6575e00640 1 -- 172.21.15.2:0/1620159700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65780cb190 msgr2=0x7f65780a8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7f6575e00640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65780cb190 0x7f65780a8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7f6575e00640 1 -- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6578158a00 msgr2=0x7f65780a9010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:46:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6f000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fde681588d0 0x7fde680ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6f000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde68158ca0 0x7fde680cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6f000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde680cf1f0 0x7fde680cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6f000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde680cb280 con 0x7fde68158ca0 2024-08-17T02:46:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6f000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde680af600 con 0x7fde681588d0 2024-08-17T02:46:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6f000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde680afb60 con 0x7fde680cf1f0 2024-08-17T02:46:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7f6576800640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6578158a00 0x7f65780a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f17d1400640 1 -- 172.21.15.2:0/911852763 wait complete. 2024-08-17T02:46:19.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f50dfe00640 1 -- 172.21.15.2:0/1057356956 >> v2:172.21.15.26:3300/0 conn(0x7f50e806e5f0 msgr2=0x7f50e814ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f50dfe00640 1 --2- 172.21.15.2:0/1057356956 >> v2:172.21.15.26:3300/0 conn(0x7f50e806e5f0 0x7f50e814ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f50dfe00640 1 -- 172.21.15.2:0/1057356956 >> v1:172.21.15.26:6789/0 conn(0x7f50e8157e10 legacy=0x7f50e80aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7f50dfe00640 1 -- 172.21.15.2:0/1057356956 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8155420 con 0x7f50e80aae50 2024-08-17T02:46:19.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7f6575e00640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6578158a00 0x7f65780a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7f6575e00640 1 -- 172.21.15.2:0/1620159700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6560009450 con 0x7f657806e590 2024-08-17T02:46:19.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7f6575e00640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f657806e590 0x7f6578169590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f656800b510 tx=0x7f6568009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6dc00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fde681588d0 0x7fde680ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6dc00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fde681588d0 0x7fde680ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53078/0 (socket says 172.21.15.2:53078) 2024-08-17T02:46:19.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.838+0000 7fde6dc00640 1 -- 172.21.15.2:0/2821769484 learned_addr learned my addr 172.21.15.2:0/2821769484 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7fde6e600640 1 --2- 172.21.15.2:0/2821769484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde680cf1f0 0x7fde680cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7f50dfe00640 1 --2- 172.21.15.2:0/1057356956 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e80aae50 0x7f50e80ac7a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009fa0 tx=0x7f50d0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7a4a166d4322cee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800f510 con 0x7f657806e590 2024-08-17T02:46:19.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800f690 con 0x7f657806e590 2024-08-17T02:46:19.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800fa50 con 0x7f657806e590 2024-08-17T02:46:19.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7f50e5400640 1 -- 172.21.15.2:0/1057356956 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00304b0 con 0x7f50e80aae50 2024-08-17T02:46:19.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7f50e5400640 1 -- 172.21.15.2:0/1057356956 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0030610 con 0x7f50e80aae50 2024-08-17T02:46:19.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7f50e5400640 1 -- 172.21.15.2:0/1057356956 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00309f0 con 0x7f50e80aae50 2024-08-17T02:46:19.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7fde6d200640 1 --2- 172.21.15.2:0/2821769484 >> v2:172.21.15.2:3300/0 conn(0x7fde68158ca0 0x7fde680cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7fde6e600640 1 -- 172.21.15.2:0/2821769484 >> v2:172.21.15.26:3300/0 conn(0x7fde681588d0 msgr2=0x7fde680ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7fde6e600640 1 --2- 172.21.15.2:0/2821769484 >> v2:172.21.15.26:3300/0 conn(0x7fde681588d0 0x7fde680ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7fde6e600640 1 -- 172.21.15.2:0/2821769484 >> v2:172.21.15.2:3300/0 conn(0x7fde68158ca0 msgr2=0x7fde680cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65780a7ff0 con 0x7f657806e590 2024-08-17T02:46:19.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7f50e7200640 1 -- 172.21.15.2:0/1057356956 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e80aae50 msgr2=0x7f50e80ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7f50e7200640 1 --2- 172.21.15.2:0/1057356956 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e80aae50 0x7f50e80ac7a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009fa0 tx=0x7f50d0009840 comp rx=0 tx=0).stop 2024-08-17T02:46:19.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6578169ad0 con 0x7f657806e590 2024-08-17T02:46:19.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7fe2ff000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2f8067970 0x7fe2f80abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7fe2ff000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f8159320 0x7fe2f806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7fe2f7400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f8159320 0x7fe2f806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7f50e7200640 1 -- 172.21.15.2:0/1057356956 shutdown_connections 2024-08-17T02:46:19.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7fe2f7400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f8159320 0x7fe2f806d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35446/0 (socket says 172.21.15.2:35446) 2024-08-17T02:46:19.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7f50e7200640 1 --2- 172.21.15.2:0/1057356956 >> v2:172.21.15.26:3300/0 conn(0x7f50e806e5f0 0x7f50e814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7f50e7200640 1 --2- 172.21.15.2:0/1057356956 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e80aae50 0x7f50e80ac7a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7f50e7200640 1 -- 172.21.15.2:0/1057356956 >> 172.21.15.2:0/1057356956 conn(0x7f50e80678e0 msgr2=0x7f50e80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7fe2f7e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2f8067970 0x7fe2f80abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7fe2f7e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2f8067970 0x7fe2f80abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53090/0 (socket says 172.21.15.2:53090) 2024-08-17T02:46:19.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7fde6e600640 1 --2- 172.21.15.2:0/2821769484 >> v2:172.21.15.2:3300/0 conn(0x7fde68158ca0 0x7fde680cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.840+0000 7fde6e600640 1 -- 172.21.15.2:0/2821769484 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680d04e0 con 0x7fde680cf1f0 2024-08-17T02:46:19.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7f50e7200640 1 -- 172.21.15.2:0/1057356956 shutdown_connections 2024-08-17T02:46:19.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7fde6d200640 1 --2- 172.21.15.2:0/2821769484 >> v2:172.21.15.2:3300/0 conn(0x7fde68158ca0 0x7fde680cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:19.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7f50e7200640 1 -- 172.21.15.2:0/1057356956 wait complete. 2024-08-17T02:46:19.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6578070720 con 0x7f657806e590 2024-08-17T02:46:19.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fde6e600640 1 --2- 172.21.15.2:0/2821769484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde680cf1f0 0x7fde680cf640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde680c6bb0 tx=0x7fde60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3422d5a2e59f5ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.841+0000 7fe2f7400640 1 -- 172.21.15.2:0/412345406 learned_addr learned my addr 172.21.15.2:0/412345406 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fe2ff000640 1 -- 172.21.15.2:0/412345406 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f806e140 con 0x7fe2f806dd10 2024-08-17T02:46:19.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fe2ff000640 1 -- 172.21.15.2:0/412345406 --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f8155860 con 0x7fe2f8067970 2024-08-17T02:46:19.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fe2ff000640 1 -- 172.21.15.2:0/412345406 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f815bc90 con 0x7fe2f8159320 2024-08-17T02:46:19.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7f17d1400640 1 Processor -- start 2024-08-17T02:46:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.837+0000 7fdda5e00640 1 -- start start 2024-08-17T02:46:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7fdda5e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda006ead0 0x7fdda00c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7fdda5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdda0158a00 0x7fdda01798e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7fdda5e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdda0158dd0 0x7fdda0175a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7fdda5e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00b04a0 con 0x7fdda0158a00 2024-08-17T02:46:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7fdda5e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda0176300 con 0x7fdda0158dd0 2024-08-17T02:46:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.839+0000 7fdda5e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda01765e0 con 0x7fdda006ead0 2024-08-17T02:46:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fde67e00640 1 -- 172.21.15.2:0/2821769484 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60007550 con 0x7fde680cf1f0 2024-08-17T02:46:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fde67e00640 1 -- 172.21.15.2:0/2821769484 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6002d050 con 0x7fde680cf1f0 2024-08-17T02:46:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fde67e00640 1 -- 172.21.15.2:0/2821769484 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60007920 con 0x7fde680cf1f0 2024-08-17T02:46:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fe2f7400640 1 -- 172.21.15.2:0/412345406 >> v2:172.21.15.26:3300/0 conn(0x7fe2f8067970 msgr2=0x7fe2f80abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fe2f7400640 1 --2- 172.21.15.2:0/412345406 >> v2:172.21.15.26:3300/0 conn(0x7fe2f8067970 0x7fe2f80abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fe2f7400640 1 -- 172.21.15.2:0/412345406 >> v1:172.21.15.2:6789/0 conn(0x7fe2f806dd10 legacy=0x7fe2f80b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7fe2f7400640 1 -- 172.21.15.2:0/412345406 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80ac4f0 con 0x7fe2f8159320 2024-08-17T02:46:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fde6f000640 1 -- 172.21.15.2:0/2821769484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde680cf1f0 msgr2=0x7fde680cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.842+0000 7f17d1400640 1 -- start start 2024-08-17T02:46:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7f50e7200640 1 Processor -- start 2024-08-17T02:46:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fde6f000640 1 --2- 172.21.15.2:0/2821769484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde680cf1f0 0x7fde680cf640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde680c6bb0 tx=0x7fde60009780 comp rx=0 tx=0).stop 2024-08-17T02:46:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fe41c800640 1 Processor -- start 2024-08-17T02:46:19.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fe2f7400640 1 --2- 172.21.15.2:0/412345406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f8159320 0x7fe2f806d7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009910 tx=0x7fe2e40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84ff09bdf3b75ee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fde6f000640 1 -- 172.21.15.2:0/2821769484 shutdown_connections 2024-08-17T02:46:19.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fe41c800640 1 -- start start 2024-08-17T02:46:19.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7f17d1400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17cc0c6c40 0x7f17cc16dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fde6f000640 1 --2- 172.21.15.2:0/2821769484 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde680cf1f0 0x7fde680cf640 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fde6f000640 1 --2- 172.21.15.2:0/2821769484 >> v2:172.21.15.2:3300/0 conn(0x7fde68158ca0 0x7fde680cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fde6f000640 1 --2- 172.21.15.2:0/2821769484 >> v2:172.21.15.26:3300/0 conn(0x7fde681588d0 0x7fde680ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fe2f6a00640 1 -- 172.21.15.2:0/412345406 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4032440 con 0x7fe2f8159320 2024-08-17T02:46:19.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fde6f000640 1 -- 172.21.15.2:0/2821769484 >> 172.21.15.2:0/2821769484 conn(0x7fde68087a80 msgr2=0x7fde6806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fe2f6a00640 1 -- 172.21.15.2:0/412345406 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e40325a0 con 0x7fe2f8159320 2024-08-17T02:46:19.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fe2f6a00640 1 -- 172.21.15.2:0/412345406 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4032980 con 0x7fe2f8159320 2024-08-17T02:46:19.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7fde6f000640 1 -- 172.21.15.2:0/2821769484 shutdown_connections 2024-08-17T02:46:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17d1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146570 0x7f17cc0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17d1400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17cc146940 0x7f17cc142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17cbe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17cc0c6c40 0x7f17cc16dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17cbe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17cc0c6c40 0x7f17cc16dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35456/0 (socket says 172.21.15.2:35456) 2024-08-17T02:46:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17d1400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc16e5f0 con 0x7f17cc146570 2024-08-17T02:46:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17d1400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc06dd00 con 0x7f17cc146940 2024-08-17T02:46:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17cbe00640 1 -- 172.21.15.2:0/24528890 learned_addr learned my addr 172.21.15.2:0/24528890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc06e120 con 0x7f17cc0c6c40 2024-08-17T02:46:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7fe2ff000640 1 -- 172.21.15.2:0/412345406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f8159320 msgr2=0x7fe2f806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7fe2ff000640 1 --2- 172.21.15.2:0/412345406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f8159320 0x7fe2f806d7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009910 tx=0x7fe2e40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17cb400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146570 0x7f17cc0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7f50e7200640 1 -- start start 2024-08-17T02:46:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7f17d0a00640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17cc146940 0x7f17cc142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe41c800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe41c800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe4140aeda0 0x7fe4140b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe41c800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4140b0900 0x7fe41406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe41c800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4140aff30 con 0x7fe4140b0900 2024-08-17T02:46:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe41c800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4140af320 con 0x7fe4140aeda0 2024-08-17T02:46:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe41c800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140af600 con 0x7fe41415cdc0 2024-08-17T02:46:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe2ff000640 1 -- 172.21.15.2:0/412345406 shutdown_connections 2024-08-17T02:46:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe2ff000640 1 --2- 172.21.15.2:0/412345406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f8159320 0x7fe2f806d7d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe2ff000640 1 --2- 172.21.15.2:0/412345406 >> v2:172.21.15.26:3300/0 conn(0x7fe2f8067970 0x7fe2f80abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe2ff000640 1 -- 172.21.15.2:0/412345406 >> 172.21.15.2:0/412345406 conn(0x7fe2f8066e60 msgr2=0x7fe2f8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe2ff000640 1 -- 172.21.15.2:0/412345406 shutdown_connections 2024-08-17T02:46:19.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7f50e7200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e806e5f0 0x7f50e814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe2ff000640 1 -- 172.21.15.2:0/412345406 wait complete. 2024-08-17T02:46:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7f50e7200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e80aae50 0x7f50e806a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7fe419e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7f50e7200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50e8157e10 0x7f50e80c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.843+0000 7fdd9fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdda0158a00 0x7fdda01798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.843+0000 7fdda5400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdda0158dd0 0x7fdda0175a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.843+0000 7fdd9fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdda0158a00 0x7fdda01798e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44276/0 (socket says 172.21.15.2:44276) 2024-08-17T02:46:19.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.843+0000 7fdd9fe00640 1 -- 172.21.15.2:0/2887365544 learned_addr learned my addr 172.21.15.2:0/2887365544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fdda4a00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda006ead0 0x7fdda00c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fdda5400640 1 -- 172.21.15.2:0/2887365544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda006ead0 msgr2=0x7fdda00c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fdda5400640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda006ead0 0x7fdda00c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fdda5400640 1 -- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdda0158a00 msgr2=0x7fdda01798e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fdda5400640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdda0158a00 0x7fdda01798e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fdda5400640 1 -- 172.21.15.2:0/2887365544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd98009a20 con 0x7fdda0158dd0 2024-08-17T02:46:19.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fdda4a00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdda006ead0 0x7fdda00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:19.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7f50e7200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e814bd00 con 0x7f50e8157e10 2024-08-17T02:46:19.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.844+0000 7fdda5400640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdda0158dd0 0x7fdda0175a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009f10 tx=0x7fdd9800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.846+0000 7f50e7200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e806b010 con 0x7f50e80aae50 2024-08-17T02:46:19.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800cdb0 con 0x7fdda0158dd0 2024-08-17T02:46:19.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9800f040 con 0x7fdda0158dd0 2024-08-17T02:46:19.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7f17cb400640 1 -- 172.21.15.2:0/24528890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17cc0c6c40 msgr2=0x7f17cc16dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7f17cb400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17cc0c6c40 0x7f17cc16dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f17cb400640 1 -- 172.21.15.2:0/24528890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17cc146940 msgr2=0x7f17cc142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f17cb400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17cc146940 0x7f17cc142290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f17cb400640 1 -- 172.21.15.2:0/24528890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc009390 con 0x7f17cc146570 2024-08-17T02:46:19.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f17cbe00640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f17cc0c6c40 0x7f17cc16dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:19.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7f17d0a00640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17cc146940 0x7f17cc142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:19.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800cdb0 con 0x7fdda0158dd0 2024-08-17T02:46:19.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c009390 con 0x7fdda0158dd0 2024-08-17T02:46:19.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda0179e20 con 0x7fdda0158dd0 2024-08-17T02:46:19.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7f50dfe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e80aae50 0x7f50e806a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f50e6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50e8157e10 0x7f50e80c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f50dfe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e80aae50 0x7f50e806a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53136/0 (socket says 172.21.15.2:53136) 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f50e6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50e8157e10 0x7f50e80c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44304/0 (socket says 172.21.15.2:44304) 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f50dfe00640 1 -- 172.21.15.2:0/3940772225 learned_addr learned my addr 172.21.15.2:0/3940772225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7f50e7200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e806b2f0 con 0x7f50e806e5f0 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f50e5e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e806e5f0 0x7f50e814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.845+0000 7fde6f000640 1 -- 172.21.15.2:0/2821769484 wait complete. 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fde6f000640 1 Processor -- start 2024-08-17T02:46:19.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fde6f000640 1 -- start start 2024-08-17T02:46:19.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7f4212e00640 1 Processor -- start 2024-08-17T02:46:19.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fe41a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4140b0900 0x7fe41406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fe41a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4140b0900 0x7fe41406d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44300/0 (socket says 172.21.15.2:44300) 2024-08-17T02:46:19.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fe41a800640 1 -- 172.21.15.2:0/727055828 learned_addr learned my addr 172.21.15.2:0/727055828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fe419400640 1 --2- 172.21.15.2:0/727055828 >> v2:172.21.15.26:3300/0 conn(0x7fe4140aeda0 0x7fe4140b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fe41a800640 1 -- 172.21.15.2:0/727055828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 msgr2=0x7fe4140ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7fe41a800640 1 --2- 172.21.15.2:0/727055828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fe41a800640 1 -- 172.21.15.2:0/727055828 >> v2:172.21.15.26:3300/0 conn(0x7fe4140aeda0 msgr2=0x7fe4140b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fe41a800640 1 --2- 172.21.15.2:0/727055828 >> v2:172.21.15.26:3300/0 conn(0x7fe4140aeda0 0x7fe4140b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fe41a800640 1 -- 172.21.15.2:0/727055828 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140af8e0 con 0x7fe4140b0900 2024-08-17T02:46:19.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fe419400640 1 --2- 172.21.15.2:0/727055828 >> v2:172.21.15.26:3300/0 conn(0x7fe4140aeda0 0x7fe4140b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:19.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fe419e00640 1 --2- 172.21.15.2:0/727055828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:19.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fe2ff000640 1 Processor -- start 2024-08-17T02:46:19.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.848+0000 7fe2ff000640 1 -- start start 2024-08-17T02:46:19.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fe41a800640 1 --2- 172.21.15.2:0/727055828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4140b0900 0x7fe41406d7d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe4140cc970 tx=0x7fe4080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c55dcc1e0c9d744 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdda0070720 con 0x7fdda0158dd0 2024-08-17T02:46:19.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.847+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f656801a400 con 0x7f657806e590 2024-08-17T02:46:19.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fe418a00640 1 -- 172.21.15.2:0/727055828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40802ad40 con 0x7fe4140b0900 2024-08-17T02:46:19.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2ff000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f8067970 0x7fe2f80cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2ff000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f806dd10 0x7fe2f814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7f4212e00640 1 -- start start 2024-08-17T02:46:19.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7f17cb400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146570 0x7f17cc0b5510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0c6a30 tx=0x7f17bc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2ff000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8159320 0x7fe2f8156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2ff000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f816eb20 con 0x7fe2f8067970 2024-08-17T02:46:19.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2ff000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f8151a10 con 0x7fe2f8159320 2024-08-17T02:46:19.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2ff000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80cbfd0 con 0x7fe2f806dd10 2024-08-17T02:46:19.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2fd000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8159320 0x7fe2f8156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2fd000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8159320 0x7fe2f8156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53150/0 (socket says 172.21.15.2:53150) 2024-08-17T02:46:19.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2fd000640 1 -- 172.21.15.2:0/3437405074 learned_addr learned my addr 172.21.15.2:0/3437405074 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fe2f7400640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f806dd10 0x7fe2f814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fde6f000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680cf1f0 0x7fde681519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fde6f000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde681588d0 0x7fde680c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fde6f000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde68158ca0 0x7fde680c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fde6f000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680b3870 con 0x7fde68158ca0 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fde6f000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680b2c60 con 0x7fde680cf1f0 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.849+0000 7fde6f000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde680b2f40 con 0x7fde681588d0 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fde6e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde68158ca0 0x7fde680c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fde6e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde68158ca0 0x7fde680c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44310/0 (socket says 172.21.15.2:44310) 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fde6e600640 1 -- 172.21.15.2:0/156959763 learned_addr learned my addr 172.21.15.2:0/156959763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fde6dc00640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680cf1f0 0x7fde681519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.850+0000 7fde6d200640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde681588d0 0x7fde680c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fde6dc00640 1 -- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde681588d0 msgr2=0x7fde680c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fde6dc00640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde681588d0 0x7fde680c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fde6dc00640 1 -- 172.21.15.2:0/156959763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde68158ca0 msgr2=0x7fde680c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fde6dc00640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde68158ca0 0x7fde680c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fde6dc00640 1 -- 172.21.15.2:0/156959763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60009a20 con 0x7fde680cf1f0 2024-08-17T02:46:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fe418a00640 1 -- 172.21.15.2:0/727055828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408032440 con 0x7fe4140b0900 2024-08-17T02:46:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fe418a00640 1 -- 172.21.15.2:0/727055828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40802aea0 con 0x7fe4140b0900 2024-08-17T02:46:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc03e730 con 0x7f17cc146570 2024-08-17T02:46:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7f50e5e00640 1 -- 172.21.15.2:0/3940772225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e80aae50 msgr2=0x7f50e806a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7f50e5e00640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50e80aae50 0x7f50e806a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7f50e5e00640 1 -- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50e8157e10 msgr2=0x7f50e80c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc142c20 con 0x7f17cc146570 2024-08-17T02:46:19.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc15e110 con 0x7f17cc146570 2024-08-17T02:46:19.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7f656d600640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f65540652a0 0x7f6554067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fe2fd000640 1 -- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f806dd10 msgr2=0x7fe2f814c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fe2fd000640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f806dd10 0x7fe2f814c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fe2fd000640 1 -- 172.21.15.2:0/3437405074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f8067970 msgr2=0x7fe2f80cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fe2fd000640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f8067970 0x7fe2f80cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe41c800640 1 -- 172.21.15.2:0/727055828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4140b0900 msgr2=0x7fe41406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe41c800640 1 --2- 172.21.15.2:0/727055828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4140b0900 0x7fe41406d7d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe4140cc970 tx=0x7fe4080091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fe2fd000640 1 -- 172.21.15.2:0/3437405074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4009450 con 0x7fe2f8159320 2024-08-17T02:46:19.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7f656fe00640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f65540652a0 0x7f6554067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7f50e5e00640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50e8157e10 0x7f50e80c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7f50e5e00640 1 -- 172.21.15.2:0/3940772225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009ae0 con 0x7f50e806e5f0 2024-08-17T02:46:19.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7f50e6800640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50e8157e10 0x7f50e80c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:19.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe41c800640 1 -- 172.21.15.2:0/727055828 shutdown_connections 2024-08-17T02:46:19.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe41c800640 1 --2- 172.21.15.2:0/727055828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4140b0900 0x7fe41406d7d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe41c800640 1 --2- 172.21.15.2:0/727055828 >> v2:172.21.15.26:3300/0 conn(0x7fe4140aeda0 0x7fe4140b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe41c800640 1 --2- 172.21.15.2:0/727055828 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe41c800640 1 -- 172.21.15.2:0/727055828 >> 172.21.15.2:0/727055828 conn(0x7fe414066e60 msgr2=0x7fe414067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7f50e5e00640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e806e5f0 0x7f50e814b7c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50d800b490 tx=0x7f50d8006f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f4212e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f420c0b1000 0x7f420c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f4212e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0af600 con 0x7f420c0caf10 2024-08-17T02:46:19.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f4212e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0afb60 con 0x7f420c1588d0 2024-08-17T02:46:19.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f4212e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0d04e0 con 0x7f420c0b1000 2024-08-17T02:46:19.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f4211a00640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f420c1588d0 0x7f420c0ca800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:46344/0 (socket says 172.21.15.2:46344) 2024-08-17T02:46:19.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f4211a00640 1 -- 172.21.15.2:0/4057240301 learned_addr learned my addr 172.21.15.2:0/4057240301 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:19.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569516111 0 0) 0x7f420c0afb60 con 0x7f420c1588d0 2024-08-17T02:46:19.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f40034e0 con 0x7f420c1588d0 2024-08-17T02:46:19.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.851+0000 7fe2f7400640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f806dd10 0x7fe2f814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:19.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe2fd000640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8159320 0x7fe2f8156ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000c860 tx=0x7fe2f0001690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000ce50 con 0x7fe2f8159320 2024-08-17T02:46:19.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f000a850 con 0x7fe2f8159320 2024-08-17T02:46:19.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000ac10 con 0x7fe2f8159320 2024-08-17T02:46:19.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7fde6dc00640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680cf1f0 0x7fde681519e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00d890 tx=0x7fde5c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 <== mon.1 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1555241257 0 0) 0x7f41f40034e0 con 0x7f420c1588d0 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f420c0b1000 msgr2=0x7f420c0cf900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f420c0b1000 0x7f420c0cf900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 >> v1:172.21.15.2:6789/0 conn(0x7f420c0caf10 legacy=0x7f420c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0af830 con 0x7f420c1588d0 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 <== mon.1 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f4200001450 con 0x7f420c1588d0 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 >> v1:172.21.15.26:6789/0 conn(0x7f420c1588d0 legacy=0x7f420c0ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f4003a50 0x7f41f4003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f4004780 0x7f41f4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41f4005330 0x7f41f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0d04e0 con 0x7f41f4005330 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f400c260 con 0x7f41f4004780 2024-08-17T02:46:19.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f400c420 con 0x7f41f4003a50 2024-08-17T02:46:19.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc03e890 con 0x7f17cc146570 2024-08-17T02:46:19.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.852+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc03ec90 con 0x7f17cc146570 2024-08-17T02:46:19.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.853+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17cc070720 con 0x7f17cc146570 2024-08-17T02:46:19.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdd98003020 con 0x7fdda0158dd0 2024-08-17T02:46:19.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f4211a00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f4003a50 0x7f41f4003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f80cc2b0 con 0x7fe2f8159320 2024-08-17T02:46:19.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f814c830 con 0x7fe2f8159320 2024-08-17T02:46:19.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6568081eb0 con 0x7f657806e590 2024-08-17T02:46:19.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f656fe00640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f65540652a0 0x7f6554067750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6560034000 tx=0x7f6560032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f4211a00640 1 -- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f4004780 msgr2=0x7f41f4004bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f4211a00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41f4004780 0x7f41f4004bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f4211a00640 1 -- 172.21.15.2:0/4057240301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41f4005330 msgr2=0x7f41f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.854+0000 7f4211a00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41f4005330 0x7f41f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7f4211a00640 1 -- 172.21.15.2:0/4057240301 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0af830 con 0x7f41f4003a50 2024-08-17T02:46:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7f656d600640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f655406d3e0 0x7f655406f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 --> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f655406fea0 con 0x7f655406d3e0 2024-08-17T02:46:19.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6568084450 con 0x7f657806e590 2024-08-17T02:46:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c00de20 con 0x7fde680cf1f0 2024-08-17T02:46:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7f6576800640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f655406d3e0 0x7f655406f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c0098b0 con 0x7fde680cf1f0 2024-08-17T02:46:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c009c50 con 0x7fde680cf1f0 2024-08-17T02:46:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde680b3220 con 0x7fde680cf1f0 2024-08-17T02:46:19.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.855+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde68151f20 con 0x7fde680cf1f0 2024-08-17T02:46:19.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7fe41c800640 1 -- 172.21.15.2:0/727055828 shutdown_connections 2024-08-17T02:46:19.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7fe41c800640 1 -- 172.21.15.2:0/727055828 wait complete. 2024-08-17T02:46:19.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7f4211a00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f4003a50 0x7f41f4003e80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f420000c260 tx=0x7f4200001df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd45f3a021f9a95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f17bc031630 con 0x7f17cc146570 2024-08-17T02:46:19.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420002d070 con 0x7f41f4003a50 2024-08-17T02:46:19.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200007150 con 0x7f41f4003a50 2024-08-17T02:46:19.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7f6576800640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f655406d3e0 0x7f655406f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:19.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800f510 con 0x7f50e806e5f0 2024-08-17T02:46:19.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.856+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2f8063fb0 con 0x7fe2f8159320 2024-08-17T02:46:19.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde68070720 con 0x7fde680cf1f0 2024-08-17T02:46:19.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d800f670 con 0x7f50e806e5f0 2024-08-17T02:46:19.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800fa70 con 0x7f50e806e5f0 2024-08-17T02:46:19.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7fdd93e00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdd800651b0 0x7fdd80067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7f420be00640 1 -- 172.21.15.2:0/4057240301 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200007550 con 0x7f41f4003a50 2024-08-17T02:46:19.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7f4212e00640 1 -- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f4003a50 msgr2=0x7f41f4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:19.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7f4212e00640 1 --2- 172.21.15.2:0/4057240301 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f41f4003a50 0x7f41f4003e80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f420000c260 tx=0x7f4200001df0 comp rx=0 tx=0).stop 2024-08-17T02:46:19.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7f4212400640 1 -- 172.21.15.2:0/4057240301 reap_dead start 2024-08-17T02:46:19.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e806b5d0 con 0x7f50e806e5f0 2024-08-17T02:46:19.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e816d550 con 0x7f50e806e5f0 2024-08-17T02:46:19.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2f0003030 con 0x7fe2f8159320 2024-08-17T02:46:19.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.858+0000 7f4212e00640 1 -- 172.21.15.2:0/4057240301 shutdown_connections 2024-08-17T02:46:19.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.858+0000 7f4212e00640 1 -- 172.21.15.2:0/4057240301 >> 172.21.15.2:0/4057240301 conn(0x7f420c087a80 msgr2=0x7f420c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:19.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.858+0000 7f4212e00640 1 -- 172.21.15.2:0/4057240301 shutdown_connections 2024-08-17T02:46:19.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.858+0000 7fe41c800640 1 Processor -- start 2024-08-17T02:46:19.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.857+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd98082b50 con 0x7fdda0158dd0 2024-08-17T02:46:19.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50bc000fd0 con 0x7f50e806e5f0 2024-08-17T02:46:19.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7f4212e00640 1 -- 172.21.15.2:0/4057240301 wait complete. 2024-08-17T02:46:19.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.858+0000 7fe41c800640 1 -- start start 2024-08-17T02:46:19.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe2ef400640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2d8065220 0x7fe2d80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2f00823e0 con 0x7fe2f8159320 2024-08-17T02:46:19.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe2ef400640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fe2d806d430 0x7fe2d806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:19.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 --> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2d806fef0 con 0x7fe2d806d430 2024-08-17T02:46:19.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2f0084a20 con 0x7fe2f8159320 2024-08-17T02:46:20.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe41c800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4140aeda0 0x7fe4140ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe41c800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4140b0900 0x7fe4140a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe41c800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe41c800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140a5da0 con 0x7fe4140b0900 2024-08-17T02:46:20.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe41c800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140a4d00 con 0x7fe4140aeda0 2024-08-17T02:46:20.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fe41c800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140a4fe0 con 0x7fe41415cdc0 2024-08-17T02:46:20.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe419e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4140aeda0 0x7fe4140ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe41a800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe419400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4140b0900 0x7fe4140a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe41a800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140a95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35536/0 (socket says 172.21.15.2:35536) 2024-08-17T02:46:20.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe41a800640 1 -- 172.21.15.2:0/3417166498 learned_addr learned my addr 172.21.15.2:0/3417166498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.858+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde5c014410 con 0x7fde680cf1f0 2024-08-17T02:46:20.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fde64c00640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde48065220 0x7fde480676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fdda4a00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdd800651b0 0x7fdd80067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fdd93e00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7fdd8006d3c0 0x7fdd8006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 --> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd8006fe80 con 0x7fdd8006d3c0 2024-08-17T02:46:20.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.859+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd98087220 con 0x7fdda0158dd0 2024-08-17T02:46:20.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fdd9fe00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7fdd8006d3c0 0x7fdd8006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe2f7e00640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2d8065220 0x7fe2d80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe2f7400640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fe2d806d430 0x7fe2d806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe41a800640 1 -- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4140aeda0 msgr2=0x7fe4140ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe41a800640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4140aeda0 0x7fe4140ab390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe41a800640 1 -- 172.21.15.2:0/3417166498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4140b0900 msgr2=0x7fe4140a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7fe41a800640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4140b0900 0x7fe4140a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fe41a800640 1 -- 172.21.15.2:0/3417166498 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408009450 con 0x7fe41415cdc0 2024-08-17T02:46:20.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.860+0000 7f17c3400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f17ac0651d0 0x7f17ac067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fdda4a00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdd800651b0 0x7fdd80067660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd940050b0 tx=0x7fdd94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fdd9fe00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7fdd8006d3c0 0x7fdd8006f7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fde6d200640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde48065220 0x7fde480676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde5c082c80 con 0x7fde680cf1f0 2024-08-17T02:46:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fe2f7400640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fe2d806d430 0x7fe2d806f840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fe2f7e00640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2d8065220 0x7fe2d80676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80643d0 tx=0x7fe2e80090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fde64c00640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7fde4806d430 0x7fde4806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 --> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde4806fef0 con 0x7fde4806d430 2024-08-17T02:46:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde5c087220 con 0x7fde680cf1f0 2024-08-17T02:46:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17bc0a2630 con 0x7f17cc146570 2024-08-17T02:46:20.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7f17c3400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f17ac06d3e0 0x7f17ac06f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 --> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17ac06fea0 con 0x7f17ac06d3e0 2024-08-17T02:46:20.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17bc0a4bd0 con 0x7f17cc146570 2024-08-17T02:46:20.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.862+0000 7fe41a800640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140a95d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe408035040 tx=0x7fe408032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.862+0000 7f17cbe00640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f17ac0651d0 0x7f17ac067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.862+0000 7fde6d200640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde48065220 0x7fde480676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde54006fd0 tx=0x7fde54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.862+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 <== osd.7 v2:172.21.15.26:6824/37470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe2d806fef0 con 0x7fe2d806d430 2024-08-17T02:46:20.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.862+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408031b30 con 0x7fe41415cdc0 2024-08-17T02:46:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.862+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408031cd0 con 0x7fe41415cdc0 2024-08-17T02:46:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.862+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40803d690 con 0x7fe41415cdc0 2024-08-17T02:46:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.862+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4140a52c0 con 0x7fe41415cdc0 2024-08-17T02:46:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.863+0000 7f17d0a00640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f17ac06d3e0 0x7f17ac06f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.863+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4140a5880 con 0x7fe41415cdc0 2024-08-17T02:46:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.863+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 <== osd.1 v2:172.21.15.2:6808/36946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f655406fea0 con 0x7f655406d3e0 2024-08-17T02:46:20.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.863+0000 7fde6e600640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7fde4806d430 0x7fde4806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.863+0000 7f17cbe00640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f17ac0651d0 0x7f17ac067680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0aefa0 tx=0x7f17b8007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7f17d0a00640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f17ac06d3e0 0x7f17ac06f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 <== osd.2 v2:172.21.15.2:6824/36950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fdd8006fe80 con 0x7fdd8006d3c0 2024-08-17T02:46:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.863+0000 7f4212e00640 1 Processor -- start 2024-08-17T02:46:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.861+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f50d80358d0 con 0x7f50e806e5f0 2024-08-17T02:46:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7f50dd600640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f50c40652a0 0x7f50c4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d8081fa0 con 0x7f50e806e5f0 2024-08-17T02:46:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3f0000fd0 con 0x7fe41415cdc0 2024-08-17T02:46:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7fde6e600640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7fde4806d430 0x7fde4806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.865+0000 7f4212e00640 1 -- start start 2024-08-17T02:46:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7f50dd600640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f50c406d4b0 0x7f50c406f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 --> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50c406ff70 con 0x7f50c406d4b0 2024-08-17T02:46:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7f50dfe00640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f50c40652a0 0x7f50c4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.864+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d80822d0 con 0x7f50e806e5f0 2024-08-17T02:46:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.865+0000 7f50dfe00640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f50c40652a0 0x7f50c4067750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009880 tx=0x7f50d003b000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.866+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 <== osd.0 v2:172.21.15.2:6800/36944 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f17ac06fea0 con 0x7f17ac06d3e0 2024-08-17T02:46:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.866+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 <== osd.4 v2:172.21.15.26:6816/37447 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fde4806fef0 con 0x7fde4806d430 2024-08-17T02:46:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.866+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe408039040 con 0x7fe41415cdc0 2024-08-17T02:46:20.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.867+0000 7fe40d600640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.867+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4080a2130 con 0x7fe41415cdc0 2024-08-17T02:46:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.867+0000 7fe40d600640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7fe3f406d360 0x7fe3f406f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.867+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 --> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3f406fe20 con 0x7fe3f406d360 2024-08-17T02:46:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.867+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4080a4770 con 0x7fe41415cdc0 2024-08-17T02:46:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.867+0000 7fe419e00640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.868+0000 7f50e6800640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f50c406d4b0 0x7f50c406f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.868+0000 7fe419e00640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe41000d560 tx=0x7fe4100075a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.869+0000 7f50e6800640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f50c406d4b0 0x7f50c406f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.870+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 <== osd.3 v2:172.21.15.2:6816/36949 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f50c406ff70 con 0x7f50c406d4b0 2024-08-17T02:46:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.870+0000 7fe419400640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7fe3f406d360 0x7fe3f406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7fe419400640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7fe3f406d360 0x7fe3f406f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4212e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41f4003a50 0x7f420c1685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4212e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c168ae0 0x7f420c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4212e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f420c156fc0 0x7f420c0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4212e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c157440 con 0x7f41f4003a50 2024-08-17T02:46:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4212e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0b3940 con 0x7f420c168ae0 2024-08-17T02:46:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4212e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0b3c00 con 0x7f420c156fc0 2024-08-17T02:46:20.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4211000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c168ae0 0x7f420c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.872+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 <== osd.6 v2:172.21.15.26:6808/37446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe3f406fe20 con 0x7fe3f406d360 2024-08-17T02:46:20.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4212400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f420c156fc0 0x7f420c0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.872+0000 7f4211000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c168ae0 0x7f420c156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53166/0 (socket says 172.21.15.2:53166) 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.872+0000 7f4211000640 1 -- 172.21.15.2:0/618219876 learned_addr learned my addr 172.21.15.2:0/618219876 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.871+0000 7f4211a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41f4003a50 0x7f420c1685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.872+0000 7f4212400640 1 -- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c168ae0 msgr2=0x7f420c156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4212400640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f420c168ae0 0x7f420c156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4212400640 1 -- 172.21.15.2:0/618219876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41f4003a50 msgr2=0x7f420c1685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4212400640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41f4003a50 0x7f420c1685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4212400640 1 -- 172.21.15.2:0/618219876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0b3ee0 con 0x7f420c156fc0 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4211a00640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41f4003a50 0x7f420c1685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4212400640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f420c156fc0 0x7f420c0c90d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f420c0cd6a0 tx=0x7f42040096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204003da0 con 0x7f420c156fc0 2024-08-17T02:46:20.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4204006190 con 0x7f420c156fc0 2024-08-17T02:46:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.876+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204006550 con 0x7f420c156fc0 2024-08-17T02:46:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.877+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c0b41c0 con 0x7f420c156fc0 2024-08-17T02:46:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.877+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c0c9830 con 0x7f420c156fc0 2024-08-17T02:46:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.879+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f420c070720 con 0x7f420c156fc0 2024-08-17T02:46:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.881+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 --> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65780b0410 con 0x7f655406d3e0 2024-08-17T02:46:20.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.881+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f42040347f0 con 0x7f420c156fc0 2024-08-17T02:46:20.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.881+0000 7f656d600640 1 -- 172.21.15.2:0/1620159700 <== osd.1 v2:172.21.15.2:6808/36946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65780b0410 con 0x7f655406d3e0 2024-08-17T02:46:20.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.882+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f655406d3e0 msgr2=0x7f655406f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.882+0000 7f6577200640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f655406d3e0 0x7f655406f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.882+0000 7f4208c00640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f41ec065250 0x7f41ec067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4204081fc0 con 0x7f420c156fc0 2024-08-17T02:46:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f65540652a0 msgr2=0x7f6554067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f6577200640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f65540652a0 0x7f6554067750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6560034000 tx=0x7f6560032000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f657806e590 msgr2=0x7f6578169590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f6577200640 1 --2- 172.21.15.2:0/1620159700 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f657806e590 0x7f6578169590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f656800b510 tx=0x7f6568009060 comp rx=0 tx=0).stop 2024-08-17T02:46:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f6576800640 1 -- 172.21.15.2:0/1620159700 reap_dead start 2024-08-17T02:46:20.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 shutdown_connections 2024-08-17T02:46:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 >> 172.21.15.2:0/1620159700 conn(0x7f65780cfb80 msgr2=0x7f65780cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f4208c00640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7f41ec06d460 0x7f41ec06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 --> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41ec06ff20 con 0x7f41ec06d460 2024-08-17T02:46:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42040822b0 con 0x7f420c156fc0 2024-08-17T02:46:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.883+0000 7f4211a00640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f41ec065250 0x7f41ec067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.884+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 shutdown_connections 2024-08-17T02:46:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.884+0000 7f6577200640 1 -- 172.21.15.2:0/1620159700 wait complete. 2024-08-17T02:46:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.884+0000 7f4211a00640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f41ec065250 0x7f41ec067700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4200033000 tx=0x7f4200034000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.886+0000 7f4211000640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7f41ec06d460 0x7f41ec06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.886+0000 7f4211000640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7f41ec06d460 0x7f41ec06f870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.888+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 <== osd.5 v2:172.21.15.26:6800/37445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f41ec06ff20 con 0x7f41ec06d460 2024-08-17T02:46:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.894+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 --> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2f806e930 con 0x7fe2d806d430 2024-08-17T02:46:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.895+0000 7fe2ef400640 1 -- 172.21.15.2:0/3437405074 <== osd.7 v2:172.21.15.26:6824/37470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2f806e930 con 0x7fe2d806d430 2024-08-17T02:46:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.895+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 --> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde68088b20 con 0x7fde4806d430 2024-08-17T02:46:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.895+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fe2d806d430 msgr2=0x7fe2d806f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.895+0000 7fe2ff000640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fe2d806d430 0x7fe2d806f840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.896+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2d8065220 msgr2=0x7fe2d80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.896+0000 7fe2ff000640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2d8065220 0x7fe2d80676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80643d0 tx=0x7fe2e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.896+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8159320 msgr2=0x7fe2f8156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.896+0000 7fe2ff000640 1 --2- 172.21.15.2:0/3437405074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f8159320 0x7fe2f8156ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000c860 tx=0x7fe2f0001690 comp rx=0 tx=0).stop 2024-08-17T02:46:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.897+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 --> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdda006f480 con 0x7fdd8006d3c0 2024-08-17T02:46:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.897+0000 7fe2fd000640 1 -- 172.21.15.2:0/3437405074 reap_dead start 2024-08-17T02:46:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.897+0000 7fdd93e00640 1 -- 172.21.15.2:0/2887365544 <== osd.2 v2:172.21.15.2:6824/36950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdda006f480 con 0x7fdd8006d3c0 2024-08-17T02:46:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.897+0000 7fde64c00640 1 -- 172.21.15.2:0/156959763 <== osd.4 v2:172.21.15.26:6816/37447 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fde68088b20 con 0x7fde4806d430 2024-08-17T02:46:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.898+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7fde4806d430 msgr2=0x7fde4806f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.898+0000 7fde6f000640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7fde4806d430 0x7fde4806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.898+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde48065220 msgr2=0x7fde480676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.898+0000 7fde6f000640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde48065220 0x7fde480676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde54006fd0 tx=0x7fde54008040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.898+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680cf1f0 msgr2=0x7fde681519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.899+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 shutdown_connections 2024-08-17T02:46:20.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.899+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 >> 172.21.15.2:0/3437405074 conn(0x7fe2f8066e60 msgr2=0x7fe2f80ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.898+0000 7fde6f000640 1 --2- 172.21.15.2:0/156959763 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde680cf1f0 0x7fde681519e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00d890 tx=0x7fde5c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.898+0000 7fde6e600640 1 -- 172.21.15.2:0/156959763 reap_dead start 2024-08-17T02:46:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.899+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 shutdown_connections 2024-08-17T02:46:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.899+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7fdd8006d3c0 msgr2=0x7fdd8006f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.899+0000 7fdda5e00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7fdd8006d3c0 0x7fdd8006f7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.899+0000 7fe2ff000640 1 -- 172.21.15.2:0/3437405074 wait complete. 2024-08-17T02:46:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdd800651b0 msgr2=0x7fdd80067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fdda5e00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdd800651b0 0x7fdd80067660 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd940050b0 tx=0x7fdd94009040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdda0158dd0 msgr2=0x7fdda0175a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fdda5e00640 1 --2- 172.21.15.2:0/2887365544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdda0158dd0 0x7fdda0175a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009f10 tx=0x7fdd9800b040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 --> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50bc002ca0 con 0x7f50c406d4b0 2024-08-17T02:46:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fdda5400640 1 -- 172.21.15.2:0/2887365544 reap_dead start 2024-08-17T02:46:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 shutdown_connections 2024-08-17T02:46:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 >> 172.21.15.2:0/156959763 conn(0x7fde68087a80 msgr2=0x7fde680b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 shutdown_connections 2024-08-17T02:46:20.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 >> 172.21.15.2:0/2887365544 conn(0x7fdda00cfb80 msgr2=0x7fdda00cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.900+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 shutdown_connections 2024-08-17T02:46:20.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.901+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 shutdown_connections 2024-08-17T02:46:20.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.901+0000 7fde6f000640 1 -- 172.21.15.2:0/156959763 wait complete. 2024-08-17T02:46:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.901+0000 7fdda5e00640 1 -- 172.21.15.2:0/2887365544 wait complete. 2024-08-17T02:46:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.901+0000 7f50dd600640 1 -- 172.21.15.2:0/3940772225 <== osd.3 v2:172.21.15.2:6816/36949 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50bc002ca0 con 0x7f50c406d4b0 2024-08-17T02:46:20.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.902+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 --> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f17cc064550 con 0x7f17ac06d3e0 2024-08-17T02:46:20.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.903+0000 7f17c3400640 1 -- 172.21.15.2:0/24528890 <== osd.0 v2:172.21.15.2:6800/36944 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f17cc064550 con 0x7f17ac06d3e0 2024-08-17T02:46:20.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.903+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f50c406d4b0 msgr2=0x7f50c406f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.903+0000 7f50e7200640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f50c406d4b0 0x7f50c406f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.904+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 --> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3f0002ca0 con 0x7fe3f406d360 2024-08-17T02:46:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.904+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f50c40652a0 msgr2=0x7f50c4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.904+0000 7f50e7200640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f50c40652a0 0x7f50c4067750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009880 tx=0x7f50d003b000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.904+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e806e5f0 msgr2=0x7f50e814b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.904+0000 7f50e7200640 1 --2- 172.21.15.2:0/3940772225 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f50e806e5f0 0x7f50e814b7c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50d800b490 tx=0x7f50d8006f50 comp rx=0 tx=0).stop 2024-08-17T02:46:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.905+0000 7f50e6800640 1 -- 172.21.15.2:0/3940772225 reap_dead start 2024-08-17T02:46:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.905+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f17ac06d3e0 msgr2=0x7f17ac06f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.905+0000 7f17d1400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f17ac06d3e0 0x7f17ac06f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.905+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 shutdown_connections 2024-08-17T02:46:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.905+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 >> 172.21.15.2:0/3940772225 conn(0x7f50e80678e0 msgr2=0x7f50e80aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.905+0000 7fe40d600640 1 -- 172.21.15.2:0/3417166498 <== osd.6 v2:172.21.15.26:6808/37446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3f0002ca0 con 0x7fe3f406d360 2024-08-17T02:46:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.906+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f17ac0651d0 msgr2=0x7f17ac067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.906+0000 7f17d1400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f17ac0651d0 0x7f17ac067680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0aefa0 tx=0x7f17b8007ea0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.906+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146570 msgr2=0x7f17cc0b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.906+0000 7f17d1400640 1 --2- 172.21.15.2:0/24528890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17cc146570 0x7f17cc0b5510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0c6a30 tx=0x7f17bc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.906+0000 7f17d0a00640 1 -- 172.21.15.2:0/24528890 reap_dead start 2024-08-17T02:46:20.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 shutdown_connections 2024-08-17T02:46:20.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 >> 172.21.15.2:0/24528890 conn(0x7f17cc087a80 msgr2=0x7f17cc144520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7fe3f406d360 msgr2=0x7fe3f406f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7fe41c800640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7fe3f406d360 0x7fe3f406f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.040 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:20.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:46:20.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 shutdown_connections 2024-08-17T02:46:20.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 msgr2=0x7fe3f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7fe41c800640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe41000d560 tx=0x7fe4100075a0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 msgr2=0x7fe4140a95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7fe41c800640 1 --2- 172.21.15.2:0/3417166498 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe41415cdc0 0x7fe4140a95d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe408035040 tx=0x7fe408032000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.908+0000 7fe41a800640 1 -- 172.21.15.2:0/3417166498 reap_dead start 2024-08-17T02:46:20.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 shutdown_connections 2024-08-17T02:46:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.907+0000 7f17d1400640 1 -- 172.21.15.2:0/24528890 wait complete. 2024-08-17T02:46:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.908+0000 7f50e7200640 1 -- 172.21.15.2:0/3940772225 wait complete. 2024-08-17T02:46:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.908+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 shutdown_connections 2024-08-17T02:46:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.908+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 >> 172.21.15.2:0/3417166498 conn(0x7fe414066e60 msgr2=0x7fe41406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.908+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 shutdown_connections 2024-08-17T02:46:20.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.908+0000 7fe41c800640 1 -- 172.21.15.2:0/3417166498 wait complete. 2024-08-17T02:46:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.914+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 --> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f420c06e8b0 con 0x7f41ec06d460 2024-08-17T02:46:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.915+0000 7f4208c00640 1 -- 172.21.15.2:0/618219876 <== osd.5 v2:172.21.15.26:6800/37445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f420c06e8b0 con 0x7f41ec06d460 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7f41ec06d460 msgr2=0x7f41ec06f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7f41ec06d460 0x7f41ec06f870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f41ec065250 msgr2=0x7f41ec067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f41ec065250 0x7f41ec067700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4200033000 tx=0x7f4200034000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f420c156fc0 msgr2=0x7f420c0c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 --2- 172.21.15.2:0/618219876 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f420c156fc0 0x7f420c0c90d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f420c0cd6a0 tx=0x7f42040096c0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212400640 1 -- 172.21.15.2:0/618219876 reap_dead start 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 shutdown_connections 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 >> 172.21.15.2:0/618219876 conn(0x7f420c087a80 msgr2=0x7f420c0c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 shutdown_connections 2024-08-17T02:46:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:19.916+0000 7f4212e00640 1 -- 172.21.15.2:0/618219876 wait complete. 2024-08-17T02:46:20.045 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:20.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:46:20.046 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:46:20.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:46:20.047 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:46:20.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:46:20.048 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:46:20.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:46:20.049 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:20.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:46:20.050 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:20.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:46:20.051 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:46:20.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:46:20.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.353+0000 7fd3a9600640 1 Processor -- start 2024-08-17T02:46:20.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.353+0000 7fd3a9600640 1 -- start start 2024-08-17T02:46:20.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.355+0000 7fd3a9600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3a415a5f0 0x7fd3a415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.355+0000 7fd3a9600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3a40ad5c0 0x7fd3a40ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.355+0000 7fd3a9600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a4069e70 con 0x7fd3a4156950 2024-08-17T02:46:20.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.355+0000 7fd3a9600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a415af80 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.355+0000 7fd3a9600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a40adf40 con 0x7fd3a415a5f0 2024-08-17T02:46:20.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.357+0000 7fd3a2000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3a415a5f0 0x7fd3a415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.358+0000 7fd3a2000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3a415a5f0 0x7fd3a415aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53172/0 (socket says 172.21.15.2:53172) 2024-08-17T02:46:20.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.358+0000 7fd3a2000640 1 -- 172.21.15.2:0/1913543436 learned_addr learned my addr 172.21.15.2:0/1913543436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.357+0000 7fd3a3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3a40ad5c0 0x7fd3a40ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.357+0000 7fd3a2a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd3a4156950 0x7fd3a40aff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44160/0 (socket says 172.21.15.2:44160) 2024-08-17T02:46:20.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.358+0000 7fd3a2000640 1 -- 172.21.15.2:0/1913543436 >> v2:172.21.15.2:3300/0 conn(0x7fd3a40ad5c0 msgr2=0x7fd3a40ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.359+0000 7f3c41000640 1 Processor -- start 2024-08-17T02:46:20.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.359+0000 7fd3a2000640 1 --2- 172.21.15.2:0/1913543436 >> v2:172.21.15.2:3300/0 conn(0x7fd3a40ad5c0 0x7fd3a40ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.359+0000 7fd3a2000640 1 -- 172.21.15.2:0/1913543436 >> v1:172.21.15.2:6789/0 conn(0x7fd3a4156950 legacy=0x7fd3a40aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.359+0000 7fd3a2000640 1 -- 172.21.15.2:0/1913543436 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a406b400 con 0x7fd3a415a5f0 2024-08-17T02:46:20.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.359+0000 7fd3a3400640 1 --2- 172.21.15.2:0/1913543436 >> v2:172.21.15.2:3300/0 conn(0x7fd3a40ad5c0 0x7fd3a40ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:20.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.359+0000 7f3c41000640 1 -- start start 2024-08-17T02:46:20.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.360+0000 7f2833a00640 1 Processor -- start 2024-08-17T02:46:20.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.360+0000 7f2833a00640 1 -- start start 2024-08-17T02:46:20.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.361+0000 7fd3a2000640 1 --2- 172.21.15.2:0/1913543436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a415a5f0 0x7fd3a415aa40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40c8d90 tx=0x7fd39c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab948c4c9cc977b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.361+0000 7f3c41000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c34053cf0 0x7f3c34006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.361+0000 7f3c41000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c340066c0 0x7f3c34056db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.362+0000 7fd3a1600640 1 -- 172.21.15.2:0/1913543436 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c032400 con 0x7fd3a415a5f0 2024-08-17T02:46:20.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.362+0000 7fd3a1600640 1 -- 172.21.15.2:0/1913543436 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c02e050 con 0x7fd3a415a5f0 2024-08-17T02:46:20.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.362+0000 7fd3a1600640 1 -- 172.21.15.2:0/1913543436 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c0327f0 con 0x7fd3a415a5f0 2024-08-17T02:46:20.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.362+0000 7ff036400640 1 Processor -- start 2024-08-17T02:46:20.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7ff036400640 1 -- start start 2024-08-17T02:46:20.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f2833a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c15d5d0 0x7f282c0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f2833a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f282c0d03b0 0x7f282c0cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f2833a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c0cc8d0 con 0x7f282c15d200 2024-08-17T02:46:20.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f2833a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c0cd550 con 0x7f282c0d03b0 2024-08-17T02:46:20.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f2833a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c0ccbb0 con 0x7f282c15d5d0 2024-08-17T02:46:20.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7fd3a9600640 1 -- 172.21.15.2:0/1913543436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a415a5f0 msgr2=0x7fd3a415aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7fd3a9600640 1 --2- 172.21.15.2:0/1913543436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a415a5f0 0x7fd3a415aa40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40c8d90 tx=0x7fd39c009840 comp rx=0 tx=0).stop 2024-08-17T02:46:20.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f2831000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f282c15d200 0x7f282c0cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44170/0 (socket says 172.21.15.2:44170) 2024-08-17T02:46:20.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f2831000640 1 -- 172.21.15.2:0/1587426227 learned_addr learned my addr 172.21.15.2:0/1587426227 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:20.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f282be00640 1 --2- 172.21.15.2:0/1587426227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c15d5d0 0x7f282c0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f3c41000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c34007a80 con 0x7f3c340cfb40 2024-08-17T02:46:20.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f3c41000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c34006e70 con 0x7f3c34053cf0 2024-08-17T02:46:20.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f3c41000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c34007150 con 0x7f3c340066c0 2024-08-17T02:46:20.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.362+0000 7f3c3b400640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3c340cfb40 0x7f3c340535e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:46350/0 (socket says 172.21.15.2:46350) 2024-08-17T02:46:20.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f3c3b400640 1 -- 172.21.15.2:0/79399631 learned_addr learned my addr 172.21.15.2:0/79399631 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:20.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860593836 0 0) 0x7f3c34007a80 con 0x7f3c340cfb40 2024-08-17T02:46:20.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c240034e0 con 0x7f3c340cfb40 2024-08-17T02:46:20.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.363+0000 7f3c3aa00640 1 --2- 172.21.15.2:0/79399631 >> v2:172.21.15.2:3300/0 conn(0x7f3c34053cf0 0x7f3c34006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 <== mon.1 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1694653501 0 0) 0x7f3c240034e0 con 0x7f3c340cfb40 2024-08-17T02:46:20.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7fd3a9600640 1 -- 172.21.15.2:0/1913543436 shutdown_connections 2024-08-17T02:46:20.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 >> v2:172.21.15.26:3300/0 conn(0x7f3c340066c0 msgr2=0x7f3c34056db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3be00640 1 --2- 172.21.15.2:0/79399631 >> v2:172.21.15.26:3300/0 conn(0x7f3c340066c0 0x7f3c34056db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7fd3a9600640 1 --2- 172.21.15.2:0/1913543436 >> v2:172.21.15.2:3300/0 conn(0x7fd3a40ad5c0 0x7fd3a40ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7fd3a9600640 1 --2- 172.21.15.2:0/1913543436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a415a5f0 0x7fd3a415aa40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7fd3a9600640 1 -- 172.21.15.2:0/1913543436 >> 172.21.15.2:0/1913543436 conn(0x7fd3a40c8260 msgr2=0x7fd3a40c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f282b400640 1 -- 172.21.15.2:0/1587426227 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772954052 0 0) 0x7f282c0cc8d0 con 0x7f282c15d200 2024-08-17T02:46:20.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f282b400640 1 -- 172.21.15.2:0/1587426227 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28100034e0 con 0x7f282c15d200 2024-08-17T02:46:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 --2- 172.21.15.2:0/79399631 >> v2:172.21.15.26:3300/0 conn(0x7f3c340066c0 0x7f3c34056db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 >> v2:172.21.15.2:3300/0 conn(0x7f3c34053cf0 msgr2=0x7f3c34006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 --2- 172.21.15.2:0/79399631 >> v2:172.21.15.2:3300/0 conn(0x7f3c34053cf0 0x7f3c34006180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34007430 con 0x7f3c340cfb40 2024-08-17T02:46:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 <== mon.1 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f3c28004e50 con 0x7f3c340cfb40 2024-08-17T02:46:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 >> v1:172.21.15.26:6789/0 conn(0x7f3c340cfb40 legacy=0x7f3c340535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24003a50 0x7f3c24003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c24004780 0x7f3c24004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c24005250 0x7f3c2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34006e70 con 0x7f3c24003a50 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.364+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34007150 con 0x7f3c24004780 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2400c290 con 0x7f3c24005250 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7f3c3aa00640 1 --2- 172.21.15.2:0/79399631 >> v2:172.21.15.2:3300/0 conn(0x7f3c34053cf0 0x7f3c34006180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7ff036400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff028008b30 0x7ff028055990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7ff036400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff028053140 con 0x7ff0280e62c0 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7ff036400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff028052530 con 0x7ff02800e000 2024-08-17T02:46:20.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7ff036400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff028052810 con 0x7ff028008b30 2024-08-17T02:46:20.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7fd3a9600640 1 -- 172.21.15.2:0/1913543436 shutdown_connections 2024-08-17T02:46:20.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7f3c3be00640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c24005250 0x7f3c2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7f3c3aa00640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c24004780 0x7f3c24004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7f3c3b400640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24003a50 0x7f3c24003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7ff035000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff0280e62c0 0x7ff02800d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44178/0 (socket says 172.21.15.2:44178) 2024-08-17T02:46:20.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7ff035000640 1 -- 172.21.15.2:0/1979842165 learned_addr learned my addr 172.21.15.2:0/1979842165 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:20.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7f3c3be00640 1 -- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c24004780 msgr2=0x7f3c24004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7f3c3be00640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c24004780 0x7f3c24004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7f3c3be00640 1 -- 172.21.15.2:0/79399631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24003a50 msgr2=0x7f3c24003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7f3c3be00640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24003a50 0x7f3c24003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7fd3a9600640 1 -- 172.21.15.2:0/1913543436 wait complete. 2024-08-17T02:46:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.367+0000 7eff3fe00640 1 Processor -- start 2024-08-17T02:46:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.365+0000 7f2831a00640 1 --2- 172.21.15.2:0/1587426227 >> v2:172.21.15.26:3300/0 conn(0x7f282c0d03b0 0x7f282c0cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7f282be00640 1 -- 172.21.15.2:0/1587426227 >> v2:172.21.15.26:3300/0 conn(0x7f282c0d03b0 msgr2=0x7f282c0cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.368+0000 7fd3a9600640 1 Processor -- start 2024-08-17T02:46:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.367+0000 7f282be00640 1 --2- 172.21.15.2:0/1587426227 >> v2:172.21.15.26:3300/0 conn(0x7f282c0d03b0 0x7f282c0cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.367+0000 7f282be00640 1 -- 172.21.15.2:0/1587426227 >> v1:172.21.15.2:6789/0 conn(0x7f282c15d200 legacy=0x7f282c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.367+0000 7f282be00640 1 -- 172.21.15.2:0/1587426227 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0cce90 con 0x7f282c15d5d0 2024-08-17T02:46:20.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.368+0000 7f339ce00640 1 Processor -- start 2024-08-17T02:46:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.368+0000 7fd3a9600640 1 -- start start 2024-08-17T02:46:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.366+0000 7f3c3be00640 1 -- 172.21.15.2:0/79399631 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34007430 con 0x7f3c24005250 2024-08-17T02:46:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.367+0000 7f3c3be00640 1 -- 172.21.15.2:0/79399631 reap_dead start 2024-08-17T02:46:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.368+0000 7f3c3be00640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c24005250 0x7f3c2400b9d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c065f30 tx=0x7f3c3c064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=620a4681990e52be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.367+0000 7ff035a00640 1 --2- 172.21.15.2:0/1979842165 >> v2:172.21.15.26:3300/0 conn(0x7ff028008b30 0x7ff028055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.368+0000 7ff035a00640 1 -- 172.21.15.2:0/1979842165 >> v1:172.21.15.26:6789/0 conn(0x7ff02800e000 legacy=0x7ff028055280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.368+0000 7ff035a00640 1 -- 172.21.15.2:0/1979842165 >> v1:172.21.15.2:6789/0 conn(0x7ff0280e62c0 legacy=0x7ff02800d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.368+0000 7ff035a00640 1 -- 172.21.15.2:0/1979842165 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff028052af0 con 0x7ff028008b30 2024-08-17T02:46:20.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.367+0000 7eff3fe00640 1 -- start start 2024-08-17T02:46:20.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7f2831a00640 1 --2- 172.21.15.2:0/1587426227 >> v2:172.21.15.26:3300/0 conn(0x7f282c0d03b0 0x7f282c0cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:20.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7eff3fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 0x7eff400ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7eff3fe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff400b0140 0x7eff400b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7eff3fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff4006d5e0 0x7eff4006da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0a1b90 con 0x7f3c24005250 2024-08-17T02:46:20.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0a1cf0 con 0x7f3c24005250 2024-08-17T02:46:20.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7f3c3a000640 1 -- 172.21.15.2:0/79399631 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0a9600 con 0x7f3c24005250 2024-08-17T02:46:20.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7f282be00640 1 --2- 172.21.15.2:0/1587426227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c15d5d0 0x7f282c0cc2d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f281c009e60 tx=0x7f281c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90e50396130b2b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7eff3fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff400b0ab0 con 0x7eff4006d5e0 2024-08-17T02:46:20.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7eff3fe00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4006df80 con 0x7eff400b0140 2024-08-17T02:46:20.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.369+0000 7eff3fe00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff400afcb0 con 0x7eff4015cdd0 2024-08-17T02:46:20.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a9600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3a40ad5c0 0x7fd3a4143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a9600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a4156950 0x7fd3a4159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a415a5f0 0x7fd3a4148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a9600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4149f50 con 0x7fd3a415a5f0 2024-08-17T02:46:20.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a9600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4167250 con 0x7fd3a4156950 2024-08-17T02:46:20.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a9600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a414aaa0 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7eff36000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff400b0140 0x7eff400b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7eff36000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff400b0140 0x7eff400b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53210/0 (socket says 172.21.15.2:53210) 2024-08-17T02:46:20.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7eff36000640 1 -- 172.21.15.2:0/3759519095 learned_addr learned my addr 172.21.15.2:0/3759519095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7eff3f400640 1 --2- 172.21.15.2:0/3759519095 >> v2:172.21.15.2:3300/0 conn(0x7eff4006d5e0 0x7eff4006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.368+0000 7f339ce00640 1 -- start start 2024-08-17T02:46:20.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f282b400640 1 -- 172.21.15.2:0/1587426227 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c007550 con 0x7f282c15d5d0 2024-08-17T02:46:20.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f282b400640 1 -- 172.21.15.2:0/1587426227 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c02d050 con 0x7f282c15d5d0 2024-08-17T02:46:20.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f282b400640 1 -- 172.21.15.2:0/1587426227 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c007920 con 0x7f282c15d5d0 2024-08-17T02:46:20.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7ff035a00640 1 --2- 172.21.15.2:0/1979842165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028008b30 0x7ff028055990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009850 tx=0x7ff01c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74610c82cd76667d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f3c41000640 1 -- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c24005250 msgr2=0x7f3c2400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f3c41000640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c24005250 0x7f3c2400b9d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c065f30 tx=0x7f3c3c064990 comp rx=0 tx=0).stop 2024-08-17T02:46:20.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a2000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a4156950 0x7fd3a4159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a2a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3a40ad5c0 0x7fd3a4143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a2a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3a40ad5c0 0x7fd3a4143580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35564/0 (socket says 172.21.15.2:35564) 2024-08-17T02:46:20.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7fd3a2a00640 1 -- 172.21.15.2:0/4207648495 learned_addr learned my addr 172.21.15.2:0/4207648495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7fd3a3400640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a415a5f0 0x7fd3a4148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7fd3a2a00640 1 -- 172.21.15.2:0/4207648495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a4156950 msgr2=0x7fd3a4159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7fd3a2a00640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a4156950 0x7fd3a4159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7fd3a2a00640 1 -- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a415a5f0 msgr2=0x7fd3a4148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7fd3a2a00640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a415a5f0 0x7fd3a4148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7fd3a2a00640 1 -- 172.21.15.2:0/4207648495 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c009ae0 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7fd3a3400640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a415a5f0 0x7fd3a4148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:20.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f2833a00640 1 -- 172.21.15.2:0/1587426227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c15d5d0 msgr2=0x7f282c0cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f2833a00640 1 --2- 172.21.15.2:0/1587426227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c15d5d0 0x7f282c0cc2d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f281c009e60 tx=0x7f281c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:20.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f339ce00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f339815cf30 0x7f339815dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f339ce00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cab20 0x7f33980c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f339ce00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980c7fc0 con 0x7f33980cb760 2024-08-17T02:46:20.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f339ce00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980c8260 con 0x7f339815cf30 2024-08-17T02:46:20.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f339ce00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c8540 con 0x7f33980cab20 2024-08-17T02:46:20.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f3397e00640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f33980cb760 0x7f339815ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:46366/0 (socket says 172.21.15.2:46366) 2024-08-17T02:46:20.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f3397e00640 1 -- 172.21.15.2:0/352411486 learned_addr learned my addr 172.21.15.2:0/352411486 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:20.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f3396a00640 1 --2- 172.21.15.2:0/352411486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cab20 0x7f33980c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7f3397400640 1 --2- 172.21.15.2:0/352411486 >> v2:172.21.15.26:3300/0 conn(0x7f339815cf30 0x7f339815dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7eff36000640 1 -- 172.21.15.2:0/3759519095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 msgr2=0x7eff400ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7eff36000640 1 --2- 172.21.15.2:0/3759519095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 0x7eff400ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7eff36000640 1 -- 172.21.15.2:0/3759519095 >> v2:172.21.15.2:3300/0 conn(0x7eff4006d5e0 msgr2=0x7eff4006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.370+0000 7eff36000640 1 --2- 172.21.15.2:0/3759519095 >> v2:172.21.15.2:3300/0 conn(0x7eff4006d5e0 0x7eff4006da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7eff36000640 1 -- 172.21.15.2:0/3759519095 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff400af0a0 con 0x7eff400b0140 2024-08-17T02:46:20.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.371+0000 7eff3f400640 1 --2- 172.21.15.2:0/3759519095 >> v2:172.21.15.2:3300/0 conn(0x7eff4006d5e0 0x7eff4006da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:20.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3c41000640 1 -- 172.21.15.2:0/79399631 shutdown_connections 2024-08-17T02:46:20.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3c41000640 1 --2- 172.21.15.2:0/79399631 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c24005250 0x7f3c2400b9d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3c41000640 1 -- 172.21.15.2:0/79399631 >> 172.21.15.2:0/79399631 conn(0x7f3c34055a10 msgr2=0x7f3c34055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7fd3a2a00640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3a40ad5c0 0x7fd3a4143580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd39400c5c0 tx=0x7fd394007ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7fd39a000640 1 -- 172.21.15.2:0/4207648495 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394007300 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7fd39a000640 1 -- 172.21.15.2:0/4207648495 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394007460 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3396a00640 1 -- 172.21.15.2:0/352411486 >> v2:172.21.15.26:3300/0 conn(0x7f339815cf30 msgr2=0x7f339815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3396a00640 1 --2- 172.21.15.2:0/352411486 >> v2:172.21.15.26:3300/0 conn(0x7f339815cf30 0x7f339815dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3ed1800640 1 Processor -- start 2024-08-17T02:46:20.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7fd39a000640 1 -- 172.21.15.2:0/4207648495 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940047a0 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7fd3a9600640 1 -- 172.21.15.2:0/4207648495 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a4149990 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3396a00640 1 -- 172.21.15.2:0/352411486 >> v1:172.21.15.26:6789/0 conn(0x7f33980cb760 legacy=0x7f339815ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3396a00640 1 -- 172.21.15.2:0/352411486 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980c8820 con 0x7f33980cab20 2024-08-17T02:46:20.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7fd3a9600640 1 -- 172.21.15.2:0/4207648495 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a4166ee0 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7f3c41000640 1 -- 172.21.15.2:0/79399631 shutdown_connections 2024-08-17T02:46:20.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f2833a00640 1 -- 172.21.15.2:0/1587426227 shutdown_connections 2024-08-17T02:46:20.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7f2833a00640 1 --2- 172.21.15.2:0/1587426227 >> v2:172.21.15.26:3300/0 conn(0x7f282c0d03b0 0x7f282c0cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7f2833a00640 1 --2- 172.21.15.2:0/1587426227 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c15d5d0 0x7f282c0cc2d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7f2833a00640 1 -- 172.21.15.2:0/1587426227 >> 172.21.15.2:0/1587426227 conn(0x7f282c068680 msgr2=0x7f282c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7ff02f400640 1 -- 172.21.15.2:0/1979842165 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c02ad90 con 0x7ff028008b30 2024-08-17T02:46:20.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7ff02f400640 1 -- 172.21.15.2:0/1979842165 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c032440 con 0x7ff028008b30 2024-08-17T02:46:20.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7ff02f400640 1 -- 172.21.15.2:0/1979842165 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c032820 con 0x7ff028008b30 2024-08-17T02:46:20.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7eff36000640 1 --2- 172.21.15.2:0/3759519095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff400b0140 0x7eff400b0570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff40068ee0 tx=0x7eff280091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=889de7b1cb37257c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7f3c41000640 1 -- 172.21.15.2:0/79399631 wait complete. 2024-08-17T02:46:20.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.372+0000 7f3ed1800640 1 -- start start 2024-08-17T02:46:20.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7eff3e000640 1 -- 172.21.15.2:0/3759519095 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2802adf0 con 0x7eff400b0140 2024-08-17T02:46:20.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.374+0000 7fd3a9600640 1 -- 172.21.15.2:0/4207648495 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a40ab090 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.374+0000 7ff036400640 1 -- 172.21.15.2:0/1979842165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028008b30 msgr2=0x7ff028055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.374+0000 7ff036400640 1 --2- 172.21.15.2:0/1979842165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028008b30 0x7ff028055990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009850 tx=0x7ff01c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7ff036400640 1 -- 172.21.15.2:0/1979842165 shutdown_connections 2024-08-17T02:46:20.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7ff036400640 1 --2- 172.21.15.2:0/1979842165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028008b30 0x7ff028055990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7ff036400640 1 -- 172.21.15.2:0/1979842165 >> 172.21.15.2:0/1979842165 conn(0x7ff02800a800 msgr2=0x7ff028056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7f2833a00640 1 -- 172.21.15.2:0/1587426227 shutdown_connections 2024-08-17T02:46:20.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7f2833a00640 1 -- 172.21.15.2:0/1587426227 wait complete. 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.374+0000 7f3396a00640 1 --2- 172.21.15.2:0/352411486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cab20 0x7f33980c9020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3384009850 tx=0x7f33840090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a2b2351838d4354 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3396000640 1 -- 172.21.15.2:0/352411486 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338402abd0 con 0x7f33980cab20 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3396000640 1 -- 172.21.15.2:0/352411486 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338402ad30 con 0x7f33980cab20 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3396000640 1 -- 172.21.15.2:0/352411486 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338402aea0 con 0x7f33980cab20 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7eff3e000640 1 -- 172.21.15.2:0/3759519095 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff28032440 con 0x7eff400b0140 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.373+0000 7eff3e000640 1 -- 172.21.15.2:0/3759519095 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28032820 con 0x7eff400b0140 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7eff3fe00640 1 -- 172.21.15.2:0/3759519095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff400b0140 msgr2=0x7eff400b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7eff3fe00640 1 --2- 172.21.15.2:0/3759519095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff400b0140 0x7eff400b0570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff40068ee0 tx=0x7eff280091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7eff3fe00640 1 -- 172.21.15.2:0/3759519095 shutdown_connections 2024-08-17T02:46:20.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7eff3fe00640 1 --2- 172.21.15.2:0/3759519095 >> v2:172.21.15.2:3300/0 conn(0x7eff4006d5e0 0x7eff4006da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7eff3fe00640 1 --2- 172.21.15.2:0/3759519095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff400b0140 0x7eff400b0570 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff40068ee0 tx=0x7eff280091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7eff3fe00640 1 --2- 172.21.15.2:0/3759519095 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 0x7eff400ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7eff3fe00640 1 -- 172.21.15.2:0/3759519095 >> 172.21.15.2:0/3759519095 conn(0x7eff40066e60 msgr2=0x7eff40067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3ed1800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3ecc0cfc10 0x7f3ecc0d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3ed1800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 0x7f3ecc0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3ed1800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc0d05b0 con 0x7f3ecc14fe00 2024-08-17T02:46:20.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3ed1800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc0af8e0 con 0x7f3ecc0cfc10 2024-08-17T02:46:20.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3ed1800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0cdef0 con 0x7f3ecc0ce380 2024-08-17T02:46:20.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f2833a00640 1 Processor -- start 2024-08-17T02:46:20.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7ff036400640 1 -- 172.21.15.2:0/1979842165 shutdown_connections 2024-08-17T02:46:20.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3c41000640 1 Processor -- start 2024-08-17T02:46:20.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3ecaa00640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3ecc14fe00 0x7f3ecc0cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:46382/0 (socket says 172.21.15.2:46382) 2024-08-17T02:46:20.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.375+0000 7f3ecaa00640 1 -- 172.21.15.2:0/1598393272 learned_addr learned my addr 172.21.15.2:0/1598393272 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:20.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7ff036400640 1 -- 172.21.15.2:0/1979842165 wait complete. 2024-08-17T02:46:20.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7eff3fe00640 1 -- 172.21.15.2:0/3759519095 shutdown_connections 2024-08-17T02:46:20.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ecb400640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 0x7f3ecc0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172767488 0 0) 0x7f3ebc001110 con 0x7f3ecc14fe00 2024-08-17T02:46:20.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb00034e0 con 0x7f3ecc14fe00 2024-08-17T02:46:20.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7fd39a000640 1 -- 172.21.15.2:0/4207648495 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd394004bf0 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3eca000640 1 --2- 172.21.15.2:0/1598393272 >> v2:172.21.15.2:3300/0 conn(0x7f3ecc0cfc10 0x7f3ecc0d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 <== mon.1 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876420299 0 0) 0x7f3eb00034e0 con 0x7f3ecc14fe00 2024-08-17T02:46:20.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7eff3fe00640 1 -- 172.21.15.2:0/3759519095 wait complete. 2024-08-17T02:46:20.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 msgr2=0x7f3ecc0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 0x7f3ecc0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 >> v2:172.21.15.2:3300/0 conn(0x7f3ecc0cfc10 msgr2=0x7f3ecc0d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 --2- 172.21.15.2:0/1598393272 >> v2:172.21.15.2:3300/0 conn(0x7f3ecc0cfc10 0x7f3ecc0d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0ccf10 con 0x7f3ecc14fe00 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 <== mon.1 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f3ebc001600 con 0x7f3ecc14fe00 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 >> v1:172.21.15.26:6789/0 conn(0x7f3ecc14fe00 legacy=0x7f3ecc0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3ec9600640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0003a50 0x7f3eb0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3ec9600640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb0004780 0x7f3eb0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3ec9600640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 0x7f3eb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0af8e0 con 0x7f3eb0003a50 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0cdef0 con 0x7f3eb0004780 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb0005530 con 0x7f3ecc0ce380 2024-08-17T02:46:20.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.376+0000 7f3c41000640 1 -- start start 2024-08-17T02:46:20.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3c41000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24005250 0x7f3c34052520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3c41000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c340cd8c0 0x7f3c34102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3c41000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c340cdcd0 0x7f3c34102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f339ce00640 1 -- 172.21.15.2:0/352411486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cab20 msgr2=0x7f33980c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f339ce00640 1 --2- 172.21.15.2:0/352411486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cab20 0x7f33980c9020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3384009850 tx=0x7f33840090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3eca000640 1 --2- 172.21.15.2:0/1598393272 >> v2:172.21.15.2:3300/0 conn(0x7f3ecc0cfc10 0x7f3ecc0d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:20.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.377+0000 7f3ecaa00640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0003a50 0x7f3eb0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f3eca000640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb0004780 0x7f3eb0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7ff036400640 1 Processor -- start 2024-08-17T02:46:20.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f2833a00640 1 -- start start 2024-08-17T02:46:20.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f3c3b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24005250 0x7f3c34052520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7fd39a000640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd3840652a0 0x7fd384067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f339ce00640 1 -- 172.21.15.2:0/352411486 shutdown_connections 2024-08-17T02:46:20.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f3eca000640 1 -- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 msgr2=0x7f3eb000b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:46:20.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f339ce00640 1 --2- 172.21.15.2:0/352411486 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cab20 0x7f33980c9020 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f339ce00640 1 --2- 172.21.15.2:0/352411486 >> v2:172.21.15.26:3300/0 conn(0x7f339815cf30 0x7f339815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f339ce00640 1 -- 172.21.15.2:0/352411486 >> 172.21.15.2:0/352411486 conn(0x7f339806b7c0 msgr2=0x7f339806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f3c3b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24005250 0x7f3c34052520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44426/0 (socket says 172.21.15.2:44426) 2024-08-17T02:46:20.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7fd39a000640 1 -- 172.21.15.2:0/4207648495 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3940817a0 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f3c3aa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c340cd8c0 0x7f3c34102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f339ce00640 1 -- 172.21.15.2:0/352411486 shutdown_connections 2024-08-17T02:46:20.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7eff3fe00640 1 Processor -- start 2024-08-17T02:46:20.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f3c3aa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c340cd8c0 0x7f3c34102440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35610/0 (socket says 172.21.15.2:35610) 2024-08-17T02:46:20.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f3ecb400640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 0x7f3eb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.378+0000 7f3c3be00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c340cdcd0 0x7f3c34102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3c3be00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c340cdcd0 0x7f3c34102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53252/0 (socket says 172.21.15.2:53252) 2024-08-17T02:46:20.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3eca000640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 0x7f3eb000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f339ce00640 1 -- 172.21.15.2:0/352411486 wait complete. 2024-08-17T02:46:20.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7eff3fe00640 1 -- start start 2024-08-17T02:46:20.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3eca000640 1 -- 172.21.15.2:0/1598393272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0003a50 msgr2=0x7f3eb0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3c41000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34038860 con 0x7f3c24005250 2024-08-17T02:46:20.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3c41000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3403ad80 con 0x7f3c340cdcd0 2024-08-17T02:46:20.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3c3b400640 1 -- 172.21.15.2:0/4168378638 learned_addr learned my addr 172.21.15.2:0/4168378638 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3eca000640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0003a50 0x7f3eb0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3eca000640 1 -- 172.21.15.2:0/1598393272 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00034e0 con 0x7f3eb0004780 2024-08-17T02:46:20.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3403b060 con 0x7f3c340cd8c0 2024-08-17T02:46:20.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7ff036400640 1 -- start start 2024-08-17T02:46:20.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f2833a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c0d03b0 0x7f282c154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f2833a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f282c15d200 0x7f282c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f2833a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282c15d5d0 0x7f282c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f2833a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c159bf0 con 0x7f282c15d5d0 2024-08-17T02:46:20.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f2833a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c158fe0 con 0x7f282c15d200 2024-08-17T02:46:20.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f2833a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c1592c0 con 0x7f282c0d03b0 2024-08-17T02:46:20.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7fd3a2000640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd3840652a0 0x7fd384067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3ecaa00640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0003a50 0x7f3eb0003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.379+0000 7f3ecb400640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc0ce380 0x7f3eb000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7f3c3be00640 1 -- 172.21.15.2:0/4168378638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c340cd8c0 msgr2=0x7f3c34102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7f3c3be00640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c340cd8c0 0x7f3c34102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7f3c3be00640 1 -- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24005250 msgr2=0x7f3c34052520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7f2831000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c0d03b0 0x7f282c154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7f282be00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f282c15d200 0x7f282c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7f2831000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c0d03b0 0x7f282c154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35620/0 (socket says 172.21.15.2:35620) 2024-08-17T02:46:20.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7f2831000640 1 -- 172.21.15.2:0/4107562967 learned_addr learned my addr 172.21.15.2:0/4107562967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7eff3fe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4006d5e0 0x7eff40156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7eff3fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 0x7eff40170d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7eff3fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff40156540 0x7eff401712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.380+0000 7eff3ea00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4006d5e0 0x7eff40156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7eff3ea00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4006d5e0 0x7eff40156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53256/0 (socket says 172.21.15.2:53256) 2024-08-17T02:46:20.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7fd3a2000640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd3840652a0 0x7fd384067750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd39c034000 tx=0x7fd39c037000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7f3c3be00640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24005250 0x7f3c34052520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7f3c3be00640 1 -- 172.21.15.2:0/4168378638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3403b340 con 0x7f3c340cdcd0 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff036400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff028008b30 0x7ff0280dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff036400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff02800e000 0x7ff0280da6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff036400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0280e62c0 0x7ff0280cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff036400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280dc260 con 0x7ff028008b30 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff036400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280dac00 con 0x7ff02800e000 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff036400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280db650 con 0x7ff0280e62c0 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff035a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0280e62c0 0x7ff0280cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff035a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0280e62c0 0x7ff0280cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35650/0 (socket says 172.21.15.2:35650) 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7ff035a00640 1 -- 172.21.15.2:0/3583030508 learned_addr learned my addr 172.21.15.2:0/3583030508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7f2831a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282c15d5d0 0x7f282c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7f3eca000640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb0004780 0x7f3eb0004bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800ab50 tx=0x7f3eb8008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b632b2609d60b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7eff3f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff40156540 0x7eff401712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7eff3f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff40156540 0x7eff401712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44436/0 (socket says 172.21.15.2:44436) 2024-08-17T02:46:20.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7eff36000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 0x7eff40170d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7eff36000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 0x7eff40170d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35636/0 (socket says 172.21.15.2:35636) 2024-08-17T02:46:20.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb802aaf0 con 0x7f3eb0004780 2024-08-17T02:46:20.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb802ac50 con 0x7f3eb0004780 2024-08-17T02:46:20.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f3ec9600640 1 -- 172.21.15.2:0/1598393272 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8032440 con 0x7f3eb0004780 2024-08-17T02:46:20.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7feab7a00640 1 Processor -- start 2024-08-17T02:46:20.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3ea00640 1 -- 172.21.15.2:0/2262231103 learned_addr learned my addr 172.21.15.2:0/2262231103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7feab7a00640 1 -- start start 2024-08-17T02:46:20.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f2831a00640 1 -- 172.21.15.2:0/4107562967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c0d03b0 msgr2=0x7f282c154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f2831a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c0d03b0 0x7f282c154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f2831a00640 1 -- 172.21.15.2:0/4107562967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f282c15d200 msgr2=0x7f282c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f2831a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f282c15d200 0x7f282c158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f2831a00640 1 -- 172.21.15.2:0/4107562967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c009a20 con 0x7f282c15d5d0 2024-08-17T02:46:20.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7ff035000640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff028008b30 0x7ff0280dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7ff035a00640 1 -- 172.21.15.2:0/3583030508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff02800e000 msgr2=0x7ff0280da6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7ff035a00640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff02800e000 0x7ff0280da6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7ff035a00640 1 -- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff028008b30 msgr2=0x7ff0280dafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7f3c3b400640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24005250 0x7f3c34052520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:20.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7ff035a00640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff028008b30 0x7ff0280dafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7f339ce00640 1 Processor -- start 2024-08-17T02:46:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.381+0000 7f339ce00640 1 -- start start 2024-08-17T02:46:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff401717f0 con 0x7eff40156540 2024-08-17T02:46:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff401719f0 con 0x7eff4006d5e0 2024-08-17T02:46:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff400a75d0 con 0x7eff4015cdd0 2024-08-17T02:46:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3ea00640 1 -- 172.21.15.2:0/2262231103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 msgr2=0x7eff40170d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3ea00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 0x7eff40170d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3ea00640 1 -- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff40156540 msgr2=0x7eff401712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7ff035a00640 1 -- 172.21.15.2:0/3583030508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c009390 con 0x7ff0280e62c0 2024-08-17T02:46:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7ff035000640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff028008b30 0x7ff0280dafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7f2831a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282c15d5d0 0x7f282c15bbf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f282400d860 tx=0x7f2824008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7fd39a000640 1 -- 172.21.15.2:0/4207648495 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd39404f970 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3ea00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff40156540 0x7eff401712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.382+0000 7eff3ea00640 1 -- 172.21.15.2:0/2262231103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28009450 con 0x7eff4006d5e0 2024-08-17T02:46:20.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7eff3f400640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff40156540 0x7eff401712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:20.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7eff3ea00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4006d5e0 0x7eff40156000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff3000b5e0 tx=0x7eff30009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f3ed1800640 1 -- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb0004780 msgr2=0x7f3eb0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f3ed1800640 1 --2- 172.21.15.2:0/1598393272 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3eb0004780 0x7f3eb0004bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800ab50 tx=0x7f3eb8008040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f3c3be00640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c340cdcd0 0x7f3c34102980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c04c4a0 tx=0x7f3c3c0ab000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7ff035a00640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0280e62c0 0x7ff0280cb8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009360 tx=0x7ff01c032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f3ecb400640 1 -- 172.21.15.2:0/1598393272 reap_dead start 2024-08-17T02:46:20.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f2823e00640 1 -- 172.21.15.2:0/4107562967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282400b6c0 con 0x7f282c15d5d0 2024-08-17T02:46:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7eff36a00640 1 -- 172.21.15.2:0/2262231103 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000f590 con 0x7eff4006d5e0 2024-08-17T02:46:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7eff36a00640 1 -- 172.21.15.2:0/2262231103 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3000f6f0 con 0x7eff4006d5e0 2024-08-17T02:46:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7eff36a00640 1 -- 172.21.15.2:0/2262231103 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000fa90 con 0x7eff4006d5e0 2024-08-17T02:46:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f2823e00640 1 -- 172.21.15.2:0/4107562967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282400b820 con 0x7f282c15d5d0 2024-08-17T02:46:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f2823e00640 1 -- 172.21.15.2:0/4107562967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282400b6c0 con 0x7f282c15d5d0 2024-08-17T02:46:20.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c1595a0 con 0x7f282c15d5d0 2024-08-17T02:46:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f339ce00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33980cab20 0x7f339814fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f339ce00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cb760 0x7f3398159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f339ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339815cf30 0x7f3398068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f339ce00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398150300 con 0x7f339815cf30 2024-08-17T02:46:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f339ce00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339816dad0 con 0x7f33980cab20 2024-08-17T02:46:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f339ce00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339816dd90 con 0x7f33980cb760 2024-08-17T02:46:20.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7f3c2ea00640 1 -- 172.21.15.2:0/4168378638 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0b7070 con 0x7f3c340cdcd0 2024-08-17T02:46:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.384+0000 7f3c2ea00640 1 -- 172.21.15.2:0/4168378638 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0b3660 con 0x7f3c340cdcd0 2024-08-17T02:46:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.384+0000 7f3c2ea00640 1 -- 172.21.15.2:0/4168378638 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0a9ea0 con 0x7f3c340cdcd0 2024-08-17T02:46:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.384+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c340384f0 con 0x7f3c340cdcd0 2024-08-17T02:46:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.383+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff400a78b0 con 0x7eff4006d5e0 2024-08-17T02:46:20.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.384+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c158b40 con 0x7f282c15d5d0 2024-08-17T02:46:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7f3ed1800640 1 -- 172.21.15.2:0/1598393272 shutdown_connections 2024-08-17T02:46:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7f3ed1800640 1 -- 172.21.15.2:0/1598393272 >> 172.21.15.2:0/1598393272 conn(0x7f3ecc068680 msgr2=0x7f3ecc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.384+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c34052a60 con 0x7f3c340cdcd0 2024-08-17T02:46:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.384+0000 7ff023e00640 1 -- 172.21.15.2:0/3583030508 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c031c80 con 0x7ff0280e62c0 2024-08-17T02:46:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.384+0000 7ff023e00640 1 -- 172.21.15.2:0/3583030508 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c031de0 con 0x7ff0280e62c0 2024-08-17T02:46:20.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7ff023e00640 1 -- 172.21.15.2:0/3583030508 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c031c80 con 0x7ff0280e62c0 2024-08-17T02:46:20.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7f3397400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33980cab20 0x7f339814fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.384+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff401700e0 con 0x7eff4006d5e0 2024-08-17T02:46:20.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7f3ed1800640 1 -- 172.21.15.2:0/1598393272 shutdown_connections 2024-08-17T02:46:20.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7f3397e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339815cf30 0x7f3398068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7f3397e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339815cf30 0x7f3398068ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44442/0 (socket says 172.21.15.2:44442) 2024-08-17T02:46:20.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7f3397e00640 1 -- 172.21.15.2:0/3963795118 learned_addr learned my addr 172.21.15.2:0/3963795118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7feab7a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feab01589e0 0x7feab0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.386+0000 7feab7a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab00af9a0 con 0x7feab00ce140 2024-08-17T02:46:20.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.386+0000 7feab7a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab00ce740 con 0x7feab00ca9c0 2024-08-17T02:46:20.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.386+0000 7feab7a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab00af810 con 0x7feab01589e0 2024-08-17T02:46:20.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7f3397e00640 1 -- 172.21.15.2:0/3963795118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cb760 msgr2=0x7f3398159840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:46:20.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7feab5000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feab01589e0 0x7feab0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7f3397e00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cb760 0x7f3398159840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7f3397e00640 1 -- 172.21.15.2:0/3963795118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33980cab20 msgr2=0x7f339814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7f3397e00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33980cab20 0x7f339814fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7feab5000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feab01589e0 0x7feab0158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44458/0 (socket says 172.21.15.2:44458) 2024-08-17T02:46:20.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7feab5000640 1 -- 172.21.15.2:0/3594072019 learned_addr learned my addr 172.21.15.2:0/3594072019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7f2823e00640 1 -- 172.21.15.2:0/4107562967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f282400bbe0 con 0x7f282c15d5d0 2024-08-17T02:46:20.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7ff036400640 1 -- 172.21.15.2:0/3583030508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0280db930 con 0x7ff0280e62c0 2024-08-17T02:46:20.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7ff036400640 1 -- 172.21.15.2:0/3583030508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0280dbef0 con 0x7ff0280e62c0 2024-08-17T02:46:20.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.385+0000 7f3ed1800640 1 -- 172.21.15.2:0/1598393272 wait complete. 2024-08-17T02:46:20.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7f3ed1800640 1 Processor -- start 2024-08-17T02:46:20.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7feab5000640 1 -- 172.21.15.2:0/3594072019 >> v1:172.21.15.26:6789/0 conn(0x7feab00ca9c0 legacy=0x7feab00cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.388+0000 7eff36a00640 1 -- 172.21.15.2:0/2262231103 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7eff3001a460 con 0x7eff4006d5e0 2024-08-17T02:46:20.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.388+0000 7f3ed1800640 1 -- start start 2024-08-17T02:46:20.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.388+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c18005210 con 0x7f3c340cdcd0 2024-08-17T02:46:20.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.388+0000 7f3c2ea00640 1 -- 172.21.15.2:0/4168378638 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3c3c0bc410 con 0x7f3c340cdcd0 2024-08-17T02:46:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.387+0000 7f3397e00640 1 -- 172.21.15.2:0/3963795118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384009390 con 0x7f339815cf30 2024-08-17T02:46:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.389+0000 7f3397e00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339815cf30 0x7f3398068ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f338800c7e0 tx=0x7f3388007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.389+0000 7f2823e00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f280c0651b0 0x7f280c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.388+0000 7feab5000640 1 -- 172.21.15.2:0/3594072019 >> v1:172.21.15.2:6789/0 conn(0x7feab00ce140 legacy=0x7feab00afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.388+0000 7feab5000640 1 -- 172.21.15.2:0/3594072019 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00cea00 con 0x7feab01589e0 2024-08-17T02:46:20.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.389+0000 7feab5000640 1 --2- 172.21.15.2:0/3594072019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feab01589e0 0x7feab0158db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009910 tx=0x7feaa00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8121930181f092ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.389+0000 7f3c2ea00640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3c1c0652d0 0x7f3c1c067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f3c2ea00640 1 -- 172.21.15.2:0/4168378638 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c3c118b50 con 0x7f3c340cdcd0 2024-08-17T02:46:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.389+0000 7f2831000640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f280c0651b0 0x7f280c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.389+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c159d30 con 0x7f282c15d5d0 2024-08-17T02:46:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f2823e00640 1 -- 172.21.15.2:0/4107562967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28240549f0 con 0x7f282c15d5d0 2024-08-17T02:46:20.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f3ed1800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0004780 0x7f3ecc0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f2831000640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f280c0651b0 0x7f280c067660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2818001880 tx=0x7f2818009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f338ea00640 1 -- 172.21.15.2:0/3963795118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388005870 con 0x7f339815cf30 2024-08-17T02:46:20.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339816e070 con 0x7f339815cf30 2024-08-17T02:46:20.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339816e630 con 0x7f339815cf30 2024-08-17T02:46:20.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.389+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff400aaa30 con 0x7eff4006d5e0 2024-08-17T02:46:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f3ed1800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc1752d0 0x7f3ecc0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f3ed1800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc175740 0x7f3ecc0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f3ed1800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0c9310 con 0x7f3eb0004780 2024-08-17T02:46:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f3ed1800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc159ef0 con 0x7f3ecc1752d0 2024-08-17T02:46:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.390+0000 7f3ed1800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0c8d50 con 0x7f3ecc175740 2024-08-17T02:46:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3ecb400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc175740 0x7f3ecc0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3ecb400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc175740 0x7f3ecc0c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35668/0 (socket says 172.21.15.2:35668) 2024-08-17T02:46:20.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3ecb400640 1 -- 172.21.15.2:0/36759379 learned_addr learned my addr 172.21.15.2:0/36759379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7feaaf400640 1 -- 172.21.15.2:0/3594072019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa002ae60 con 0x7feab01589e0 2024-08-17T02:46:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3eca000640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc1752d0 0x7f3ecc0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3ecb400640 1 -- 172.21.15.2:0/36759379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc1752d0 msgr2=0x7f3ecc0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7ff021600640 1 -- 172.21.15.2:0/3583030508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff004005210 con 0x7ff0280e62c0 2024-08-17T02:46:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3ecb400640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc1752d0 0x7f3ecc0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3ecb400640 1 -- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0004780 msgr2=0x7f3ecc0c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3ecb400640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0004780 0x7f3ecc0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3c3b400640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3c1c0652d0 0x7f3c1c067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7ff023e00640 1 -- 172.21.15.2:0/3583030508 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff01c039070 con 0x7ff0280e62c0 2024-08-17T02:46:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.391+0000 7f3ecb400640 1 -- 172.21.15.2:0/36759379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0c9030 con 0x7f3ecc175740 2024-08-17T02:46:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.392+0000 7f3ecb400640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc175740 0x7f3ecc0c8420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc15ca20 tx=0x7f3ec4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.392+0000 7f3c3b400640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3c1c0652d0 0x7f3c1c067780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c28000e10 tx=0x7f3c2800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.392+0000 7ff023e00640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff010065210 0x7ff0100676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.392+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3398163cc0 con 0x7f339815cf30 2024-08-17T02:46:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.393+0000 7ff023e00640 1 -- 172.21.15.2:0/3583030508 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff01c0a2be0 con 0x7ff0280e62c0 2024-08-17T02:46:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.393+0000 7ff035000640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff010065210 0x7ff0100676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.392+0000 7eff36a00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7eff1c0652a0 0x7eff1c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.392+0000 7eff36a00640 1 -- 172.21.15.2:0/2262231103 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff30082120 con 0x7eff4006d5e0 2024-08-17T02:46:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.393+0000 7ff035000640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff010065210 0x7ff0100676c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff030000b60 tx=0x7ff03006a040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.393+0000 7eff36000640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7eff1c0652a0 0x7eff1c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.394+0000 7eff36000640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7eff1c0652a0 0x7eff1c067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff28034000 tx=0x7eff28032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.392+0000 7f338ea00640 1 -- 172.21.15.2:0/3963795118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388005be0 con 0x7f339815cf30 2024-08-17T02:46:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.393+0000 7f338ea00640 1 -- 172.21.15.2:0/3963795118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388005d90 con 0x7f339815cf30 2024-08-17T02:46:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.394+0000 7f3c2ea00640 1 -- 172.21.15.2:0/4168378638 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3c3c0e6ca0 con 0x7f3c340cdcd0 2024-08-17T02:46:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.396+0000 7f3ec2000640 1 -- 172.21.15.2:0/36759379 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4007080 con 0x7f3ecc175740 2024-08-17T02:46:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.396+0000 7ff023e00640 1 -- 172.21.15.2:0/3583030508 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff01c070cc0 con 0x7ff0280e62c0 2024-08-17T02:46:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.396+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc159b80 con 0x7f3ecc175740 2024-08-17T02:46:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.397+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc0b2340 con 0x7f3ecc175740 2024-08-17T02:46:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.397+0000 7f3ec2000640 1 -- 172.21.15.2:0/36759379 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4002620 con 0x7f3ecc175740 2024-08-17T02:46:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.397+0000 7f3ec2000640 1 -- 172.21.15.2:0/36759379 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40029e0 con 0x7f3ecc175740 2024-08-17T02:46:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.398+0000 7eff36a00640 1 -- 172.21.15.2:0/2262231103 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7eff30050240 con 0x7eff4006d5e0 2024-08-17T02:46:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.399+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea4005210 con 0x7f3ecc175740 2024-08-17T02:46:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.400+0000 7f3ec2000640 1 -- 172.21.15.2:0/36759379 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ec4003040 con 0x7f3ecc175740 2024-08-17T02:46:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.401+0000 7f3ec2000640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3eac065250 0x7f3eac067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.402+0000 7f3ec2000640 1 -- 172.21.15.2:0/36759379 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ec4081cc0 con 0x7f3ecc175740 2024-08-17T02:46:20.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.402+0000 7feaaf400640 1 -- 172.21.15.2:0/3594072019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa0032440 con 0x7feab01589e0 2024-08-17T02:46:20.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.402+0000 7f3ecaa00640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3eac065250 0x7f3eac067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.402+0000 7f2823e00640 1 -- 172.21.15.2:0/4107562967 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2824050dc0 con 0x7f282c15d5d0 2024-08-17T02:46:20.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.402+0000 7feaaf400640 1 -- 172.21.15.2:0/3594072019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa00327e0 con 0x7feab01589e0 2024-08-17T02:46:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.403+0000 7f3ecaa00640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3eac065250 0x7f3eac067700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0012b0 tx=0x7f3ebc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.403+0000 7feab7a00640 1 -- 172.21.15.2:0/3594072019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feab01589e0 msgr2=0x7feab0158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.403+0000 7feab7a00640 1 --2- 172.21.15.2:0/3594072019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feab01589e0 0x7feab0158db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009910 tx=0x7feaa00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.403+0000 7feab7a00640 1 -- 172.21.15.2:0/3594072019 shutdown_connections 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.403+0000 7feab7a00640 1 --2- 172.21.15.2:0/3594072019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feab01589e0 0x7feab0158db0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.403+0000 7feab7a00640 1 -- 172.21.15.2:0/3594072019 >> 172.21.15.2:0/3594072019 conn(0x7feab006e590 msgr2=0x7feab006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.403+0000 7feab7a00640 1 -- 172.21.15.2:0/3594072019 shutdown_connections 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.403+0000 7feab7a00640 1 -- 172.21.15.2:0/3594072019 wait complete. 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.406+0000 7feab7a00640 1 Processor -- start 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.407+0000 7feab7a00640 1 -- start start 2024-08-17T02:46:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.407+0000 7f3ec2000640 1 -- 172.21.15.2:0/36759379 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3ec4088080 con 0x7f3ecc175740 2024-08-17T02:46:20.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.408+0000 7feab7a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab00ca9c0 0x7feab014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.408+0000 7feab7a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feab00ce140 0x7feab0151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.409+0000 7feab7a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feab0151770 0x7feab00b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.409+0000 7feab7a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab0151c10 con 0x7feab00ce140 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.409+0000 7feab7a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab00c85f0 con 0x7feab00ca9c0 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.409+0000 7feab7a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab00b1e40 con 0x7feab0151770 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.409+0000 7feab5000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab00ca9c0 0x7feab014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.410+0000 7feab5000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab00ca9c0 0x7feab014fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53286/0 (socket says 172.21.15.2:53286) 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.410+0000 7feab5000640 1 -- 172.21.15.2:0/1282026350 learned_addr learned my addr 172.21.15.2:0/1282026350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.410+0000 7feab5a00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feab0151770 0x7feab00b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.411+0000 7feab5000640 1 -- 172.21.15.2:0/1282026350 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feab0151770 msgr2=0x7feab00b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.411+0000 7feab5000640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feab0151770 0x7feab00b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.411+0000 7feab5000640 1 -- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feab00ce140 msgr2=0x7feab0151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.411+0000 7feab5000640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feab00ce140 0x7feab0151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.411+0000 7feab5000640 1 -- 172.21.15.2:0/1282026350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0009450 con 0x7feab00ca9c0 2024-08-17T02:46:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.411+0000 7feab5000640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab00ca9c0 0x7feab014fbb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009970 tx=0x7feaa0032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.412+0000 7fea9fe00640 1 -- 172.21.15.2:0/1282026350 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0031a60 con 0x7feab00ca9c0 2024-08-17T02:46:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.412+0000 7fea9fe00640 1 -- 172.21.15.2:0/1282026350 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa0031be0 con 0x7feab00ca9c0 2024-08-17T02:46:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.412+0000 7fea9fe00640 1 -- 172.21.15.2:0/1282026350 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0045410 con 0x7feab00ca9c0 2024-08-17T02:46:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.412+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab00c7a40 con 0x7feab00ca9c0 2024-08-17T02:46:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.413+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab00c7fa0 con 0x7feab00ca9c0 2024-08-17T02:46:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.416+0000 7f338ea00640 1 -- 172.21.15.2:0/3963795118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3388007300 con 0x7f339815cf30 2024-08-17T02:46:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.414+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab0063fb0 con 0x7feab00ca9c0 2024-08-17T02:46:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.417+0000 7fea9fe00640 1 -- 172.21.15.2:0/1282026350 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feaa0039050 con 0x7feab00ca9c0 2024-08-17T02:46:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.418+0000 7f338ea00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f33780651d0 0x7f3378067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.418+0000 7f338ea00640 1 -- 172.21.15.2:0/3963795118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3388082ac0 con 0x7f339815cf30 2024-08-17T02:46:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.418+0000 7f3397400640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f33780651d0 0x7f3378067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.418+0000 7fea9fe00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fea94065180 0x7fea94067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.418+0000 7fea9fe00640 1 -- 172.21.15.2:0/1282026350 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feaa00a21a0 con 0x7feab00ca9c0 2024-08-17T02:46:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.419+0000 7f338ea00640 1 -- 172.21.15.2:0/3963795118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3388050be0 con 0x7f339815cf30 2024-08-17T02:46:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.419+0000 7feaafe00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fea94065180 0x7fea94067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.420+0000 7f3397400640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f33780651d0 0x7f3378067680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3390007620 tx=0x7f339000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.420+0000 7feaafe00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fea94065180 0x7fea94067630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feab0152360 tx=0x7feaa4007a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:20.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.424+0000 7fea9fe00640 1 -- 172.21.15.2:0/1282026350 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feaa00a7060 con 0x7feab00ca9c0 2024-08-17T02:46:20.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.810+0000 7fd3a9600640 1 -- 172.21.15.2:0/4207648495 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd3a414adf0 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.810+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3c180054c0 con 0x7f3c340cdcd0 2024-08-17T02:46:20.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.811+0000 7fd39a000640 1 -- 172.21.15.2:0/4207648495 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd394018020 con 0x7fd3a40ad5c0 2024-08-17T02:46:20.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.811+0000 7f3c2ea00640 1 -- 172.21.15.2:0/4168378638 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c3c0a1e60 con 0x7f3c340cdcd0 2024-08-17T02:46:20.812 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:46:20.815 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:46:20.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.814+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3c1c0652d0 msgr2=0x7f3c1c067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.814+0000 7f3c41000640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3c1c0652d0 0x7f3c1c067780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c28000e10 tx=0x7f3c2800c040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c340cdcd0 msgr2=0x7f3c34102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c340cdcd0 0x7f3c34102980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c04c4a0 tx=0x7f3c3c0ab000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 shutdown_connections 2024-08-17T02:46:20.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c340cdcd0 0x7f3c34102980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3c1c0652d0 0x7f3c1c067780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3c340cd8c0 0x7f3c34102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 --2- 172.21.15.2:0/4168378638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24005250 0x7f3c34052520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 >> 172.21.15.2:0/4168378638 conn(0x7f3c34055a10 msgr2=0x7f3c34005ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.815+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 shutdown_connections 2024-08-17T02:46:20.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.816+0000 7f3c41000640 1 -- 172.21.15.2:0/4168378638 wait complete. 2024-08-17T02:46:20.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.817+0000 7fd38f400640 1 -- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd3840652a0 msgr2=0x7fd384067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.817+0000 7fd38f400640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd3840652a0 0x7fd384067750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd39c034000 tx=0x7fd39c037000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.817+0000 7fd38f400640 1 -- 172.21.15.2:0/4207648495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3a40ad5c0 msgr2=0x7fd3a4143580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.817+0000 7fd38f400640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3a40ad5c0 0x7fd3a4143580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd39400c5c0 tx=0x7fd394007ee0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.818+0000 7fd38f400640 1 -- 172.21.15.2:0/4207648495 shutdown_connections 2024-08-17T02:46:20.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.818+0000 7fd38f400640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a415a5f0 0x7fd3a4148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.818+0000 7fd38f400640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3a4156950 0x7fd3a4159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.818+0000 7fd38f400640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd3840652a0 0x7fd384067750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.818+0000 7fd38f400640 1 --2- 172.21.15.2:0/4207648495 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd3a40ad5c0 0x7fd3a4143580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.818+0000 7fd38f400640 1 -- 172.21.15.2:0/4207648495 >> 172.21.15.2:0/4207648495 conn(0x7fd3a40c8260 msgr2=0x7fd3a40ab320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.818+0000 7fd38f400640 1 -- 172.21.15.2:0/4207648495 shutdown_connections 2024-08-17T02:46:20.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.818+0000 7fd38f400640 1 -- 172.21.15.2:0/4207648495 wait complete. 2024-08-17T02:46:20.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.823+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7eff400a7430 con 0x7eff4006d5e0 2024-08-17T02:46:20.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.824+0000 7eff36a00640 1 -- 172.21.15.2:0/2262231103 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff400a7430 con 0x7eff4006d5e0 2024-08-17T02:46:20.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.825+0000 7ff021600640 1 -- 172.21.15.2:0/3583030508 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff0040054c0 con 0x7ff0280e62c0 2024-08-17T02:46:20.826 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:46:20.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.826+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f282c159d30 con 0x7f282c15d5d0 2024-08-17T02:46:20.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.826+0000 7ff023e00640 1 -- 172.21.15.2:0/3583030508 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff01c040090 con 0x7ff0280e62c0 2024-08-17T02:46:20.828 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:20.829 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:20.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.827+0000 7f2823e00640 1 -- 172.21.15.2:0/4107562967 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f282c159d30 con 0x7f282c15d5d0 2024-08-17T02:46:20.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.828+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7eff1c0652a0 msgr2=0x7eff1c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.828+0000 7eff3fe00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7eff1c0652a0 0x7eff1c067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff28034000 tx=0x7eff28032000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.828+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4006d5e0 msgr2=0x7eff40156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.828+0000 7eff3fe00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4006d5e0 0x7eff40156000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff3000b5e0 tx=0x7eff30009120 comp rx=0 tx=0).stop 2024-08-17T02:46:20.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 shutdown_connections 2024-08-17T02:46:20.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7eff3fe00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff40156540 0x7eff401712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7eff3fe00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7eff1c0652a0 0x7eff1c067750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7eff3fe00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7eff4015cdd0 0x7eff40170d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7eff3fe00640 1 --2- 172.21.15.2:0/2262231103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff4006d5e0 0x7eff40156000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 >> 172.21.15.2:0/2262231103 conn(0x7eff40066e60 msgr2=0x7eff4015b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 shutdown_connections 2024-08-17T02:46:20.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7eff3fe00640 1 -- 172.21.15.2:0/2262231103 wait complete. 2024-08-17T02:46:20.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f280c0651b0 msgr2=0x7f280c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7f2833a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f280c0651b0 0x7f280c067660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2818001880 tx=0x7f2818009040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282c15d5d0 msgr2=0x7f282c15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.830+0000 7f2833a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282c15d5d0 0x7f282c15bbf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f282400d860 tx=0x7f2824008040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.831+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 shutdown_connections 2024-08-17T02:46:20.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.831+0000 7f2833a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f282c15d5d0 0x7f282c15bbf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.831+0000 7f2833a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f282c15d200 0x7f282c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.831+0000 7f2833a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f280c0651b0 0x7f280c067660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.831+0000 7f2833a00640 1 --2- 172.21.15.2:0/4107562967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f282c0d03b0 0x7f282c154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.831+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 >> 172.21.15.2:0/4107562967 conn(0x7f282c068680 msgr2=0x7f282c1569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.831+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 shutdown_connections 2024-08-17T02:46:20.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.831+0000 7f2833a00640 1 -- 172.21.15.2:0/4107562967 wait complete. 2024-08-17T02:46:20.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 -- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff010065210 msgr2=0x7ff0100676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff010065210 0x7ff0100676c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff030000b60 tx=0x7ff03006a040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 -- 172.21.15.2:0/3583030508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0280e62c0 msgr2=0x7ff0280cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0280e62c0 0x7ff0280cb8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009360 tx=0x7ff01c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 -- 172.21.15.2:0/3583030508 shutdown_connections 2024-08-17T02:46:20.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff010065210 0x7ff0100676c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0280e62c0 0x7ff0280cb8f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff02800e000 0x7ff0280da6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 --2- 172.21.15.2:0/3583030508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff028008b30 0x7ff0280dafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.832+0000 7ff021600640 1 -- 172.21.15.2:0/3583030508 >> 172.21.15.2:0/3583030508 conn(0x7ff02800a800 msgr2=0x7ff028054dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.833+0000 7ff021600640 1 -- 172.21.15.2:0/3583030508 shutdown_connections 2024-08-17T02:46:20.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.833+0000 7ff021600640 1 -- 172.21.15.2:0/3583030508 wait complete. 2024-08-17T02:46:20.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2024-08-17T02:46:20.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.841+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3ea40054c0 con 0x7f3ecc175740 2024-08-17T02:46:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.843+0000 7f3ec2000640 1 -- 172.21.15.2:0/36759379 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ec40537f0 con 0x7f3ecc175740 2024-08-17T02:46:20.844 INFO:teuthology.orchestra.run.smithi002.stdout:55834574851 2024-08-17T02:46:20.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-08-17T02:46:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.846+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3398070700 con 0x7f339815cf30 2024-08-17T02:46:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f338ea00640 1 -- 172.21.15.2:0/3963795118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3388054200 con 0x7f339815cf30 2024-08-17T02:46:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3eac065250 msgr2=0x7f3eac067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3eac065250 0x7f3eac067700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0012b0 tx=0x7f3ebc009040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc175740 msgr2=0x7f3ecc0c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc175740 0x7f3ecc0c8420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc15ca20 tx=0x7f3ec4009840 comp rx=0 tx=0).stop 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 shutdown_connections 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3eac065250 0x7f3eac067700 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f3ecc175740 0x7f3ecc0c8420 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3ecc1752d0 0x7f3ecc0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 --2- 172.21.15.2:0/36759379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3eb0004780 0x7f3ecc0c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 >> 172.21.15.2:0/36759379 conn(0x7f3ecc068680 msgr2=0x7f3ecc0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 shutdown_connections 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.847+0000 7f3ed1800640 1 -- 172.21.15.2:0/36759379 wait complete. 2024-08-17T02:46:20.849 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.850+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f33780651d0 msgr2=0x7f3378067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.850+0000 7f339ce00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f33780651d0 0x7f3378067680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3390007620 tx=0x7f339000b040 comp rx=0 tx=0).stop 2024-08-17T02:46:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.850+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339815cf30 msgr2=0x7f3398068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.850+0000 7f339ce00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339815cf30 0x7f3398068ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f338800c7e0 tx=0x7f3388007e40 comp rx=0 tx=0).stop 2024-08-17T02:46:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.851+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 shutdown_connections 2024-08-17T02:46:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.851+0000 7f339ce00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339815cf30 0x7f3398068ed0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.851+0000 7f339ce00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f33780651d0 0x7f3378067680 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.851+0000 7f339ce00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33980cb760 0x7f3398159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.851+0000 7f339ce00640 1 --2- 172.21.15.2:0/3963795118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33980cab20 0x7f339814fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.851+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 >> 172.21.15.2:0/3963795118 conn(0x7f339806b7c0 msgr2=0x7f339815d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.851+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 shutdown_connections 2024-08-17T02:46:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.851+0000 7f339ce00640 1 -- 172.21.15.2:0/3963795118 wait complete. 2024-08-17T02:46:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.853+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7feab00cf730 con 0x7feab00ca9c0 2024-08-17T02:46:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.853+0000 7fea9fe00640 1 -- 172.21.15.2:0/1282026350 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feaa00701d0 con 0x7feab00ca9c0 2024-08-17T02:46:20.854 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:20.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-08-17T02:46:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fea94065180 msgr2=0x7fea94067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fea94065180 0x7fea94067630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feab0152360 tx=0x7feaa4007a70 comp rx=0 tx=0).stop 2024-08-17T02:46:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab00ca9c0 msgr2=0x7feab014fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab00ca9c0 0x7feab014fbb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009970 tx=0x7feaa0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 shutdown_connections 2024-08-17T02:46:20.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-08-17T02:46:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fea94065180 0x7fea94067630 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7feab0151770 0x7feab00b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feab00ce140 0x7feab0151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:20.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 --2- 172.21.15.2:0/1282026350 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab00ca9c0 0x7feab014fbb0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009970 tx=0x7feaa0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 >> 172.21.15.2:0/1282026350 conn(0x7feab006e590 msgr2=0x7feab0155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 shutdown_connections 2024-08-17T02:46:20.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:20.856+0000 7feab7a00640 1 -- 172.21.15.2:0/1282026350 wait complete. 2024-08-17T02:46:20.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-08-17T02:46:20.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-08-17T02:46:20.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-08-17T02:46:20.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-08-17T02:46:21.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:46:21.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:46:21.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:46:21.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:46:21.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:46:21.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:46:21.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:46:21.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:46:22.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.092+0000 7fe542e00640 1 Processor -- start 2024-08-17T02:46:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.092+0000 7fe542e00640 1 -- start start 2024-08-17T02:46:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.094+0000 7fe542e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5340cf970 0x7fe5340073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.094+0000 7fe542e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe534057dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.095+0000 7fe541a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe5340cf970 0x7fe5340073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.095+0000 7fe541000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe534057dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.095+0000 7fe541000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe534057dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35694/0 (socket says 172.21.15.2:35694) 2024-08-17T02:46:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.095+0000 7fe541000640 1 -- 172.21.15.2:0/2779211401 learned_addr learned my addr 172.21.15.2:0/2779211401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.096+0000 7fe542e00640 1 -- 172.21.15.2:0/2779211401 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe534006f10 con 0x7fe5340cfd40 2024-08-17T02:46:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.096+0000 7fe542e00640 1 -- 172.21.15.2:0/2779211401 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe534006340 con 0x7fe5340cf970 2024-08-17T02:46:22.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.096+0000 7fe542e00640 1 -- 172.21.15.2:0/2779211401 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340065e0 con 0x7fe5340078e0 2024-08-17T02:46:22.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.097+0000 7fe53be00640 1 -- 172.21.15.2:0/2779211401 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684811108 0 0) 0x7fe534006f10 con 0x7fe5340cfd40 2024-08-17T02:46:22.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.098+0000 7fe53be00640 1 -- 172.21.15.2:0/2779211401 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5240034e0 con 0x7fe5340cfd40 2024-08-17T02:46:22.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.098+0000 7fe541000640 1 -- 172.21.15.2:0/2779211401 >> v2:172.21.15.2:3300/0 conn(0x7fe5340cf970 msgr2=0x7fe5340073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.098+0000 7fe541000640 1 --2- 172.21.15.2:0/2779211401 >> v2:172.21.15.2:3300/0 conn(0x7fe5340cf970 0x7fe5340073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.098+0000 7fe541000640 1 -- 172.21.15.2:0/2779211401 >> v1:172.21.15.2:6789/0 conn(0x7fe5340cfd40 legacy=0x7fe53403bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.098+0000 7fe541000640 1 -- 172.21.15.2:0/2779211401 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340068c0 con 0x7fe5340078e0 2024-08-17T02:46:22.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.098+0000 7fe541a00640 1 --2- 172.21.15.2:0/2779211401 >> v2:172.21.15.2:3300/0 conn(0x7fe5340cf970 0x7fe5340073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:22.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.100+0000 7fe541000640 1 --2- 172.21.15.2:0/2779211401 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe534057dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe530009910 tx=0x7fe5300091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e9f0996fbe1ce2e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.100+0000 7fe53be00640 1 -- 172.21.15.2:0/2779211401 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53002ae40 con 0x7fe5340078e0 2024-08-17T02:46:22.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.100+0000 7fe53be00640 1 -- 172.21.15.2:0/2779211401 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe530032440 con 0x7fe5340078e0 2024-08-17T02:46:22.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.100+0000 7fe53be00640 1 -- 172.21.15.2:0/2779211401 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530032820 con 0x7fe5340078e0 2024-08-17T02:46:22.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.102+0000 7fe542e00640 1 -- 172.21.15.2:0/2779211401 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 msgr2=0x7fe534057dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.102+0000 7fe542e00640 1 --2- 172.21.15.2:0/2779211401 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe534057dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe530009910 tx=0x7fe5300091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.102+0000 7fe542e00640 1 -- 172.21.15.2:0/2779211401 shutdown_connections 2024-08-17T02:46:22.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.102+0000 7fe542e00640 1 --2- 172.21.15.2:0/2779211401 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe534057dd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.102+0000 7fe542e00640 1 --2- 172.21.15.2:0/2779211401 >> v2:172.21.15.2:3300/0 conn(0x7fe5340cf970 0x7fe5340073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.103+0000 7fe542e00640 1 -- 172.21.15.2:0/2779211401 >> 172.21.15.2:0/2779211401 conn(0x7fe53400e5c0 msgr2=0x7fe53400e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.103+0000 7fe542e00640 1 -- 172.21.15.2:0/2779211401 shutdown_connections 2024-08-17T02:46:22.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.103+0000 7fe542e00640 1 -- 172.21.15.2:0/2779211401 wait complete. 2024-08-17T02:46:22.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.106+0000 7fe542e00640 1 Processor -- start 2024-08-17T02:46:22.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.107+0000 7fe542e00640 1 -- start start 2024-08-17T02:46:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.108+0000 7fe542e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe53403e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.109+0000 7fe542e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5340cf970 0x7fe5340e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.109+0000 7fe542e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5340cfd40 0x7fe534051530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.110+0000 7fe541000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5340cf970 0x7fe5340e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.110+0000 7fe541000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5340cf970 0x7fe5340e9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44502/0 (socket says 172.21.15.2:44502) 2024-08-17T02:46:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.110+0000 7fe541a00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe53403e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.111+0000 7fe542400640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5340cfd40 0x7fe534051530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.110+0000 7fe541000640 1 -- 172.21.15.2:0/1790783875 learned_addr learned my addr 172.21.15.2:0/1790783875 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.111+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53403eaf0 con 0x7fe5340cf970 2024-08-17T02:46:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.111+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53403d510 con 0x7fe5340cfd40 2024-08-17T02:46:22.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.111+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53403d7f0 con 0x7fe5340078e0 2024-08-17T02:46:22.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.112+0000 7fe542400640 1 -- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 msgr2=0x7fe53403e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.112+0000 7fe542400640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe53403e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.112+0000 7fe542400640 1 -- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5340cf970 msgr2=0x7fe5340e9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.113+0000 7fe542400640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5340cf970 0x7fe5340e9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.113+0000 7fe542400640 1 -- 172.21.15.2:0/1790783875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009450 con 0x7fe5340cfd40 2024-08-17T02:46:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.113+0000 7fe541000640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5340cf970 0x7fe5340e9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.114+0000 7fe542400640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5340cfd40 0x7fe534051530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe534011cf0 tx=0x7fe528007bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.115+0000 7fe538c00640 1 -- 172.21.15.2:0/1790783875 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528011590 con 0x7fe5340cfd40 2024-08-17T02:46:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.115+0000 7fe538c00640 1 -- 172.21.15.2:0/1790783875 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528011710 con 0x7fe5340cfd40 2024-08-17T02:46:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.115+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53403dad0 con 0x7fe5340cfd40 2024-08-17T02:46:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.115+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53403e090 con 0x7fe5340cfd40 2024-08-17T02:46:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.116+0000 7fe538c00640 1 -- 172.21.15.2:0/1790783875 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528011ad0 con 0x7fe5340cfd40 2024-08-17T02:46:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.119+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe518005210 con 0x7fe5340cfd40 2024-08-17T02:46:22.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.120+0000 7fe538c00640 1 -- 172.21.15.2:0/1790783875 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe52801c460 con 0x7fe5340cfd40 2024-08-17T02:46:22.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.121+0000 7fe538c00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe51c0651d0 0x7fe51c067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.122+0000 7fe541a00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe51c0651d0 0x7fe51c067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.123+0000 7fe538c00640 1 -- 172.21.15.2:0/1790783875 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe528081fa0 con 0x7fe5340cfd40 2024-08-17T02:46:22.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.124+0000 7fe541a00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe51c0651d0 0x7fe51c067680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe53c000b60 tx=0x7fe53c064990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.125+0000 7fe538c00640 1 -- 172.21.15.2:0/1790783875 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe52804ff30 con 0x7fe5340cfd40 2024-08-17T02:46:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.163+0000 7f9546a00640 1 Processor -- start 2024-08-17T02:46:22.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.163+0000 7f9546a00640 1 -- start start 2024-08-17T02:46:22.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.165+0000 7f9546a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380e1fb0 0x7f95380e2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.165+0000 7f9546a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9538054fb0 con 0x7f9538039280 2024-08-17T02:46:22.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.165+0000 7f9546a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9538054680 con 0x7f953803b050 2024-08-17T02:46:22.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.165+0000 7f9546a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953803b880 con 0x7f95380e1fb0 2024-08-17T02:46:22.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.166+0000 7f953fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380e1fb0 0x7f95380e2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.166+0000 7f953fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380e1fb0 0x7f95380e2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35710/0 (socket says 172.21.15.2:35710) 2024-08-17T02:46:22.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.166+0000 7f953fe00640 1 -- 172.21.15.2:0/1377607022 learned_addr learned my addr 172.21.15.2:0/1377607022 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.167+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076566712 0 0) 0x7f9538054fb0 con 0x7f9538039280 2024-08-17T02:46:22.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.167+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95280034e0 con 0x7f9538039280 2024-08-17T02:46:22.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3151130218 0 0) 0x7f95280034e0 con 0x7f9538039280 2024-08-17T02:46:22.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380e1fb0 msgr2=0x7f95380e2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380e1fb0 0x7f95380e2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 >> v1:172.21.15.26:6789/0 conn(0x7f953803b050 legacy=0x7f9538038b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538054960 con 0x7f9538039280 2024-08-17T02:46:22.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f954004c200 con 0x7f9538039280 2024-08-17T02:46:22.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 >> v1:172.21.15.2:6789/0 conn(0x7f9538039280 legacy=0x7f9538006480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528003960 0x7f9528003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9528004780 0x7f9528004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9528005130 0x7f952800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953803b880 con 0x7f9528003960 2024-08-17T02:46:22.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952800bf70 con 0x7f9528004780 2024-08-17T02:46:22.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952800c130 con 0x7f9528005130 2024-08-17T02:46:22.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.167+0000 7f474b200640 1 Processor -- start 2024-08-17T02:46:22.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.167+0000 7f474b200640 1 -- start start 2024-08-17T02:46:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.168+0000 7f9544a00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9528005130 0x7f952800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.169+0000 7f953fe00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528003960 0x7f9528003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.169+0000 7f953f400640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9528004780 0x7f9528004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.169+0000 7f474b200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47440cfb40 0x7f47440535e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.169+0000 7f474b200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4744053b20 0x7f4744006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.169+0000 7f9544a00640 1 -- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9528004780 msgr2=0x7f9528004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f9544a00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9528004780 0x7f9528004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f9544a00640 1 -- 172.21.15.2:0/1377607022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528003960 msgr2=0x7f9528003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f9544a00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528003960 0x7f9528003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f9544a00640 1 -- 172.21.15.2:0/1377607022 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538054960 con 0x7f9528005130 2024-08-17T02:46:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f474b200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47440066c0 0x7f47440ea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f474b200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4744007a80 con 0x7f47440cfb40 2024-08-17T02:46:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f474b200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4744006e70 con 0x7f4744053b20 2024-08-17T02:46:22.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f474b200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4744007150 con 0x7f47440066c0 2024-08-17T02:46:22.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f83c3e00640 1 Processor -- start 2024-08-17T02:46:22.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f953f400640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9528004780 0x7f9528004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f4749e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47440cfb40 0x7f47440535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f4749e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47440cfb40 0x7f47440535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44530/0 (socket says 172.21.15.2:44530) 2024-08-17T02:46:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f4749e00640 1 -- 172.21.15.2:0/720798342 learned_addr learned my addr 172.21.15.2:0/720798342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f83c3e00640 1 -- start start 2024-08-17T02:46:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.170+0000 7f953fe00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9528003960 0x7f9528003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f4749400640 1 --2- 172.21.15.2:0/720798342 >> v2:172.21.15.26:3300/0 conn(0x7f4744053b20 0x7f4744006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f4749400640 1 -- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47440066c0 msgr2=0x7f47440ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f474a800640 1 --2- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47440066c0 0x7f47440ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f9544a00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9528005130 0x7f952800b9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f95400654b0 tx=0x7f9540064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b1df2dc0a5295 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.172+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400a5050 con 0x7f9528005130 2024-08-17T02:46:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f4749400640 1 --2- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47440066c0 0x7f47440ea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f4749400640 1 -- 172.21.15.2:0/720798342 >> v2:172.21.15.2:3300/0 conn(0x7f47440cfb40 msgr2=0x7f47440535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f4749400640 1 --2- 172.21.15.2:0/720798342 >> v2:172.21.15.2:3300/0 conn(0x7f47440cfb40 0x7f47440535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f4749400640 1 -- 172.21.15.2:0/720798342 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744007430 con 0x7f4744053b20 2024-08-17T02:46:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.171+0000 7f474a800640 1 --2- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47440066c0 0x7f47440ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.172+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95400a93f0 con 0x7f9528005130 2024-08-17T02:46:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.172+0000 7f953ea00640 1 -- 172.21.15.2:0/1377607022 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400a9850 con 0x7f9528005130 2024-08-17T02:46:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f9546a00640 1 -- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9528005130 msgr2=0x7f952800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f9546a00640 1 --2- 172.21.15.2:0/1377607022 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9528005130 0x7f952800b9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f95400654b0 tx=0x7f9540064990 comp rx=0 tx=0).stop 2024-08-17T02:46:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f9544a00640 1 -- 172.21.15.2:0/1377607022 reap_dead start 2024-08-17T02:46:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f9546a00640 1 -- 172.21.15.2:0/1377607022 shutdown_connections 2024-08-17T02:46:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f9546a00640 1 -- 172.21.15.2:0/1377607022 >> 172.21.15.2:0/1377607022 conn(0x7f9538055a00 msgr2=0x7f9538055e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f83c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83bc0e6280 0x7f83bc0e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f83c3e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc04fbe0 con 0x7f83bc0e55d0 2024-08-17T02:46:22.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f83c3e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc005fa0 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f83c3e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc051210 con 0x7f83bc0e6280 2024-08-17T02:46:22.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.174+0000 7f70b8a00640 1 Processor -- start 2024-08-17T02:46:22.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.174+0000 7f70b8a00640 1 -- start start 2024-08-17T02:46:22.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.174+0000 7f83c2000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83bc0e6280 0x7f83bc0e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.174+0000 7f83c2000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f83bc0e6280 0x7f83bc0e5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44542/0 (socket says 172.21.15.2:44542) 2024-08-17T02:46:22.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.174+0000 7f83c2000640 1 -- 172.21.15.2:0/1366387468 learned_addr learned my addr 172.21.15.2:0/1366387468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.175+0000 7fd27de00640 1 Processor -- start 2024-08-17T02:46:22.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.175+0000 7f83c2000640 1 -- 172.21.15.2:0/1366387468 >> v1:172.21.15.26:6789/0 conn(0x7f83bc0e5eb0 legacy=0x7f83bc033a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.175+0000 7f83c2000640 1 -- 172.21.15.2:0/1366387468 >> v1:172.21.15.2:6789/0 conn(0x7f83bc0e55d0 legacy=0x7f83bc006430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.175+0000 7f83c2000640 1 -- 172.21.15.2:0/1366387468 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc034190 con 0x7f83bc0e6280 2024-08-17T02:46:22.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f9546a00640 1 -- 172.21.15.2:0/1377607022 shutdown_connections 2024-08-17T02:46:22.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.173+0000 7f9546a00640 1 -- 172.21.15.2:0/1377607022 wait complete. 2024-08-17T02:46:22.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.175+0000 7f9546a00640 1 Processor -- start 2024-08-17T02:46:22.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.176+0000 7f9546a00640 1 -- start start 2024-08-17T02:46:22.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.175+0000 7fd27de00640 1 -- start start 2024-08-17T02:46:22.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.176+0000 7f4749400640 1 --2- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4744053b20 0x7f4744006180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4744058f70 tx=0x7f47380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f32d3e73f20d351b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7fd27de00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2700e6250 0x7fd27000d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7fd27de00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2700e6620 0x7fd27000ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7fd27de00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd270055690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f83c2000640 1 --2- 172.21.15.2:0/1366387468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e6280 0x7f83bc0e5090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009890 tx=0x7f83b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee122d521e75d60a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f70b8a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac037060 0x7f70ac0dd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f70b8a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70ac0dd9a0 0x7f70ac04fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f70b8a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ac035600 con 0x7f70ac036c90 2024-08-17T02:46:22.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f70b8a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac0e0500 con 0x7f70ac0dd9a0 2024-08-17T02:46:22.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f70b8a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac037490 con 0x7f70ac037060 2024-08-17T02:46:22.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f9546a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95380dcf60 0x7f9538037ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f9546a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380dd330 0x7f95380ee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f9546a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953803cd10 0x7f95380e11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f9546a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95380dda80 con 0x7f95380dcf60 2024-08-17T02:46:22.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f9546a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953803de20 con 0x7f953803cd10 2024-08-17T02:46:22.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f9546a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953803d210 con 0x7f95380dd330 2024-08-17T02:46:22.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7fd27de00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700530d0 con 0x7fd2700e6620 2024-08-17T02:46:22.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7fd27de00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700524c0 con 0x7fd2700e6250 2024-08-17T02:46:22.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7fd27de00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700527a0 con 0x7fd270055210 2024-08-17T02:46:22.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.177+0000 7f4748a00640 1 -- 172.21.15.2:0/720798342 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473802ad00 con 0x7f4744053b20 2024-08-17T02:46:22.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7fd27d400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd270055690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f4748a00640 1 -- 172.21.15.2:0/720798342 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473802ae60 con 0x7f4744053b20 2024-08-17T02:46:22.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f4748a00640 1 -- 172.21.15.2:0/720798342 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738032670 con 0x7f4744053b20 2024-08-17T02:46:22.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7fd27d400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd270055690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35740/0 (socket says 172.21.15.2:35740) 2024-08-17T02:46:22.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7fd27d400640 1 -- 172.21.15.2:0/3711072504 learned_addr learned my addr 172.21.15.2:0/3711072504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7fd27ca00640 1 --2- 172.21.15.2:0/3711072504 >> v2:172.21.15.26:3300/0 conn(0x7fd2700e6250 0x7fd27000d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f953fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95380dcf60 0x7f9538037ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f953f400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380dd330 0x7f95380ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f953f400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380dd330 0x7f95380ee140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35760/0 (socket says 172.21.15.2:35760) 2024-08-17T02:46:22.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f953f400640 1 -- 172.21.15.2:0/4162733020 learned_addr learned my addr 172.21.15.2:0/4162733020 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f9544a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953803cd10 0x7f95380e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f474b200640 1 -- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4744053b20 msgr2=0x7f4744006180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f474b200640 1 --2- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4744053b20 0x7f4744006180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4744058f70 tx=0x7f47380090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7fd27d400640 1 -- 172.21.15.2:0/3711072504 >> v2:172.21.15.26:3300/0 conn(0x7fd2700e6250 msgr2=0x7fd27000d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7fd27d400640 1 --2- 172.21.15.2:0/3711072504 >> v2:172.21.15.26:3300/0 conn(0x7fd2700e6250 0x7fd27000d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7fd27d400640 1 -- 172.21.15.2:0/3711072504 >> v2:172.21.15.2:3300/0 conn(0x7fd2700e6620 msgr2=0x7fd27000ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7fd27d400640 1 --2- 172.21.15.2:0/3711072504 >> v2:172.21.15.2:3300/0 conn(0x7fd2700e6620 0x7fd27000ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7fd27d400640 1 -- 172.21.15.2:0/3711072504 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270052a80 con 0x7fd270055210 2024-08-17T02:46:22.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f9544a00640 1 -- 172.21.15.2:0/4162733020 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380dd330 msgr2=0x7f95380ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f9544a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380dd330 0x7f95380ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f9544a00640 1 -- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95380dcf60 msgr2=0x7f9538037ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f9544a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95380dcf60 0x7f9538037ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f9544a00640 1 -- 172.21.15.2:0/4162733020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953803d4f0 con 0x7f953803cd10 2024-08-17T02:46:22.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f70b2800640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f70ac036c90 0x7f70ac034ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:46422/0 (socket says 172.21.15.2:46422) 2024-08-17T02:46:22.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f70b2800640 1 -- 172.21.15.2:0/1804062574 learned_addr learned my addr 172.21.15.2:0/1804062574 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:22.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f70b1e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac037060 0x7f70ac0dd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.178+0000 7f83c1600640 1 -- 172.21.15.2:0/1366387468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b402ab20 con 0x7f83bc0e6280 2024-08-17T02:46:22.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f83c1600640 1 -- 172.21.15.2:0/1366387468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b402ac80 con 0x7f83bc0e6280 2024-08-17T02:46:22.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f83c1600640 1 -- 172.21.15.2:0/1366387468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4032440 con 0x7f83bc0e6280 2024-08-17T02:46:22.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f70b3200640 1 --2- 172.21.15.2:0/1804062574 >> v2:172.21.15.2:3300/0 conn(0x7f70ac0dd9a0 0x7f70ac04fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f70b1e00640 1 -- 172.21.15.2:0/1804062574 >> v2:172.21.15.2:3300/0 conn(0x7f70ac0dd9a0 msgr2=0x7f70ac04fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f9544a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953803cd10 0x7f95380e11b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9540060af0 tx=0x7f95400ae000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f70b1e00640 1 --2- 172.21.15.2:0/1804062574 >> v2:172.21.15.2:3300/0 conn(0x7f70ac0dd9a0 0x7f70ac04fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f70b1e00640 1 -- 172.21.15.2:0/1804062574 >> v1:172.21.15.26:6789/0 conn(0x7f70ac036c90 legacy=0x7f70ac034ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.179+0000 7f70b1e00640 1 -- 172.21.15.2:0/1804062574 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0e1300 con 0x7f70ac037060 2024-08-17T02:46:22.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f9533400640 1 -- 172.21.15.2:0/4162733020 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400a5040 con 0x7f953803cd10 2024-08-17T02:46:22.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f474b200640 1 -- 172.21.15.2:0/720798342 shutdown_connections 2024-08-17T02:46:22.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f9533400640 1 -- 172.21.15.2:0/4162733020 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95400b5660 con 0x7f953803cd10 2024-08-17T02:46:22.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f9533400640 1 -- 172.21.15.2:0/4162733020 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400b59e0 con 0x7f953803cd10 2024-08-17T02:46:22.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f474b200640 1 --2- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f47440066c0 0x7f47440ea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f474b200640 1 --2- 172.21.15.2:0/720798342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4744053b20 0x7f4744006180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f474b200640 1 --2- 172.21.15.2:0/720798342 >> v2:172.21.15.2:3300/0 conn(0x7f47440cfb40 0x7f47440535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f474b200640 1 -- 172.21.15.2:0/720798342 >> 172.21.15.2:0/720798342 conn(0x7f4744055a10 msgr2=0x7f4744055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953803d7d0 con 0x7f953803cd10 2024-08-17T02:46:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f83c3e00640 1 -- 172.21.15.2:0/1366387468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e6280 msgr2=0x7f83bc0e5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.180+0000 7f83c3e00640 1 --2- 172.21.15.2:0/1366387468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e6280 0x7f83bc0e5090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009890 tx=0x7f83b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f83c3e00640 1 -- 172.21.15.2:0/1366387468 shutdown_connections 2024-08-17T02:46:22.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f83c3e00640 1 --2- 172.21.15.2:0/1366387468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e6280 0x7f83bc0e5090 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f83c3e00640 1 -- 172.21.15.2:0/1366387468 >> 172.21.15.2:0/1366387468 conn(0x7f83bc051600 msgr2=0x7f83bc051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f83c3e00640 1 -- 172.21.15.2:0/1366387468 shutdown_connections 2024-08-17T02:46:22.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f474b200640 1 -- 172.21.15.2:0/720798342 shutdown_connections 2024-08-17T02:46:22.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f83c3e00640 1 -- 172.21.15.2:0/1366387468 wait complete. 2024-08-17T02:46:22.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f474b200640 1 -- 172.21.15.2:0/720798342 wait complete. 2024-08-17T02:46:22.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f70b1e00640 1 --2- 172.21.15.2:0/1804062574 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac037060 0x7f70ac0dd460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f70a400fad0 tx=0x7f70a40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e149f843f974a4f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7fd27d400640 1 --2- 172.21.15.2:0/3711072504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd270055690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd27000eca0 tx=0x7fd26c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68791ad72bbf7a8e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95380ee680 con 0x7f953803cd10 2024-08-17T02:46:22.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7fd277400640 1 -- 172.21.15.2:0/3711072504 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c02add0 con 0x7fd270055210 2024-08-17T02:46:22.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.182+0000 7f70b1400640 1 -- 172.21.15.2:0/1804062574 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4033510 con 0x7f70ac037060 2024-08-17T02:46:22.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.182+0000 7f70b1400640 1 -- 172.21.15.2:0/1804062574 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4031050 con 0x7f70ac037060 2024-08-17T02:46:22.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.182+0000 7f70b1400640 1 -- 172.21.15.2:0/1804062574 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40338e0 con 0x7f70ac037060 2024-08-17T02:46:22.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7fd277400640 1 -- 172.21.15.2:0/3711072504 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c032440 con 0x7fd270055210 2024-08-17T02:46:22.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.181+0000 7fd277400640 1 -- 172.21.15.2:0/3711072504 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c032820 con 0x7fd270055210 2024-08-17T02:46:22.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.182+0000 7f4899600640 1 Processor -- start 2024-08-17T02:46:22.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.182+0000 7f4899600640 1 -- start start 2024-08-17T02:46:22.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f70b8a00640 1 -- 172.21.15.2:0/1804062574 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac037060 msgr2=0x7f70ac0dd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f70b8a00640 1 --2- 172.21.15.2:0/1804062574 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac037060 0x7f70ac0dd460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f70a400fad0 tx=0x7f70a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7fd27de00640 1 -- 172.21.15.2:0/3711072504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 msgr2=0x7fd270055690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f83c3e00640 1 Processor -- start 2024-08-17T02:46:22.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7fd27de00640 1 --2- 172.21.15.2:0/3711072504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd270055690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd27000eca0 tx=0x7fd26c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953803df90 con 0x7f953803cd10 2024-08-17T02:46:22.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f83c3e00640 1 -- start start 2024-08-17T02:46:22.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f70b8a00640 1 -- 172.21.15.2:0/1804062574 shutdown_connections 2024-08-17T02:46:22.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f70b8a00640 1 --2- 172.21.15.2:0/1804062574 >> v2:172.21.15.2:3300/0 conn(0x7f70ac0dd9a0 0x7f70ac04fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f70b8a00640 1 --2- 172.21.15.2:0/1804062574 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac037060 0x7f70ac0dd460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.183+0000 7f70b8a00640 1 -- 172.21.15.2:0/1804062574 >> 172.21.15.2:0/1804062574 conn(0x7f70ac054b90 msgr2=0x7f70ac054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7fd27de00640 1 -- 172.21.15.2:0/3711072504 shutdown_connections 2024-08-17T02:46:22.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f70b8a00640 1 -- 172.21.15.2:0/1804062574 shutdown_connections 2024-08-17T02:46:22.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7fd27de00640 1 --2- 172.21.15.2:0/3711072504 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd270055690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7fd27de00640 1 --2- 172.21.15.2:0/3711072504 >> v2:172.21.15.2:3300/0 conn(0x7fd2700e6620 0x7fd27000ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7fd27de00640 1 --2- 172.21.15.2:0/3711072504 >> v2:172.21.15.26:3300/0 conn(0x7fd2700e6250 0x7fd27000d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7fd27de00640 1 -- 172.21.15.2:0/3711072504 >> 172.21.15.2:0/3711072504 conn(0x7fd27000a790 msgr2=0x7fd270056d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f4899600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48940cc710 0x7f48940ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f4899600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f48940ca350 0x7f48940ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f4899600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940cd0b0 con 0x7f489415d010 2024-08-17T02:46:22.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f4899600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489406f210 con 0x7f48940cc710 2024-08-17T02:46:22.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f4899600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48940b0c10 con 0x7f48940ca350 2024-08-17T02:46:22.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f4892a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f489415d010 0x7f48940cf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44222/0 (socket says 172.21.15.2:44222) 2024-08-17T02:46:22.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f4892a00640 1 -- 172.21.15.2:0/3360107906 learned_addr learned my addr 172.21.15.2:0/3360107906 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:22.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7fd27de00640 1 -- 172.21.15.2:0/3711072504 shutdown_connections 2024-08-17T02:46:22.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7f4892000640 1 --2- 172.21.15.2:0/3360107906 >> v2:172.21.15.2:3300/0 conn(0x7f48940cc710 0x7f48940ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7f4893400640 1 --2- 172.21.15.2:0/3360107906 >> v2:172.21.15.26:3300/0 conn(0x7f48940ca350 0x7f48940ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7fc91fa00640 1 Processor -- start 2024-08-17T02:46:22.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7f83c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e55d0 0x7f83bc0d9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7fc91fa00640 1 -- start start 2024-08-17T02:46:22.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7f9533400640 1 -- 172.21.15.2:0/4162733020 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95400b5d50 con 0x7f953803cd10 2024-08-17T02:46:22.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.186+0000 7f83c3e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83bc0e5eb0 0x7f83bc037930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.186+0000 7f83c3e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83bc0e6280 0x7f83bc037e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.186+0000 7f83c2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e55d0 0x7f83bc0d9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.186+0000 7f83c2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e55d0 0x7f83bc0d9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44580/0 (socket says 172.21.15.2:44580) 2024-08-17T02:46:22.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.186+0000 7f83c3400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83bc0e6280 0x7f83bc037e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f83c3400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83bc0e6280 0x7f83bc037e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53344/0 (socket says 172.21.15.2:53344) 2024-08-17T02:46:22.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f83c3400640 1 -- 172.21.15.2:0/3628682817 learned_addr learned my addr 172.21.15.2:0/3628682817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7f4893400640 1 -- 172.21.15.2:0/3360107906 >> v2:172.21.15.2:3300/0 conn(0x7f48940cc710 msgr2=0x7f48940ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7f4893400640 1 --2- 172.21.15.2:0/3360107906 >> v2:172.21.15.2:3300/0 conn(0x7f48940cc710 0x7f48940ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7f4893400640 1 -- 172.21.15.2:0/3360107906 >> v1:172.21.15.2:6789/0 conn(0x7f489415d010 legacy=0x7f48940cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7f4893400640 1 -- 172.21.15.2:0/3360107906 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940b0e90 con 0x7f48940ca350 2024-08-17T02:46:22.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0e25b0 con 0x7f83bc0e55d0 2024-08-17T02:46:22.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc038480 con 0x7f83bc0e6280 2024-08-17T02:46:22.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f474b200640 1 Processor -- start 2024-08-17T02:46:22.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f83c2000640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83bc0e5eb0 0x7f83bc037930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.185+0000 7fd27de00640 1 -- 172.21.15.2:0/3711072504 wait complete. 2024-08-17T02:46:22.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc038760 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.184+0000 7f70b8a00640 1 -- 172.21.15.2:0/1804062574 wait complete. 2024-08-17T02:46:22.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7fd27de00640 1 Processor -- start 2024-08-17T02:46:22.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f70b8a00640 1 Processor -- start 2024-08-17T02:46:22.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f4893400640 1 --2- 172.21.15.2:0/3360107906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 0x7f48940ca740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4894160bd0 tx=0x7f488c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=980858c9b7db6fe2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc91fa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9180cb0d0 0x7fc918158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc91fa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cda30 0x7fc9180cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc91fa00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9180af9a0 con 0x7fc9181589e0 2024-08-17T02:46:22.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc91fa00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9180af810 con 0x7fc9180cb0d0 2024-08-17T02:46:22.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc91fa00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180ce740 con 0x7fc9180cda30 2024-08-17T02:46:22.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7f70b8a00640 1 -- start start 2024-08-17T02:46:22.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc917e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9180cb0d0 0x7fc918158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7f9533400640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9520065250 0x7f9520067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f83c2000640 1 -- 172.21.15.2:0/3628682817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83bc0e6280 msgr2=0x7f83bc037e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f83c2000640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83bc0e6280 0x7f83bc037e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f83c2000640 1 -- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e55d0 msgr2=0x7f83bc0d9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc91da00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cda30 0x7fc9180cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc91da00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cda30 0x7fc9180cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35784/0 (socket says 172.21.15.2:35784) 2024-08-17T02:46:22.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.187+0000 7f474b200640 1 -- start start 2024-08-17T02:46:22.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f474b200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47440066c0 0x7f47440cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f474b200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4744053b20 0x7f47440e5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f474b200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440cfb40 0x7f47440503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f474b200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474403a420 con 0x7f47440cfb40 2024-08-17T02:46:22.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f474b200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440388f0 con 0x7f47440066c0 2024-08-17T02:46:22.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f474b200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4744039e60 con 0x7f4744053b20 2024-08-17T02:46:22.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f70b8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70ac036c90 0x7f70ac0db370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f70b8a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ac037060 0x7f70ac050540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f70b8a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac0dd9a0 0x7f70ac050a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f70b8a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac050fc0 con 0x7f70ac036c90 2024-08-17T02:46:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f70b8a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac054020 con 0x7f70ac037060 2024-08-17T02:46:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f70b8a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac053410 con 0x7f70ac0dd9a0 2024-08-17T02:46:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fc91da00640 1 -- 172.21.15.2:0/1713796856 learned_addr learned my addr 172.21.15.2:0/1713796856 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f83c2000640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e55d0 0x7f83bc0d9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f83c2000640 1 -- 172.21.15.2:0/3628682817 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009450 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f83c2a00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e55d0 0x7f83bc0d9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7f9533400640 1 -- 172.21.15.2:0/4162733020 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9540118160 con 0x7f953803cd10 2024-08-17T02:46:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f953fe00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9520065250 0x7f9520067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f4749e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47440066c0 0x7f47440cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f4749400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4744053b20 0x7f47440e5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f4749400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4744053b20 0x7f47440e5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35806/0 (socket says 172.21.15.2:35806) 2024-08-17T02:46:22.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f4749400640 1 -- 172.21.15.2:0/4055528309 learned_addr learned my addr 172.21.15.2:0/4055528309 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.188+0000 7fd27de00640 1 -- start start 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd27de00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd2700e1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd27de00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2700e6250 0x7fd27004dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd27de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2700e6620 0x7fd2700e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd27de00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27003b1a0 con 0x7fd2700e6620 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd27de00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27003b9d0 con 0x7fd2700e6250 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd27de00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27003a840 con 0x7fd270055210 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b1e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ac037060 0x7f70ac050540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b1e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ac037060 0x7f70ac050540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53346/0 (socket says 172.21.15.2:53346) 2024-08-17T02:46:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b1e00640 1 -- 172.21.15.2:0/3161232688 learned_addr learned my addr 172.21.15.2:0/3161232688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b3200640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac0dd9a0 0x7f70ac050a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b1e00640 1 -- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac0dd9a0 msgr2=0x7f70ac050a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b1e00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac0dd9a0 0x7f70ac050a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b1e00640 1 -- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70ac036c90 msgr2=0x7f70ac0db370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b1e00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70ac036c90 0x7f70ac0db370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b1e00640 1 -- 172.21.15.2:0/3161232688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a400f610 con 0x7f70ac037060 2024-08-17T02:46:22.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f83c2000640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83bc0e5eb0 0x7f83bc037930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83b4031000 tx=0x7f83b4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd277e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2700e6250 0x7fd27004dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd277e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2700e6250 0x7fd27004dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:53372/0 (socket says 172.21.15.2:53372) 2024-08-17T02:46:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fd277e00640 1 -- 172.21.15.2:0/3259870543 learned_addr learned my addr 172.21.15.2:0/3259870543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f4749e00640 1 -- 172.21.15.2:0/4055528309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4744053b20 msgr2=0x7f47440e5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7f70b3200640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac0dd9a0 0x7f70ac050a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f4749e00640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4744053b20 0x7f47440e5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f4749e00640 1 -- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440cfb40 msgr2=0x7f47440503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f70b1e00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ac037060 0x7f70ac050540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70a400f5e0 tx=0x7f70a4039000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.189+0000 7fc91da00640 1 -- 172.21.15.2:0/1713796856 >> v2:172.21.15.2:3300/0 conn(0x7fc9180cb0d0 msgr2=0x7fc918158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fc91da00640 1 --2- 172.21.15.2:0/1713796856 >> v2:172.21.15.2:3300/0 conn(0x7fc9180cb0d0 0x7fc918158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fc91da00640 1 -- 172.21.15.2:0/1713796856 >> v1:172.21.15.26:6789/0 conn(0x7fc9181589e0 legacy=0x7fc9180ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f4749e00640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440cfb40 0x7f47440503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7fd27ca00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd2700e1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.190+0000 7fc91da00640 1 -- 172.21.15.2:0/1713796856 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9180cea00 con 0x7fc9180cda30 2024-08-17T02:46:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f4749e00640 1 -- 172.21.15.2:0/4055528309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4738009390 con 0x7f47440066c0 2024-08-17T02:46:22.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7fd27d400640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2700e6620 0x7fd2700e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f4749400640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4744053b20 0x7f47440e5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f83ba000640 1 -- 172.21.15.2:0/3628682817 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b403c620 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f83ba000640 1 -- 172.21.15.2:0/3628682817 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b403c7c0 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f83ba000640 1 -- 172.21.15.2:0/3628682817 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b403cb80 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc038a40 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7fd277e00640 1 -- 172.21.15.2:0/3259870543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 msgr2=0x7fd2700e1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7fd277e00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd2700e1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7fd277e00640 1 -- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2700e6620 msgr2=0x7fd2700e38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7fd277e00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2700e6620 0x7fd2700e38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f4749e00640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47440066c0 0x7f47440cb9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f474c065320 tx=0x7f474c064990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7fd277e00640 1 -- 172.21.15.2:0/3259870543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c009450 con 0x7fd2700e6250 2024-08-17T02:46:22.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7fd27d400640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2700e6620 0x7fd2700e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:22.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f953fe00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9520065250 0x7f9520067700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f953800df40 tx=0x7f9534011040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.191+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc039000 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7fd277e00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2700e6250 0x7fd27004dde0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd26400b5e0 tx=0x7fd264009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7fc917e00640 1 --2- 172.21.15.2:0/1713796856 >> v2:172.21.15.2:3300/0 conn(0x7fc9180cb0d0 0x7fc918158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f70aa000640 1 -- 172.21.15.2:0/3161232688 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40357e0 con 0x7f70ac037060 2024-08-17T02:46:22.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f4741600640 1 -- 172.21.15.2:0/4055528309 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0705f0 con 0x7f47440066c0 2024-08-17T02:46:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ac0536f0 con 0x7f70ac037060 2024-08-17T02:46:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f4741600640 1 -- 172.21.15.2:0/4055528309 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c070750 con 0x7f47440066c0 2024-08-17T02:46:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f4741600640 1 -- 172.21.15.2:0/4055528309 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c08f430 con 0x7f47440066c0 2024-08-17T02:46:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac053cb0 con 0x7f70ac037060 2024-08-17T02:46:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f70aa000640 1 -- 172.21.15.2:0/3161232688 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400c070 con 0x7f70ac037060 2024-08-17T02:46:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7f70aa000640 1 -- 172.21.15.2:0/3161232688 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4035b90 con 0x7f70ac037060 2024-08-17T02:46:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7fc91da00640 1 --2- 172.21.15.2:0/1713796856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cda30 0x7fc9180cdeb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc910009f20 tx=0x7fc910009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e15e8f6e88c1ce9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7f9533400640 1 -- 172.21.15.2:0/4162733020 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95400e6350 con 0x7f953803cd10 2024-08-17T02:46:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7fd26be00640 1 -- 172.21.15.2:0/3259870543 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400f590 con 0x7fd2700e6250 2024-08-17T02:46:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7fd26be00640 1 -- 172.21.15.2:0/3259870543 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26400f6f0 con 0x7fd2700e6250 2024-08-17T02:46:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.192+0000 7fd26be00640 1 -- 172.21.15.2:0/3259870543 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400fab0 con 0x7fd2700e6250 2024-08-17T02:46:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27003b380 con 0x7fd2700e6250 2024-08-17T02:46:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7f4891600640 1 -- 172.21.15.2:0/3360107906 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c007550 con 0x7f48940ca350 2024-08-17T02:46:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7f4891600640 1 -- 172.21.15.2:0/3360107906 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c02d050 con 0x7f48940ca350 2024-08-17T02:46:22.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7f4891600640 1 -- 172.21.15.2:0/3360107906 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c007920 con 0x7f48940ca350 2024-08-17T02:46:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7fc917400640 1 -- 172.21.15.2:0/1713796856 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91002e050 con 0x7fc9180cda30 2024-08-17T02:46:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474403a140 con 0x7f47440066c0 2024-08-17T02:46:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2700e2300 con 0x7fd2700e6250 2024-08-17T02:46:22.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c005210 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7fc917400640 1 -- 172.21.15.2:0/1713796856 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910007400 con 0x7fc9180cda30 2024-08-17T02:46:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7fc917400640 1 -- 172.21.15.2:0/1713796856 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9100077e0 con 0x7fc9180cda30 2024-08-17T02:46:22.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.193+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47440cbf00 con 0x7f47440066c0 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.194+0000 7f4899600640 1 -- 172.21.15.2:0/3360107906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 msgr2=0x7f48940ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.194+0000 7f4899600640 1 --2- 172.21.15.2:0/3360107906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 0x7f48940ca740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4894160bd0 tx=0x7f488c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.194+0000 7f4899600640 1 -- 172.21.15.2:0/3360107906 shutdown_connections 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.194+0000 7f4899600640 1 --2- 172.21.15.2:0/3360107906 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 0x7f48940ca740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.194+0000 7f4899600640 1 --2- 172.21.15.2:0/3360107906 >> v2:172.21.15.2:3300/0 conn(0x7f48940cc710 0x7f48940ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.194+0000 7f4899600640 1 -- 172.21.15.2:0/3360107906 >> 172.21.15.2:0/3360107906 conn(0x7f4894068680 msgr2=0x7f4894068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.195+0000 7f4899600640 1 -- 172.21.15.2:0/3360107906 shutdown_connections 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.195+0000 7fc91fa00640 1 -- 172.21.15.2:0/1713796856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cda30 msgr2=0x7fc9180cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.195+0000 7fc91fa00640 1 --2- 172.21.15.2:0/1713796856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cda30 0x7fc9180cdeb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc910009f20 tx=0x7fc910009840 comp rx=0 tx=0).stop 2024-08-17T02:46:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.195+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27003bb40 con 0x7fd2700e6250 2024-08-17T02:46:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.197+0000 7fc91fa00640 1 -- 172.21.15.2:0/1713796856 shutdown_connections 2024-08-17T02:46:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.197+0000 7fc91fa00640 1 --2- 172.21.15.2:0/1713796856 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cda30 0x7fc9180cdeb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.197+0000 7fc91fa00640 1 --2- 172.21.15.2:0/1713796856 >> v2:172.21.15.2:3300/0 conn(0x7fc9180cb0d0 0x7fc918158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.197+0000 7fc91fa00640 1 -- 172.21.15.2:0/1713796856 >> 172.21.15.2:0/1713796856 conn(0x7fc91806e590 msgr2=0x7fc91806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.197+0000 7f70aa000640 1 -- 172.21.15.2:0/3161232688 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f70a403e420 con 0x7f70ac037060 2024-08-17T02:46:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.197+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c005210 con 0x7f70ac037060 2024-08-17T02:46:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.195+0000 7f4899600640 1 -- 172.21.15.2:0/3360107906 wait complete. 2024-08-17T02:46:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.198+0000 7fd26be00640 1 -- 172.21.15.2:0/3259870543 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd2640358d0 con 0x7fd2700e6250 2024-08-17T02:46:22.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.198+0000 7fc91fa00640 1 -- 172.21.15.2:0/1713796856 shutdown_connections 2024-08-17T02:46:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.197+0000 7f4899600640 1 Processor -- start 2024-08-17T02:46:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.198+0000 7f4899600640 1 -- start start 2024-08-17T02:46:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.195+0000 7f83ba000640 1 -- 172.21.15.2:0/3628682817 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f83b4039070 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.196+0000 7f4741600640 1 -- 172.21.15.2:0/4055528309 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f474c08f860 con 0x7f47440066c0 2024-08-17T02:46:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.198+0000 7f83ba000640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f83a40652a0 0x7f83a4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.197+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47440056a0 con 0x7f47440066c0 2024-08-17T02:46:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.198+0000 7f4741600640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f472c065150 0x7f472c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.198+0000 7f4741600640 1 -- 172.21.15.2:0/4055528309 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f474c0f86a0 con 0x7f47440066c0 2024-08-17T02:46:22.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.199+0000 7fd26be00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd258065220 0x7fd2580676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.199+0000 7f83ba000640 1 -- 172.21.15.2:0/3628682817 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f83b40a2410 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.199+0000 7fd26be00640 1 -- 172.21.15.2:0/3259870543 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd264082420 con 0x7fd2700e6250 2024-08-17T02:46:22.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.199+0000 7f4749400640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f472c065150 0x7f472c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.199+0000 7f70aa000640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7094065150 0x7f7094067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.199+0000 7f70aa000640 1 -- 172.21.15.2:0/3161232688 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70a40a35f0 con 0x7f70ac037060 2024-08-17T02:46:22.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.199+0000 7f83c2a00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f83a40652a0 0x7f83a4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.199+0000 7fd27ca00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd258065220 0x7fd2580676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.198+0000 7fc91fa00640 1 -- 172.21.15.2:0/1713796856 wait complete. 2024-08-17T02:46:22.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.200+0000 7fc91fa00640 1 Processor -- start 2024-08-17T02:46:22.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.200+0000 7fd27ca00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd258065220 0x7fd2580676d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd278000b60 tx=0x7fd278088040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.201+0000 7fd26be00640 1 -- 172.21.15.2:0/3259870543 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd264050600 con 0x7fd2700e6250 2024-08-17T02:46:22.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.201+0000 7f70b2800640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7094065150 0x7f7094067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.201+0000 7f4899600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 0x7f48940b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.201+0000 7f4899600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48940cc710 0x7f4894179c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.201+0000 7f4899600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f489415d010 0x7f4894159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.200+0000 7fc91fa00640 1 -- start start 2024-08-17T02:46:22.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.201+0000 7fc91fa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cb0d0 0x7fc9181757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91fa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9180cda30 0x7fc91815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4892000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48940cc710 0x7f4894179c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4893400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f489415d010 0x7f4894159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4892000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48940cc710 0x7f4894179c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35818/0 (socket says 172.21.15.2:35818) 2024-08-17T02:46:22.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4893400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f489415d010 0x7f4894159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44638/0 (socket says 172.21.15.2:44638) 2024-08-17T02:46:22.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91fa00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9181589e0 0x7fc91814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91d000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cb0d0 0x7fc9181757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91fa00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918175d00 con 0x7fc9180cda30 2024-08-17T02:46:22.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91d000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cb0d0 0x7fc9181757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:35832/0 (socket says 172.21.15.2:35832) 2024-08-17T02:46:22.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91d000640 1 -- 172.21.15.2:0/2765742050 learned_addr learned my addr 172.21.15.2:0/2765742050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc917e00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9180cda30 0x7fc91815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4892000640 1 -- 172.21.15.2:0/4033759934 learned_addr learned my addr 172.21.15.2:0/4033759934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4899600640 1 -- 172.21.15.2:0/4033759934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940c8620 con 0x7f489415d010 2024-08-17T02:46:22.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4899600640 1 -- 172.21.15.2:0/4033759934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940c8900 con 0x7f48940ca350 2024-08-17T02:46:22.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4899600640 1 -- 172.21.15.2:0/4033759934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940c8be0 con 0x7f48940cc710 2024-08-17T02:46:22.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91815a370 con 0x7fc9181589e0 2024-08-17T02:46:22.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7f4892a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 0x7f48940b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91815a650 con 0x7fc9180cb0d0 2024-08-17T02:46:22.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.202+0000 7fc91da00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9181589e0 0x7fc91814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7f4749400640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f472c065150 0x7f472c067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47440f9c40 tx=0x7f4738032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7f83ba000640 1 -- 172.21.15.2:0/3628682817 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f83b4070560 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7f83c2a00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f83a40652a0 0x7f83a4067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f83c4060af0 tx=0x7f83c4088040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7f70b2800640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7094065150 0x7f7094067600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70b4000b60 tx=0x7f70b4064990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7fc91da00640 1 -- 172.21.15.2:0/2765742050 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cb0d0 msgr2=0x7fc9181757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7fc91da00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cb0d0 0x7fc9181757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7fc91da00640 1 -- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9180cda30 msgr2=0x7fc91815b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7fc91da00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9180cda30 0x7fc91815b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7fc91da00640 1 -- 172.21.15.2:0/2765742050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910009ae0 con 0x7fc9181589e0 2024-08-17T02:46:22.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7f4892000640 1 -- 172.21.15.2:0/4033759934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 msgr2=0x7f48940b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7f4892000640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 0x7f48940b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.203+0000 7f4892000640 1 -- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f489415d010 msgr2=0x7f4894159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.204+0000 7f4892000640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f489415d010 0x7f4894159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.204+0000 7f4892000640 1 -- 172.21.15.2:0/4033759934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c009a20 con 0x7f48940cc710 2024-08-17T02:46:22.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.204+0000 7f4893400640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f489415d010 0x7f4894159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:22.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.204+0000 7fc91da00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9181589e0 0x7fc91814b8d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc910031000 tx=0x7fc910037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.204+0000 7f4892000640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48940cc710 0x7f4894179c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f488000d890 tx=0x7f4880008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.205+0000 7f488a000640 1 -- 172.21.15.2:0/4033759934 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000de20 con 0x7f48940cc710 2024-08-17T02:46:22.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.205+0000 7f488a000640 1 -- 172.21.15.2:0/4033759934 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800098b0 con 0x7f48940cc710 2024-08-17T02:46:22.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.205+0000 7f488a000640 1 -- 172.21.15.2:0/4033759934 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880009c50 con 0x7f48940cc710 2024-08-17T02:46:22.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.205+0000 7f4741600640 1 -- 172.21.15.2:0/4055528309 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f474c0c6830 con 0x7f47440066c0 2024-08-17T02:46:22.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.209+0000 7fc90fe00640 1 -- 172.21.15.2:0/2765742050 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91003c410 con 0x7fc9181589e0 2024-08-17T02:46:22.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.209+0000 7fc90fe00640 1 -- 172.21.15.2:0/2765742050 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91003c590 con 0x7fc9181589e0 2024-08-17T02:46:22.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.209+0000 7fc90fe00640 1 -- 172.21.15.2:0/2765742050 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91003c990 con 0x7fc9181589e0 2024-08-17T02:46:22.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.209+0000 7f4899600640 1 -- 172.21.15.2:0/4033759934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48940c8ec0 con 0x7f48940cc710 2024-08-17T02:46:22.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.209+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91815a930 con 0x7fc9181589e0 2024-08-17T02:46:22.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.210+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91815aef0 con 0x7fc9181589e0 2024-08-17T02:46:22.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.210+0000 7f4899600640 1 -- 172.21.15.2:0/4033759934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48940c81d0 con 0x7f48940cc710 2024-08-17T02:46:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.211+0000 7f70aa000640 1 -- 172.21.15.2:0/3161232688 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f70a40716b0 con 0x7f70ac037060 2024-08-17T02:46:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.211+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91815b0e0 con 0x7fc9181589e0 2024-08-17T02:46:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.211+0000 7f487f400640 1 -- 172.21.15.2:0/4033759934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4894063fb0 con 0x7f48940cc710 2024-08-17T02:46:22.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.213+0000 7f488a000640 1 -- 172.21.15.2:0/4033759934 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4880014620 con 0x7f48940cc710 2024-08-17T02:46:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.213+0000 7fc90fe00640 1 -- 172.21.15.2:0/2765742050 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc910039050 con 0x7fc9181589e0 2024-08-17T02:46:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.214+0000 7fc90fe00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc8f80652a0 0x7fc8f8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.215+0000 7f488a000640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f48740652a0 0x7f4874067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.215+0000 7fc91d000640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc8f80652a0 0x7fc8f8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.216+0000 7f4892a00640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f48740652a0 0x7f4874067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.216+0000 7fc90fe00640 1 -- 172.21.15.2:0/2765742050 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9100a3020 con 0x7fc9181589e0 2024-08-17T02:46:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.217+0000 7fc91d000640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc8f80652a0 0x7fc8f8067750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9080037e0 tx=0x7fc908009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.217+0000 7f488a000640 1 -- 172.21.15.2:0/4033759934 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4880082c20 con 0x7f48940cc710 2024-08-17T02:46:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.218+0000 7f4892a00640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f48740652a0 0x7f4874067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f4884009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.219+0000 7f488a000640 1 -- 172.21.15.2:0/4033759934 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4880050cc0 con 0x7f48940cc710 2024-08-17T02:46:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.219+0000 7fc90fe00640 1 -- 172.21.15.2:0/2765742050 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc9100d4e40 con 0x7fc9181589e0 2024-08-17T02:46:22.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.526+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe5180054c0 con 0x7fe5340cfd40 2024-08-17T02:46:22.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.527+0000 7fe538c00640 1 -- 172.21.15.2:0/1790783875 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe528053550 con 0x7fe5340cfd40 2024-08-17T02:46:22.528 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:22.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.531+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe51c0651d0 msgr2=0x7fe51c067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.531+0000 7fe542e00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe51c0651d0 0x7fe51c067680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe53c000b60 tx=0x7fe53c064990 comp rx=0 tx=0).stop 2024-08-17T02:46:22.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.531+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5340cfd40 msgr2=0x7fe534051530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.531+0000 7fe542e00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5340cfd40 0x7fe534051530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe534011cf0 tx=0x7fe528007bf0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.532+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 shutdown_connections 2024-08-17T02:46:22.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.532+0000 7fe542e00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5340cfd40 0x7fe534051530 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.532+0000 7fe542e00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5340cf970 0x7fe5340e9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.532+0000 7fe542e00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe51c0651d0 0x7fe51c067680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.532+0000 7fe542e00640 1 --2- 172.21.15.2:0/1790783875 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe5340078e0 0x7fe53403e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.532+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 >> 172.21.15.2:0/1790783875 conn(0x7fe53400e5c0 msgr2=0x7fe534039160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.533+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 shutdown_connections 2024-08-17T02:46:22.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.533+0000 7fe542e00640 1 -- 172.21.15.2:0/1790783875 wait complete. 2024-08-17T02:46:22.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2024-08-17T02:46:22.559 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.580+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f95380056a0 con 0x7f953803cd10 2024-08-17T02:46:22.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.581+0000 7f9533400640 1 -- 172.21.15.2:0/4162733020 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95400e9970 con 0x7f953803cd10 2024-08-17T02:46:22.582 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.583+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9520065250 msgr2=0x7f9520067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.583+0000 7f9546a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9520065250 0x7f9520067700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f953800df40 tx=0x7f9534011040 comp rx=0 tx=0).stop 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.583+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953803cd10 msgr2=0x7f95380e11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.583+0000 7f9546a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953803cd10 0x7f95380e11b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9540060af0 tx=0x7f95400ae000 comp rx=0 tx=0).stop 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.584+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 shutdown_connections 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.584+0000 7f9546a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f953803cd10 0x7f95380e11b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.584+0000 7f9546a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9520065250 0x7f9520067700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.584+0000 7f9546a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95380dd330 0x7f95380ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.584+0000 7f9546a00640 1 --2- 172.21.15.2:0/4162733020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95380dcf60 0x7f9538037ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.584+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 >> 172.21.15.2:0/4162733020 conn(0x7f9538055a00 msgr2=0x7f9538056b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.584+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 shutdown_connections 2024-08-17T02:46:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.584+0000 7f9546a00640 1 -- 172.21.15.2:0/4162733020 wait complete. 2024-08-17T02:46:22.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-08-17T02:46:22.600 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.625+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f839c0054c0 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.626+0000 7f83ba000640 1 -- 172.21.15.2:0/3628682817 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83b4037020 con 0x7f83bc0e5eb0 2024-08-17T02:46:22.627 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:22.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.627+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd270005630 con 0x7fd2700e6250 2024-08-17T02:46:22.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.628+0000 7fd26be00640 1 -- 172.21.15.2:0/3259870543 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd264053c20 con 0x7fd2700e6250 2024-08-17T02:46:22.629 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2024-08-17T02:46:22.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4744038230 con 0x7f47440066c0 2024-08-17T02:46:22.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f83a40652a0 msgr2=0x7f83a4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f83a40652a0 0x7f83a4067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f83c4060af0 tx=0x7f83c4088040 comp rx=0 tx=0).stop 2024-08-17T02:46:22.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83bc0e5eb0 msgr2=0x7f83bc037930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83bc0e5eb0 0x7f83bc037930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83b4031000 tx=0x7f83b4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 shutdown_connections 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f83bc0e6280 0x7f83bc037e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f83a40652a0 0x7f83a4067750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f83bc0e5eb0 0x7f83bc037930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 --2- 172.21.15.2:0/3628682817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83bc0e55d0 0x7f83bc0d9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 >> 172.21.15.2:0/3628682817 conn(0x7f83bc051600 msgr2=0x7f83bc04b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 shutdown_connections 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7f83c3e00640 1 -- 172.21.15.2:0/3628682817 wait complete. 2024-08-17T02:46:22.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.630+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd258065220 msgr2=0x7fd2580676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd258065220 0x7fd2580676d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd278000b60 tx=0x7fd278088040 comp rx=0 tx=0).stop 2024-08-17T02:46:22.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2700e6250 msgr2=0x7fd27004dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2700e6250 0x7fd27004dde0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd26400b5e0 tx=0x7fd264009120 comp rx=0 tx=0).stop 2024-08-17T02:46:22.633 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:46:22.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7f4741600640 1 -- 172.21.15.2:0/4055528309 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f474c094090 con 0x7f47440066c0 2024-08-17T02:46:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 shutdown_connections 2024-08-17T02:46:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2700e6620 0x7fd2700e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2700e6250 0x7fd27004dde0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd258065220 0x7fd2580676d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 --2- 172.21.15.2:0/3259870543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd270055210 0x7fd2700e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 >> 172.21.15.2:0/3259870543 conn(0x7fd27000a790 msgr2=0x7fd270007ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 shutdown_connections 2024-08-17T02:46:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.631+0000 7fd27de00640 1 -- 172.21.15.2:0/3259870543 wait complete. 2024-08-17T02:46:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.633+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f472c065150 msgr2=0x7f472c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.633+0000 7f474b200640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f472c065150 0x7f472c067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47440f9c40 tx=0x7f4738032000 comp rx=0 tx=0).stop 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47440066c0 msgr2=0x7f47440cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47440066c0 0x7f47440cb9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f474c065320 tx=0x7f474c064990 comp rx=0 tx=0).stop 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 shutdown_connections 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47440cfb40 0x7f47440503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f472c065150 0x7f472c067600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4744053b20 0x7f47440e5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 --2- 172.21.15.2:0/4055528309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47440066c0 0x7f47440cb9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 >> 172.21.15.2:0/4055528309 conn(0x7f4744055a10 msgr2=0x7f47440e8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 shutdown_connections 2024-08-17T02:46:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.634+0000 7f474b200640 1 -- 172.21.15.2:0/4055528309 wait complete. 2024-08-17T02:46:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.635+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f708c005790 con 0x7f70ac037060 2024-08-17T02:46:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.636+0000 7f70aa000640 1 -- 172.21.15.2:0/3161232688 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70a4074cd0 con 0x7f70ac037060 2024-08-17T02:46:22.637 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:46:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7094065150 msgr2=0x7f7094067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7094065150 0x7f7094067600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70b4000b60 tx=0x7f70b4064990 comp rx=0 tx=0).stop 2024-08-17T02:46:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ac037060 msgr2=0x7f70ac050540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ac037060 0x7f70ac050540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70a400f5e0 tx=0x7f70a4039000 comp rx=0 tx=0).stop 2024-08-17T02:46:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 shutdown_connections 2024-08-17T02:46:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7094065150 0x7f7094067600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70ac0dd9a0 0x7f70ac050a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70ac037060 0x7f70ac050540 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 --2- 172.21.15.2:0/3161232688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70ac036c90 0x7f70ac0db370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 >> 172.21.15.2:0/3161232688 conn(0x7f70ac054b90 msgr2=0x7f70ac0dfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 shutdown_connections 2024-08-17T02:46:22.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.640+0000 7f70b8a00640 1 -- 172.21.15.2:0/3161232688 wait complete. 2024-08-17T02:46:22.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.641+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc91815a790 con 0x7fc9181589e0 2024-08-17T02:46:22.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.642+0000 7fc90fe00640 1 -- 172.21.15.2:0/2765742050 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc91815a790 con 0x7fc9181589e0 2024-08-17T02:46:22.643 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:46:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.644+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc8f80652a0 msgr2=0x7fc8f8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.644+0000 7fc91fa00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc8f80652a0 0x7fc8f8067750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9080037e0 tx=0x7fc908009040 comp rx=0 tx=0).stop 2024-08-17T02:46:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.644+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9181589e0 msgr2=0x7fc91814b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.644+0000 7fc91fa00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9181589e0 0x7fc91814b8d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc910031000 tx=0x7fc910037000 comp rx=0 tx=0).stop 2024-08-17T02:46:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.646+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 shutdown_connections 2024-08-17T02:46:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.646+0000 7fc91fa00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9181589e0 0x7fc91814b8d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.646+0000 7fc91fa00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9180cda30 0x7fc91815b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.646+0000 7fc91fa00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc8f80652a0 0x7fc8f8067750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.646+0000 7fc91fa00640 1 --2- 172.21.15.2:0/2765742050 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9180cb0d0 0x7fc9181757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.646+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 >> 172.21.15.2:0/2765742050 conn(0x7fc91806e590 msgr2=0x7fc918157460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.646+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 shutdown_connections 2024-08-17T02:46:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.646+0000 7fc91fa00640 1 -- 172.21.15.2:0/2765742050 wait complete. 2024-08-17T02:46:22.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.647+0000 7f487f400640 1 -- 172.21.15.2:0/4033759934 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f48940c8d20 con 0x7f48940cc710 2024-08-17T02:46:22.649 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2024-08-17T02:46:22.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.648+0000 7f488a000640 1 -- 172.21.15.2:0/4033759934 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48940c8d20 con 0x7f48940cc710 2024-08-17T02:46:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.651+0000 7f487f400640 1 -- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f48740652a0 msgr2=0x7f4874067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.651+0000 7f487f400640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f48740652a0 0x7f4874067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f4884009040 comp rx=0 tx=0).stop 2024-08-17T02:46:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 -- 172.21.15.2:0/4033759934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48940cc710 msgr2=0x7f4894179c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48940cc710 0x7f4894179c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f488000d890 tx=0x7f4880008040 comp rx=0 tx=0).stop 2024-08-17T02:46:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 -- 172.21.15.2:0/4033759934 shutdown_connections 2024-08-17T02:46:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f489415d010 0x7f4894159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f48740652a0 0x7f4874067750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48940cc710 0x7f4894179c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 --2- 172.21.15.2:0/4033759934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48940ca350 0x7f48940b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 -- 172.21.15.2:0/4033759934 >> 172.21.15.2:0/4033759934 conn(0x7f4894068680 msgr2=0x7f48940caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 -- 172.21.15.2:0/4033759934 shutdown_connections 2024-08-17T02:46:22.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.652+0000 7f487f400640 1 -- 172.21.15.2:0/4033759934 wait complete. 2024-08-17T02:46:22.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-08-17T02:46:22.657 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-08-17T02:46:22.658 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-08-17T02:46:22.660 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-08-17T02:46:22.665 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-08-17T02:46:22.668 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-08-17T02:46:22.673 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:22.673 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:46:22.673 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:22.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.863+0000 7f59dbe00640 1 Processor -- start 2024-08-17T02:46:22.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.864+0000 7f59dbe00640 1 -- start start 2024-08-17T02:46:22.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59dbe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f59dc0b0e30 0x7f59dc0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59dbe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f59dc15a590 0x7f59dc13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59dbe00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc06d7c0 con 0x7f59dc156f90 2024-08-17T02:46:22.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59dbe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc15ab30 con 0x7f59dc15a590 2024-08-17T02:46:22.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59dbe00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc15ae10 con 0x7f59dc0b0e30 2024-08-17T02:46:22.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59db400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f59dc15a590 0x7f59dc13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59db400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f59dc15a590 0x7f59dc13fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37810/0 (socket says 172.21.15.2:37810) 2024-08-17T02:46:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59db400640 1 -- 172.21.15.2:0/2536610425 learned_addr learned my addr 172.21.15.2:0/2536610425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.865+0000 7f59daa00640 1 --2- 172.21.15.2:0/2536610425 >> v2:172.21.15.26:3300/0 conn(0x7f59dc0b0e30 0x7f59dc0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.866+0000 7f59db400640 1 -- 172.21.15.2:0/2536610425 >> v2:172.21.15.26:3300/0 conn(0x7f59dc0b0e30 msgr2=0x7f59dc0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.866+0000 7f59db400640 1 --2- 172.21.15.2:0/2536610425 >> v2:172.21.15.26:3300/0 conn(0x7f59dc0b0e30 0x7f59dc0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.866+0000 7f59db400640 1 -- 172.21.15.2:0/2536610425 >> v1:172.21.15.26:6789/0 conn(0x7f59dc156f90 legacy=0x7f59dc0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.866+0000 7f59db400640 1 -- 172.21.15.2:0/2536610425 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc15b0f0 con 0x7f59dc15a590 2024-08-17T02:46:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.867+0000 7f59db400640 1 --2- 172.21.15.2:0/2536610425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc13fcc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0cb7e0 tx=0x7f59d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5882633050130c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.867+0000 7f59d9600640 1 -- 172.21.15.2:0/2536610425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d402e050 con 0x7f59dc15a590 2024-08-17T02:46:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.867+0000 7f59d9600640 1 -- 172.21.15.2:0/2536610425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4007400 con 0x7f59dc15a590 2024-08-17T02:46:22.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.867+0000 7f59d9600640 1 -- 172.21.15.2:0/2536610425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40077e0 con 0x7f59dc15a590 2024-08-17T02:46:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.867+0000 7f59dbe00640 1 -- 172.21.15.2:0/2536610425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 msgr2=0x7f59dc13fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.867+0000 7f59dbe00640 1 --2- 172.21.15.2:0/2536610425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc13fcc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0cb7e0 tx=0x7f59d4009840 comp rx=0 tx=0).stop 2024-08-17T02:46:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.868+0000 7f59dbe00640 1 -- 172.21.15.2:0/2536610425 shutdown_connections 2024-08-17T02:46:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.868+0000 7f59dbe00640 1 --2- 172.21.15.2:0/2536610425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc13fcc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.868+0000 7f59dbe00640 1 --2- 172.21.15.2:0/2536610425 >> v2:172.21.15.26:3300/0 conn(0x7f59dc0b0e30 0x7f59dc0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.868+0000 7f59dbe00640 1 -- 172.21.15.2:0/2536610425 >> 172.21.15.2:0/2536610425 conn(0x7f59dc062af0 msgr2=0x7f59dc062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.868+0000 7f59dbe00640 1 -- 172.21.15.2:0/2536610425 shutdown_connections 2024-08-17T02:46:22.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.868+0000 7f59dbe00640 1 -- 172.21.15.2:0/2536610425 wait complete. 2024-08-17T02:46:22.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.869+0000 7f59dbe00640 1 Processor -- start 2024-08-17T02:46:22.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.869+0000 7f59dbe00640 1 -- start start 2024-08-17T02:46:22.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59dbe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc0b0e30 0x7f59dc136280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59dbe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc156f90 0x7f59dc158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59dbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc138f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59dbe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc1587b0 con 0x7f59dc15a590 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59dbe00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc139950 con 0x7f59dc0b0e30 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59dbe00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc1367c0 con 0x7f59dc156f90 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59db400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc138f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59daa00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc0b0e30 0x7f59dc136280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59db400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc138f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37820/0 (socket says 172.21.15.2:37820) 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59db400640 1 -- 172.21.15.2:0/4196600784 learned_addr learned my addr 172.21.15.2:0/4196600784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.870+0000 7f59da000640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc156f90 0x7f59dc158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.871+0000 7f59db400640 1 -- 172.21.15.2:0/4196600784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc156f90 msgr2=0x7f59dc158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.871+0000 7f59db400640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc156f90 0x7f59dc158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.871+0000 7f59db400640 1 -- 172.21.15.2:0/4196600784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc0b0e30 msgr2=0x7f59dc136280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.871+0000 7f59db400640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc0b0e30 0x7f59dc136280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.871+0000 7f59db400640 1 -- 172.21.15.2:0/4196600784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4009ae0 con 0x7f59dc15a590 2024-08-17T02:46:22.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.871+0000 7f59db400640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc138f00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009f20 tx=0x7f59d4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.873+0000 7f59d2000640 1 -- 172.21.15.2:0/4196600784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4033e70 con 0x7f59dc15a590 2024-08-17T02:46:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.873+0000 7f59d2000640 1 -- 172.21.15.2:0/4196600784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d403c410 con 0x7f59dc15a590 2024-08-17T02:46:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.873+0000 7f59d2000640 1 -- 172.21.15.2:0/4196600784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d403c7f0 con 0x7f59dc15a590 2024-08-17T02:46:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.873+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc157e80 con 0x7f59dc15a590 2024-08-17T02:46:22.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.873+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc158440 con 0x7f59dc15a590 2024-08-17T02:46:22.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.874+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc158960 con 0x7f59dc15a590 2024-08-17T02:46:22.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.875+0000 7f59d2000640 1 -- 172.21.15.2:0/4196600784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f59d4039050 con 0x7f59dc15a590 2024-08-17T02:46:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.877+0000 7f59d2000640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f59bc065220 0x7f59bc0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.877+0000 7f59d2000640 1 -- 172.21.15.2:0/4196600784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59d40a2a70 con 0x7f59dc15a590 2024-08-17T02:46:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.877+0000 7f59daa00640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f59bc065220 0x7f59bc0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:22.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.877+0000 7f59daa00640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f59bc065220 0x7f59bc0676d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009d20 tx=0x7f59cc0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:22.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:22.881+0000 7f59d2000640 1 -- 172.21.15.2:0/4196600784 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f59dc158960 con 0x7f59dc15a590 2024-08-17T02:46:23.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.059+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59dc158960 con 0x7f59bc065220 2024-08-17T02:46:23.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.066+0000 7f59d2000640 1 -- 172.21.15.2:0/4196600784 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264440 (secure 0 0 0) 0x7f59dc158960 con 0x7f59bc065220 2024-08-17T02:46:23.070 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:46:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f59bc065220 msgr2=0x7f59bc0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f59bc065220 0x7f59bc0676d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009d20 tx=0x7f59cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 msgr2=0x7f59dc138f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc138f00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009f20 tx=0x7f59d4037000 comp rx=0 tx=0).stop 2024-08-17T02:46:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 shutdown_connections 2024-08-17T02:46:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59dc15a590 0x7f59dc138f00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f59bc065220 0x7f59bc0676d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f59dc156f90 0x7f59dc158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 --2- 172.21.15.2:0/4196600784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59dc0b0e30 0x7f59dc136280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 >> 172.21.15.2:0/4196600784 conn(0x7f59dc062af0 msgr2=0x7f59dc13e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 shutdown_connections 2024-08-17T02:46:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.070+0000 7f59dbe00640 1 -- 172.21.15.2:0/4196600784 wait complete. 2024-08-17T02:46:23.086 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:46:23.016436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415072,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752559648,"statfs":{"total":773094113280,"available":770621079552,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.274596"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783449+0000","last_change":"2024-08-17T02:46:13.782069+0000","last_active":"2024-08-17T02:46:13.783449+0000","last_peered":"2024-08-17T02:46:13.783449+0000","last_clean":"2024-08-17T02:46:13.783449+0000","last_became_active":"2024-08-17T02:46:13.780634+0000","last_became_peered":"2024-08-17T02:46:13.780634+0000","last_unstale":"2024-08-17T02:46:13.783449+0000","last_undegraded":"2024-08-17T02:46:13.783449+0000","last_fullsized":"2024-08-17T02:46:13.783449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:48.296428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788581+0000","last_change":"2024-08-17T02:46:13.787373+0000","last_active":"2024-08-17T02:46:13.788581+0000","last_peered":"2024-08-17T02:46:13.788581+0000","last_clean":"2024-08-17T02:46:13.788581+0000","last_became_active":"2024-08-17T02:46:13.785874+0000","last_became_peered":"2024-08-17T02:46:13.785874+0000","last_unstale":"2024-08-17T02:46:13.788581+0000","last_undegraded":"2024-08-17T02:46:13.788581+0000","last_fullsized":"2024-08-17T02:46:13.788581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.771809+0000","last_change":"2024-08-17T02:46:13.756970+0000","last_active":"2024-08-17T02:46:13.771809+0000","last_peered":"2024-08-17T02:46:13.771809+0000","last_clean":"2024-08-17T02:46:13.771809+0000","last_became_active":"2024-08-17T02:46:13.756661+0000","last_became_peered":"2024-08-17T02:46:13.756661+0000","last_unstale":"2024-08-17T02:46:13.771809+0000","last_undegraded":"2024-08-17T02:46:13.771809+0000","last_fullsized":"2024-08-17T02:46:13.771809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763017+0000","last_change":"2024-08-17T02:46:13.760375+0000","last_active":"2024-08-17T02:46:13.763017+0000","last_peered":"2024-08-17T02:46:13.763017+0000","last_clean":"2024-08-17T02:46:13.763017+0000","last_became_active":"2024-08-17T02:46:13.759323+0000","last_became_peered":"2024-08-17T02:46:13.759323+0000","last_unstale":"2024-08-17T02:46:13.763017+0000","last_undegraded":"2024-08-17T02:46:13.763017+0000","last_fullsized":"2024-08-17T02:46:13.763017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:53.437116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787628+0000","last_change":"2024-08-17T02:46:13.778338+0000","last_active":"2024-08-17T02:46:13.787628+0000","last_peered":"2024-08-17T02:46:13.787628+0000","last_clean":"2024-08-17T02:46:13.787628+0000","last_became_active":"2024-08-17T02:46:13.771574+0000","last_became_peered":"2024-08-17T02:46:13.771574+0000","last_unstale":"2024-08-17T02:46:13.787628+0000","last_undegraded":"2024-08-17T02:46:13.787628+0000","last_fullsized":"2024-08-17T02:46:13.787628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:53.437116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777529+0000","last_change":"2024-08-17T02:46:13.774672+0000","last_active":"2024-08-17T02:46:13.777529+0000","last_peered":"2024-08-17T02:46:13.777529+0000","last_clean":"2024-08-17T02:46:13.777529+0000","last_became_active":"2024-08-17T02:46:13.774417+0000","last_became_peered":"2024-08-17T02:46:13.774417+0000","last_unstale":"2024-08-17T02:46:13.777529+0000","last_undegraded":"2024-08-17T02:46:13.777529+0000","last_fullsized":"2024-08-17T02:46:13.777529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777974+0000","last_change":"2024-08-17T02:46:13.777018+0000","last_active":"2024-08-17T02:46:13.777974+0000","last_peered":"2024-08-17T02:46:13.777974+0000","last_clean":"2024-08-17T02:46:13.777974+0000","last_became_active":"2024-08-17T02:46:13.776494+0000","last_became_peered":"2024-08-17T02:46:13.776494+0000","last_unstale":"2024-08-17T02:46:13.777974+0000","last_undegraded":"2024-08-17T02:46:13.777974+0000","last_fullsized":"2024-08-17T02:46:13.777974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:13.882288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777982+0000","last_change":"2024-08-17T02:46:13.772303+0000","last_active":"2024-08-17T02:46:13.777982+0000","last_peered":"2024-08-17T02:46:13.777982+0000","last_clean":"2024-08-17T02:46:13.777982+0000","last_became_active":"2024-08-17T02:46:13.770496+0000","last_became_peered":"2024-08-17T02:46:13.770496+0000","last_unstale":"2024-08-17T02:46:13.777982+0000","last_undegraded":"2024-08-17T02:46:13.777982+0000","last_fullsized":"2024-08-17T02:46:13.777982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783745+0000","last_change":"2024-08-17T02:46:13.782542+0000","last_active":"2024-08-17T02:46:13.783745+0000","last_peered":"2024-08-17T02:46:13.783745+0000","last_clean":"2024-08-17T02:46:13.783745+0000","last_became_active":"2024-08-17T02:46:13.781512+0000","last_became_peered":"2024-08-17T02:46:13.781512+0000","last_unstale":"2024-08-17T02:46:13.783745+0000","last_undegraded":"2024-08-17T02:46:13.783745+0000","last_fullsized":"2024-08-17T02:46:13.783745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:31.909156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774645+0000","last_change":"2024-08-17T02:46:13.772207+0000","last_active":"2024-08-17T02:46:13.774645+0000","last_peered":"2024-08-17T02:46:13.774645+0000","last_clean":"2024-08-17T02:46:13.774645+0000","last_became_active":"2024-08-17T02:46:13.771965+0000","last_became_peered":"2024-08-17T02:46:13.771965+0000","last_unstale":"2024-08-17T02:46:13.774645+0000","last_undegraded":"2024-08-17T02:46:13.774645+0000","last_fullsized":"2024-08-17T02:46:13.774645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774903+0000","last_change":"2024-08-17T02:46:13.772803+0000","last_active":"2024-08-17T02:46:13.774903+0000","last_peered":"2024-08-17T02:46:13.774903+0000","last_clean":"2024-08-17T02:46:13.774903+0000","last_became_active":"2024-08-17T02:46:13.772356+0000","last_became_peered":"2024-08-17T02:46:13.772356+0000","last_unstale":"2024-08-17T02:46:13.774903+0000","last_undegraded":"2024-08-17T02:46:13.774903+0000","last_fullsized":"2024-08-17T02:46:13.774903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774317+0000","last_change":"2024-08-17T02:46:13.765594+0000","last_active":"2024-08-17T02:46:13.774317+0000","last_peered":"2024-08-17T02:46:13.774317+0000","last_clean":"2024-08-17T02:46:13.774317+0000","last_became_active":"2024-08-17T02:46:13.765142+0000","last_became_peered":"2024-08-17T02:46:13.765142+0000","last_unstale":"2024-08-17T02:46:13.774317+0000","last_undegraded":"2024-08-17T02:46:13.774317+0000","last_fullsized":"2024-08-17T02:46:13.774317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:17.516179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764835+0000","last_change":"2024-08-17T02:46:13.762927+0000","last_active":"2024-08-17T02:46:13.764835+0000","last_peered":"2024-08-17T02:46:13.764835+0000","last_clean":"2024-08-17T02:46:13.764835+0000","last_became_active":"2024-08-17T02:46:13.762593+0000","last_became_peered":"2024-08-17T02:46:13.762593+0000","last_unstale":"2024-08-17T02:46:13.764835+0000","last_undegraded":"2024-08-17T02:46:13.764835+0000","last_fullsized":"2024-08-17T02:46:13.764835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786511+0000","last_change":"2024-08-17T02:46:13.779226+0000","last_active":"2024-08-17T02:46:13.786511+0000","last_peered":"2024-08-17T02:46:13.786511+0000","last_clean":"2024-08-17T02:46:13.786511+0000","last_became_active":"2024-08-17T02:46:13.778514+0000","last_became_peered":"2024-08-17T02:46:13.778514+0000","last_unstale":"2024-08-17T02:46:13.786511+0000","last_undegraded":"2024-08-17T02:46:13.786511+0000","last_fullsized":"2024-08-17T02:46:13.786511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775996+0000","last_change":"2024-08-17T02:46:13.764824+0000","last_active":"2024-08-17T02:46:13.775996+0000","last_peered":"2024-08-17T02:46:13.775996+0000","last_clean":"2024-08-17T02:46:13.775996+0000","last_became_active":"2024-08-17T02:46:13.764423+0000","last_became_peered":"2024-08-17T02:46:13.764423+0000","last_unstale":"2024-08-17T02:46:13.775996+0000","last_undegraded":"2024-08-17T02:46:13.775996+0000","last_fullsized":"2024-08-17T02:46:13.775996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.762356+0000","last_change":"2024-08-17T02:46:13.758109+0000","last_active":"2024-08-17T02:46:13.762356+0000","last_peered":"2024-08-17T02:46:13.762356+0000","last_clean":"2024-08-17T02:46:13.762356+0000","last_became_active":"2024-08-17T02:46:13.757727+0000","last_became_peered":"2024-08-17T02:46:13.757727+0000","last_unstale":"2024-08-17T02:46:13.762356+0000","last_undegraded":"2024-08-17T02:46:13.762356+0000","last_fullsized":"2024-08-17T02:46:13.762356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:29.582747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775780+0000","last_change":"2024-08-17T02:46:13.770315+0000","last_active":"2024-08-17T02:46:13.775780+0000","last_peered":"2024-08-17T02:46:13.775780+0000","last_clean":"2024-08-17T02:46:13.775780+0000","last_became_active":"2024-08-17T02:46:13.770058+0000","last_became_peered":"2024-08-17T02:46:13.770058+0000","last_unstale":"2024-08-17T02:46:13.775780+0000","last_undegraded":"2024-08-17T02:46:13.775780+0000","last_fullsized":"2024-08-17T02:46:13.775780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:13.882288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.765237+0000","last_change":"2024-08-17T02:46:13.762473+0000","last_active":"2024-08-17T02:46:13.765237+0000","last_peered":"2024-08-17T02:46:13.765237+0000","last_clean":"2024-08-17T02:46:13.765237+0000","last_became_active":"2024-08-17T02:46:13.762210+0000","last_became_peered":"2024-08-17T02:46:13.762210+0000","last_unstale":"2024-08-17T02:46:13.765237+0000","last_undegraded":"2024-08-17T02:46:13.765237+0000","last_fullsized":"2024-08-17T02:46:13.765237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:28.991722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781197+0000","last_change":"2024-08-17T02:46:13.774494+0000","last_active":"2024-08-17T02:46:13.781197+0000","last_peered":"2024-08-17T02:46:13.781197+0000","last_clean":"2024-08-17T02:46:13.781197+0000","last_became_active":"2024-08-17T02:46:13.774173+0000","last_became_peered":"2024-08-17T02:46:13.774173+0000","last_unstale":"2024-08-17T02:46:13.781197+0000","last_undegraded":"2024-08-17T02:46:13.781197+0000","last_fullsized":"2024-08-17T02:46:13.781197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:10.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774059+0000","last_change":"2024-08-17T02:46:13.766560+0000","last_active":"2024-08-17T02:46:13.774059+0000","last_peered":"2024-08-17T02:46:13.774059+0000","last_clean":"2024-08-17T02:46:13.774059+0000","last_became_active":"2024-08-17T02:46:13.765745+0000","last_became_peered":"2024-08-17T02:46:13.765745+0000","last_unstale":"2024-08-17T02:46:13.774059+0000","last_undegraded":"2024-08-17T02:46:13.774059+0000","last_fullsized":"2024-08-17T02:46:13.774059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776545+0000","last_change":"2024-08-17T02:46:13.765254+0000","last_active":"2024-08-17T02:46:13.776545+0000","last_peered":"2024-08-17T02:46:13.776545+0000","last_clean":"2024-08-17T02:46:13.776545+0000","last_became_active":"2024-08-17T02:46:13.756647+0000","last_became_peered":"2024-08-17T02:46:13.756647+0000","last_unstale":"2024-08-17T02:46:13.776545+0000","last_undegraded":"2024-08-17T02:46:13.776545+0000","last_fullsized":"2024-08-17T02:46:13.776545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.770703+0000","last_change":"2024-08-17T02:46:13.765508+0000","last_active":"2024-08-17T02:46:13.770703+0000","last_peered":"2024-08-17T02:46:13.770703+0000","last_clean":"2024-08-17T02:46:13.770703+0000","last_became_active":"2024-08-17T02:46:13.765136+0000","last_became_peered":"2024-08-17T02:46:13.765136+0000","last_unstale":"2024-08-17T02:46:13.770703+0000","last_undegraded":"2024-08-17T02:46:13.770703+0000","last_fullsized":"2024-08-17T02:46:13.770703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:48.296428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.773564+0000","last_change":"2024-08-17T02:46:13.766938+0000","last_active":"2024-08-17T02:46:13.773564+0000","last_peered":"2024-08-17T02:46:13.773564+0000","last_clean":"2024-08-17T02:46:13.773564+0000","last_became_active":"2024-08-17T02:46:13.766711+0000","last_became_peered":"2024-08-17T02:46:13.766711+0000","last_unstale":"2024-08-17T02:46:13.773564+0000","last_undegraded":"2024-08-17T02:46:13.773564+0000","last_fullsized":"2024-08-17T02:46:13.773564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763233+0000","last_change":"2024-08-17T02:46:13.761055+0000","last_active":"2024-08-17T02:46:13.763233+0000","last_peered":"2024-08-17T02:46:13.763233+0000","last_clean":"2024-08-17T02:46:13.763233+0000","last_became_active":"2024-08-17T02:46:13.760766+0000","last_became_peered":"2024-08-17T02:46:13.760766+0000","last_unstale":"2024-08-17T02:46:13.763233+0000","last_undegraded":"2024-08-17T02:46:13.763233+0000","last_fullsized":"2024-08-17T02:46:13.763233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:10.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776693+0000","last_change":"2024-08-17T02:46:13.769437+0000","last_active":"2024-08-17T02:46:13.776693+0000","last_peered":"2024-08-17T02:46:13.776693+0000","last_clean":"2024-08-17T02:46:13.776693+0000","last_became_active":"2024-08-17T02:46:13.768078+0000","last_became_peered":"2024-08-17T02:46:13.768078+0000","last_unstale":"2024-08-17T02:46:13.776693+0000","last_undegraded":"2024-08-17T02:46:13.776693+0000","last_fullsized":"2024-08-17T02:46:13.776693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.782708+0000","last_change":"2024-08-17T02:46:13.780502+0000","last_active":"2024-08-17T02:46:13.782708+0000","last_peered":"2024-08-17T02:46:13.782708+0000","last_clean":"2024-08-17T02:46:13.782708+0000","last_became_active":"2024-08-17T02:46:13.780234+0000","last_became_peered":"2024-08-17T02:46:13.780234+0000","last_unstale":"2024-08-17T02:46:13.782708+0000","last_undegraded":"2024-08-17T02:46:13.782708+0000","last_fullsized":"2024-08-17T02:46:13.782708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776104+0000","last_change":"2024-08-17T02:46:13.765975+0000","last_active":"2024-08-17T02:46:13.776104+0000","last_peered":"2024-08-17T02:46:13.776104+0000","last_clean":"2024-08-17T02:46:13.776104+0000","last_became_active":"2024-08-17T02:46:13.765732+0000","last_became_peered":"2024-08-17T02:46:13.765732+0000","last_unstale":"2024-08-17T02:46:13.776104+0000","last_undegraded":"2024-08-17T02:46:13.776104+0000","last_fullsized":"2024-08-17T02:46:13.776104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781638+0000","last_change":"2024-08-17T02:46:13.768145+0000","last_active":"2024-08-17T02:46:13.781638+0000","last_peered":"2024-08-17T02:46:13.781638+0000","last_clean":"2024-08-17T02:46:13.781638+0000","last_became_active":"2024-08-17T02:46:13.767826+0000","last_became_peered":"2024-08-17T02:46:13.767826+0000","last_unstale":"2024-08-17T02:46:13.781638+0000","last_undegraded":"2024-08-17T02:46:13.781638+0000","last_fullsized":"2024-08-17T02:46:13.781638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787886+0000","last_change":"2024-08-17T02:46:13.773416+0000","last_active":"2024-08-17T02:46:13.787886+0000","last_peered":"2024-08-17T02:46:13.787886+0000","last_clean":"2024-08-17T02:46:13.787886+0000","last_became_active":"2024-08-17T02:46:13.773114+0000","last_became_peered":"2024-08-17T02:46:13.773114+0000","last_unstale":"2024-08-17T02:46:13.787886+0000","last_undegraded":"2024-08-17T02:46:13.787886+0000","last_fullsized":"2024-08-17T02:46:13.787886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:00.627300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.765708+0000","last_change":"2024-08-17T02:46:13.759659+0000","last_active":"2024-08-17T02:46:13.765708+0000","last_peered":"2024-08-17T02:46:13.765708+0000","last_clean":"2024-08-17T02:46:13.765708+0000","last_became_active":"2024-08-17T02:46:13.759333+0000","last_became_peered":"2024-08-17T02:46:13.759333+0000","last_unstale":"2024-08-17T02:46:13.765708+0000","last_undegraded":"2024-08-17T02:46:13.765708+0000","last_fullsized":"2024-08-17T02:46:13.765708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772382+0000","last_change":"2024-08-17T02:46:13.768988+0000","last_active":"2024-08-17T02:46:13.772382+0000","last_peered":"2024-08-17T02:46:13.772382+0000","last_clean":"2024-08-17T02:46:13.772382+0000","last_became_active":"2024-08-17T02:46:13.768739+0000","last_became_peered":"2024-08-17T02:46:13.768739+0000","last_unstale":"2024-08-17T02:46:13.772382+0000","last_undegraded":"2024-08-17T02:46:13.772382+0000","last_fullsized":"2024-08-17T02:46:13.772382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:43.094798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777504+0000","last_change":"2024-08-17T02:46:13.776020+0000","last_active":"2024-08-17T02:46:13.777504+0000","last_peered":"2024-08-17T02:46:13.777504+0000","last_clean":"2024-08-17T02:46:13.777504+0000","last_became_active":"2024-08-17T02:46:13.775579+0000","last_became_peered":"2024-08-17T02:46:13.775579+0000","last_unstale":"2024-08-17T02:46:13.777504+0000","last_undegraded":"2024-08-17T02:46:13.777504+0000","last_fullsized":"2024-08-17T02:46:13.777504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787097+0000","last_change":"2024-08-17T02:46:13.785306+0000","last_active":"2024-08-17T02:46:13.787097+0000","last_peered":"2024-08-17T02:46:13.787097+0000","last_clean":"2024-08-17T02:46:13.787097+0000","last_became_active":"2024-08-17T02:46:13.783412+0000","last_became_peered":"2024-08-17T02:46:13.783412+0000","last_unstale":"2024-08-17T02:46:13.787097+0000","last_undegraded":"2024-08-17T02:46:13.787097+0000","last_fullsized":"2024-08-17T02:46:13.787097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:29.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787958+0000","last_change":"2024-08-17T02:46:12.766141+0000","last_active":"2024-08-17T02:46:13.787958+0000","last_peered":"2024-08-17T02:46:13.787958+0000","last_clean":"2024-08-17T02:46:13.787958+0000","last_became_active":"2024-08-17T02:46:12.763492+0000","last_became_peered":"2024-08-17T02:46:12.763492+0000","last_unstale":"2024-08-17T02:46:13.787958+0000","last_undegraded":"2024-08-17T02:46:13.787958+0000","last_fullsized":"2024-08-17T02:46:13.787958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784653+0000","last_change":"2024-08-17T02:46:13.772658+0000","last_active":"2024-08-17T02:46:13.784653+0000","last_peered":"2024-08-17T02:46:13.784653+0000","last_clean":"2024-08-17T02:46:13.784653+0000","last_became_active":"2024-08-17T02:46:13.765586+0000","last_became_peered":"2024-08-17T02:46:13.765586+0000","last_unstale":"2024-08-17T02:46:13.784653+0000","last_undegraded":"2024-08-17T02:46:13.784653+0000","last_fullsized":"2024-08-17T02:46:13.784653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788422+0000","last_change":"2024-08-17T02:46:12.765654+0000","last_active":"2024-08-17T02:46:13.788422+0000","last_peered":"2024-08-17T02:46:13.788422+0000","last_clean":"2024-08-17T02:46:13.788422+0000","last_became_active":"2024-08-17T02:46:12.765358+0000","last_became_peered":"2024-08-17T02:46:12.765358+0000","last_unstale":"2024-08-17T02:46:13.788422+0000","last_undegraded":"2024-08-17T02:46:13.788422+0000","last_fullsized":"2024-08-17T02:46:13.788422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.746879+0000","last_change":"2024-08-17T02:46:12.757374+0000","last_active":"2024-08-17T02:46:13.746879+0000","last_peered":"2024-08-17T02:46:13.746879+0000","last_clean":"2024-08-17T02:46:13.746879+0000","last_became_active":"2024-08-17T02:46:12.757064+0000","last_became_peered":"2024-08-17T02:46:12.757064+0000","last_unstale":"2024-08-17T02:46:13.746879+0000","last_undegraded":"2024-08-17T02:46:13.746879+0000","last_fullsized":"2024-08-17T02:46:13.746879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:32.171597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.758714+0000","last_change":"2024-08-17T02:46:13.757800+0000","last_active":"2024-08-17T02:46:13.758714+0000","last_peered":"2024-08-17T02:46:13.758714+0000","last_clean":"2024-08-17T02:46:13.758714+0000","last_became_active":"2024-08-17T02:46:13.757609+0000","last_became_peered":"2024-08-17T02:46:13.757609+0000","last_unstale":"2024-08-17T02:46:13.758714+0000","last_undegraded":"2024-08-17T02:46:13.758714+0000","last_fullsized":"2024-08-17T02:46:13.758714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.752836+0000","last_change":"2024-08-17T02:46:12.771509+0000","last_active":"2024-08-17T02:46:13.752836+0000","last_peered":"2024-08-17T02:46:13.752836+0000","last_clean":"2024-08-17T02:46:13.752836+0000","last_became_active":"2024-08-17T02:46:12.765884+0000","last_became_peered":"2024-08-17T02:46:12.765884+0000","last_unstale":"2024-08-17T02:46:13.752836+0000","last_undegraded":"2024-08-17T02:46:13.752836+0000","last_fullsized":"2024-08-17T02:46:13.752836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772441+0000","last_change":"2024-08-17T02:46:13.760432+0000","last_active":"2024-08-17T02:46:13.772441+0000","last_peered":"2024-08-17T02:46:13.772441+0000","last_clean":"2024-08-17T02:46:13.772441+0000","last_became_active":"2024-08-17T02:46:13.757461+0000","last_became_peered":"2024-08-17T02:46:13.757461+0000","last_unstale":"2024-08-17T02:46:13.772441+0000","last_undegraded":"2024-08-17T02:46:13.772441+0000","last_fullsized":"2024-08-17T02:46:13.772441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.760005+0000","last_change":"2024-08-17T02:46:12.771440+0000","last_active":"2024-08-17T02:46:13.760005+0000","last_peered":"2024-08-17T02:46:13.760005+0000","last_clean":"2024-08-17T02:46:13.760005+0000","last_became_active":"2024-08-17T02:46:12.771171+0000","last_became_peered":"2024-08-17T02:46:12.771171+0000","last_unstale":"2024-08-17T02:46:13.760005+0000","last_undegraded":"2024-08-17T02:46:13.760005+0000","last_fullsized":"2024-08-17T02:46:13.760005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776159+0000","last_change":"2024-08-17T02:46:13.770867+0000","last_active":"2024-08-17T02:46:13.776159+0000","last_peered":"2024-08-17T02:46:13.776159+0000","last_clean":"2024-08-17T02:46:13.776159+0000","last_became_active":"2024-08-17T02:46:13.770367+0000","last_became_peered":"2024-08-17T02:46:13.770367+0000","last_unstale":"2024-08-17T02:46:13.776159+0000","last_undegraded":"2024-08-17T02:46:13.776159+0000","last_fullsized":"2024-08-17T02:46:13.776159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:59.549871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749408+0000","last_change":"2024-08-17T02:46:12.773955+0000","last_active":"2024-08-17T02:46:13.749408+0000","last_peered":"2024-08-17T02:46:13.749408+0000","last_clean":"2024-08-17T02:46:13.749408+0000","last_became_active":"2024-08-17T02:46:12.772243+0000","last_became_peered":"2024-08-17T02:46:12.772243+0000","last_unstale":"2024-08-17T02:46:13.749408+0000","last_undegraded":"2024-08-17T02:46:13.749408+0000","last_fullsized":"2024-08-17T02:46:13.749408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786276+0000","last_change":"2024-08-17T02:46:13.777529+0000","last_active":"2024-08-17T02:46:13.786276+0000","last_peered":"2024-08-17T02:46:13.786276+0000","last_clean":"2024-08-17T02:46:13.786276+0000","last_became_active":"2024-08-17T02:46:13.776596+0000","last_became_peered":"2024-08-17T02:46:13.776596+0000","last_unstale":"2024-08-17T02:46:13.786276+0000","last_undegraded":"2024-08-17T02:46:13.786276+0000","last_fullsized":"2024-08-17T02:46:13.786276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784145+0000","last_change":"2024-08-17T02:46:12.771541+0000","last_active":"2024-08-17T02:46:13.784145+0000","last_peered":"2024-08-17T02:46:13.784145+0000","last_clean":"2024-08-17T02:46:13.784145+0000","last_became_active":"2024-08-17T02:46:12.771307+0000","last_became_peered":"2024-08-17T02:46:12.771307+0000","last_unstale":"2024-08-17T02:46:13.784145+0000","last_undegraded":"2024-08-17T02:46:13.784145+0000","last_fullsized":"2024-08-17T02:46:13.784145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.771994+0000","last_change":"2024-08-17T02:46:13.765422+0000","last_active":"2024-08-17T02:46:13.771994+0000","last_peered":"2024-08-17T02:46:13.771994+0000","last_clean":"2024-08-17T02:46:13.771994+0000","last_became_active":"2024-08-17T02:46:13.764854+0000","last_became_peered":"2024-08-17T02:46:13.764854+0000","last_unstale":"2024-08-17T02:46:13.771994+0000","last_undegraded":"2024-08-17T02:46:13.771994+0000","last_fullsized":"2024-08-17T02:46:13.771994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:20.767461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.790295+0000","last_change":"2024-08-17T02:46:12.763643+0000","last_active":"2024-08-17T02:46:13.790295+0000","last_peered":"2024-08-17T02:46:13.790295+0000","last_clean":"2024-08-17T02:46:13.790295+0000","last_became_active":"2024-08-17T02:46:12.763196+0000","last_became_peered":"2024-08-17T02:46:12.763196+0000","last_unstale":"2024-08-17T02:46:13.790295+0000","last_undegraded":"2024-08-17T02:46:13.790295+0000","last_fullsized":"2024-08-17T02:46:13.790295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781185+0000","last_change":"2024-08-17T02:46:13.768744+0000","last_active":"2024-08-17T02:46:13.781185+0000","last_peered":"2024-08-17T02:46:13.781185+0000","last_clean":"2024-08-17T02:46:13.781185+0000","last_became_active":"2024-08-17T02:46:13.768433+0000","last_became_peered":"2024-08-17T02:46:13.768433+0000","last_unstale":"2024-08-17T02:46:13.781185+0000","last_undegraded":"2024-08-17T02:46:13.781185+0000","last_fullsized":"2024-08-17T02:46:13.781185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:30.671696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788049+0000","last_change":"2024-08-17T02:46:12.764570+0000","last_active":"2024-08-17T02:46:13.788049+0000","last_peered":"2024-08-17T02:46:13.788049+0000","last_clean":"2024-08-17T02:46:13.788049+0000","last_became_active":"2024-08-17T02:46:12.763764+0000","last_became_peered":"2024-08-17T02:46:12.763764+0000","last_unstale":"2024-08-17T02:46:13.788049+0000","last_undegraded":"2024-08-17T02:46:13.788049+0000","last_fullsized":"2024-08-17T02:46:13.788049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:32.171597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.778773+0000","last_change":"2024-08-17T02:46:13.764855+0000","last_active":"2024-08-17T02:46:13.778773+0000","last_peered":"2024-08-17T02:46:13.778773+0000","last_clean":"2024-08-17T02:46:13.778773+0000","last_became_active":"2024-08-17T02:46:13.764494+0000","last_became_peered":"2024-08-17T02:46:13.764494+0000","last_unstale":"2024-08-17T02:46:13.778773+0000","last_undegraded":"2024-08-17T02:46:13.778773+0000","last_fullsized":"2024-08-17T02:46:13.778773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:26.668711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749487+0000","last_change":"2024-08-17T02:46:12.763292+0000","last_active":"2024-08-17T02:46:13.749487+0000","last_peered":"2024-08-17T02:46:13.749487+0000","last_clean":"2024-08-17T02:46:13.749487+0000","last_became_active":"2024-08-17T02:46:12.762486+0000","last_became_peered":"2024-08-17T02:46:12.762486+0000","last_unstale":"2024-08-17T02:46:13.749487+0000","last_undegraded":"2024-08-17T02:46:13.749487+0000","last_fullsized":"2024-08-17T02:46:13.749487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788571+0000","last_change":"2024-08-17T02:46:13.787493+0000","last_active":"2024-08-17T02:46:13.788571+0000","last_peered":"2024-08-17T02:46:13.788571+0000","last_clean":"2024-08-17T02:46:13.788571+0000","last_became_active":"2024-08-17T02:46:13.778178+0000","last_became_peered":"2024-08-17T02:46:13.778178+0000","last_unstale":"2024-08-17T02:46:13.788571+0000","last_undegraded":"2024-08-17T02:46:13.788571+0000","last_fullsized":"2024-08-17T02:46:13.788571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:59.549871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.759786+0000","last_change":"2024-08-17T02:46:12.760312+0000","last_active":"2024-08-17T02:46:13.759786+0000","last_peered":"2024-08-17T02:46:13.759786+0000","last_clean":"2024-08-17T02:46:13.759786+0000","last_became_active":"2024-08-17T02:46:12.760019+0000","last_became_peered":"2024-08-17T02:46:12.760019+0000","last_unstale":"2024-08-17T02:46:13.759786+0000","last_undegraded":"2024-08-17T02:46:13.759786+0000","last_fullsized":"2024-08-17T02:46:13.759786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777485+0000","last_change":"2024-08-17T02:46:13.775855+0000","last_active":"2024-08-17T02:46:13.777485+0000","last_peered":"2024-08-17T02:46:13.777485+0000","last_clean":"2024-08-17T02:46:13.777485+0000","last_became_active":"2024-08-17T02:46:13.775232+0000","last_became_peered":"2024-08-17T02:46:13.775232+0000","last_unstale":"2024-08-17T02:46:13.777485+0000","last_undegraded":"2024-08-17T02:46:13.777485+0000","last_fullsized":"2024-08-17T02:46:13.777485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788359+0000","last_change":"2024-08-17T02:46:12.761768+0000","last_active":"2024-08-17T02:46:13.788359+0000","last_peered":"2024-08-17T02:46:13.788359+0000","last_clean":"2024-08-17T02:46:13.788359+0000","last_became_active":"2024-08-17T02:46:12.761478+0000","last_became_peered":"2024-08-17T02:46:12.761478+0000","last_unstale":"2024-08-17T02:46:13.788359+0000","last_undegraded":"2024-08-17T02:46:13.788359+0000","last_fullsized":"2024-08-17T02:46:13.788359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784569+0000","last_change":"2024-08-17T02:46:13.780280+0000","last_active":"2024-08-17T02:46:13.784569+0000","last_peered":"2024-08-17T02:46:13.784569+0000","last_clean":"2024-08-17T02:46:13.784569+0000","last_became_active":"2024-08-17T02:46:13.779454+0000","last_became_peered":"2024-08-17T02:46:13.779454+0000","last_unstale":"2024-08-17T02:46:13.784569+0000","last_undegraded":"2024-08-17T02:46:13.784569+0000","last_fullsized":"2024-08-17T02:46:13.784569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788136+0000","last_change":"2024-08-17T02:46:12.769206+0000","last_active":"2024-08-17T02:46:13.788136+0000","last_peered":"2024-08-17T02:46:13.788136+0000","last_clean":"2024-08-17T02:46:13.788136+0000","last_became_active":"2024-08-17T02:46:12.768891+0000","last_became_peered":"2024-08-17T02:46:12.768891+0000","last_unstale":"2024-08-17T02:46:13.788136+0000","last_undegraded":"2024-08-17T02:46:13.788136+0000","last_fullsized":"2024-08-17T02:46:13.788136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:59:55.270622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774129+0000","last_change":"2024-08-17T02:46:13.769837+0000","last_active":"2024-08-17T02:46:13.774129+0000","last_peered":"2024-08-17T02:46:13.774129+0000","last_clean":"2024-08-17T02:46:13.774129+0000","last_became_active":"2024-08-17T02:46:13.769478+0000","last_became_peered":"2024-08-17T02:46:13.769478+0000","last_unstale":"2024-08-17T02:46:13.774129+0000","last_undegraded":"2024-08-17T02:46:13.774129+0000","last_fullsized":"2024-08-17T02:46:13.774129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:47.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783670+0000","last_change":"2024-08-17T02:46:12.755672+0000","last_active":"2024-08-17T02:46:13.783670+0000","last_peered":"2024-08-17T02:46:13.783670+0000","last_clean":"2024-08-17T02:46:13.783670+0000","last_became_active":"2024-08-17T02:46:12.754437+0000","last_became_peered":"2024-08-17T02:46:12.754437+0000","last_unstale":"2024-08-17T02:46:13.783670+0000","last_undegraded":"2024-08-17T02:46:13.783670+0000","last_fullsized":"2024-08-17T02:46:13.783670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783726+0000","last_change":"2024-08-17T02:46:13.782246+0000","last_active":"2024-08-17T02:46:13.783726+0000","last_peered":"2024-08-17T02:46:13.783726+0000","last_clean":"2024-08-17T02:46:13.783726+0000","last_became_active":"2024-08-17T02:46:13.781368+0000","last_became_peered":"2024-08-17T02:46:13.781368+0000","last_unstale":"2024-08-17T02:46:13.783726+0000","last_undegraded":"2024-08-17T02:46:13.783726+0000","last_fullsized":"2024-08-17T02:46:13.783726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786712+0000","last_change":"2024-08-17T02:46:12.761505+0000","last_active":"2024-08-17T02:46:13.786712+0000","last_peered":"2024-08-17T02:46:13.786712+0000","last_clean":"2024-08-17T02:46:13.786712+0000","last_became_active":"2024-08-17T02:46:12.760373+0000","last_became_peered":"2024-08-17T02:46:12.760373+0000","last_unstale":"2024-08-17T02:46:13.786712+0000","last_undegraded":"2024-08-17T02:46:13.786712+0000","last_fullsized":"2024-08-17T02:46:13.786712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:16.510354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763000+0000","last_change":"2024-08-17T02:46:13.758103+0000","last_active":"2024-08-17T02:46:13.763000+0000","last_peered":"2024-08-17T02:46:13.763000+0000","last_clean":"2024-08-17T02:46:13.763000+0000","last_became_active":"2024-08-17T02:46:13.757785+0000","last_became_peered":"2024-08-17T02:46:13.757785+0000","last_unstale":"2024-08-17T02:46:13.763000+0000","last_undegraded":"2024-08-17T02:46:13.763000+0000","last_fullsized":"2024-08-17T02:46:13.763000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:47.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.751133+0000","last_change":"2024-08-17T02:46:12.773394+0000","last_active":"2024-08-17T02:46:13.751133+0000","last_peered":"2024-08-17T02:46:13.751133+0000","last_clean":"2024-08-17T02:46:13.751133+0000","last_became_active":"2024-08-17T02:46:12.773045+0000","last_became_peered":"2024-08-17T02:46:12.773045+0000","last_unstale":"2024-08-17T02:46:13.751133+0000","last_undegraded":"2024-08-17T02:46:13.751133+0000","last_fullsized":"2024-08-17T02:46:13.751133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783423+0000","last_change":"2024-08-17T02:46:13.782165+0000","last_active":"2024-08-17T02:46:13.783423+0000","last_peered":"2024-08-17T02:46:13.783423+0000","last_clean":"2024-08-17T02:46:13.783423+0000","last_became_active":"2024-08-17T02:46:13.781292+0000","last_became_peered":"2024-08-17T02:46:13.781292+0000","last_unstale":"2024-08-17T02:46:13.783423+0000","last_undegraded":"2024-08-17T02:46:13.783423+0000","last_fullsized":"2024-08-17T02:46:13.783423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:14.050922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756445+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:46:13.756445+0000","last_peered":"2024-08-17T02:46:13.756445+0000","last_clean":"2024-08-17T02:46:13.756445+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:46:13.756445+0000","last_undegraded":"2024-08-17T02:46:13.756445+0000","last_fullsized":"2024-08-17T02:46:13.756445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.747542+0000","last_change":"2024-08-17T02:46:12.761371+0000","last_active":"2024-08-17T02:46:13.747542+0000","last_peered":"2024-08-17T02:46:13.747542+0000","last_clean":"2024-08-17T02:46:13.747542+0000","last_became_active":"2024-08-17T02:46:12.761066+0000","last_became_peered":"2024-08-17T02:46:12.761066+0000","last_unstale":"2024-08-17T02:46:13.747542+0000","last_undegraded":"2024-08-17T02:46:13.747542+0000","last_fullsized":"2024-08-17T02:46:13.747542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.778045+0000","last_change":"2024-08-17T02:46:13.773410+0000","last_active":"2024-08-17T02:46:13.778045+0000","last_peered":"2024-08-17T02:46:13.778045+0000","last_clean":"2024-08-17T02:46:13.778045+0000","last_became_active":"2024-08-17T02:46:13.771934+0000","last_became_peered":"2024-08-17T02:46:13.771934+0000","last_unstale":"2024-08-17T02:46:13.778045+0000","last_undegraded":"2024-08-17T02:46:13.778045+0000","last_fullsized":"2024-08-17T02:46:13.778045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:29.582747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756352+0000","last_change":"2024-08-17T02:46:12.766920+0000","last_active":"2024-08-17T02:46:13.756352+0000","last_peered":"2024-08-17T02:46:13.756352+0000","last_clean":"2024-08-17T02:46:13.756352+0000","last_became_active":"2024-08-17T02:46:12.766386+0000","last_became_peered":"2024-08-17T02:46:12.766386+0000","last_unstale":"2024-08-17T02:46:13.756352+0000","last_undegraded":"2024-08-17T02:46:13.756352+0000","last_fullsized":"2024-08-17T02:46:13.756352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783602+0000","last_change":"2024-08-17T02:46:13.765726+0000","last_active":"2024-08-17T02:46:13.783602+0000","last_peered":"2024-08-17T02:46:13.783602+0000","last_clean":"2024-08-17T02:46:13.783602+0000","last_became_active":"2024-08-17T02:46:13.765377+0000","last_became_peered":"2024-08-17T02:46:13.765377+0000","last_unstale":"2024-08-17T02:46:13.783602+0000","last_undegraded":"2024-08-17T02:46:13.783602+0000","last_fullsized":"2024-08-17T02:46:13.783602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.750833+0000","last_change":"2024-08-17T02:46:12.754881+0000","last_active":"2024-08-17T02:46:13.750833+0000","last_peered":"2024-08-17T02:46:13.750833+0000","last_clean":"2024-08-17T02:46:13.750833+0000","last_became_active":"2024-08-17T02:46:12.753763+0000","last_became_peered":"2024-08-17T02:46:12.753763+0000","last_unstale":"2024-08-17T02:46:13.750833+0000","last_undegraded":"2024-08-17T02:46:13.750833+0000","last_fullsized":"2024-08-17T02:46:13.750833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772407+0000","last_change":"2024-08-17T02:46:13.759314+0000","last_active":"2024-08-17T02:46:13.772407+0000","last_peered":"2024-08-17T02:46:13.772407+0000","last_clean":"2024-08-17T02:46:13.772407+0000","last_became_active":"2024-08-17T02:46:13.759005+0000","last_became_peered":"2024-08-17T02:46:13.759005+0000","last_unstale":"2024-08-17T02:46:13.772407+0000","last_undegraded":"2024-08-17T02:46:13.772407+0000","last_fullsized":"2024-08-17T02:46:13.772407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749580+0000","last_change":"2024-08-17T02:46:12.764920+0000","last_active":"2024-08-17T02:46:13.749580+0000","last_peered":"2024-08-17T02:46:13.749580+0000","last_clean":"2024-08-17T02:46:13.749580+0000","last_became_active":"2024-08-17T02:46:12.764463+0000","last_became_peered":"2024-08-17T02:46:12.764463+0000","last_unstale":"2024-08-17T02:46:13.749580+0000","last_undegraded":"2024-08-17T02:46:13.749580+0000","last_fullsized":"2024-08-17T02:46:13.749580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.773750+0000","last_change":"2024-08-17T02:46:13.768129+0000","last_active":"2024-08-17T02:46:13.773750+0000","last_peered":"2024-08-17T02:46:13.773750+0000","last_clean":"2024-08-17T02:46:13.773750+0000","last_became_active":"2024-08-17T02:46:13.767922+0000","last_became_peered":"2024-08-17T02:46:13.767922+0000","last_unstale":"2024-08-17T02:46:13.773750+0000","last_undegraded":"2024-08-17T02:46:13.773750+0000","last_fullsized":"2024-08-17T02:46:13.773750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:28.991722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.752673+0000","last_change":"2024-08-17T02:46:12.768892+0000","last_active":"2024-08-17T02:46:13.752673+0000","last_peered":"2024-08-17T02:46:13.752673+0000","last_clean":"2024-08-17T02:46:13.752673+0000","last_became_active":"2024-08-17T02:46:12.768653+0000","last_became_peered":"2024-08-17T02:46:12.768653+0000","last_unstale":"2024-08-17T02:46:13.752673+0000","last_undegraded":"2024-08-17T02:46:13.752673+0000","last_fullsized":"2024-08-17T02:46:13.752673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776587+0000","last_change":"2024-08-17T02:46:13.768046+0000","last_active":"2024-08-17T02:46:13.776587+0000","last_peered":"2024-08-17T02:46:13.776587+0000","last_clean":"2024-08-17T02:46:13.776587+0000","last_became_active":"2024-08-17T02:46:13.767445+0000","last_became_peered":"2024-08-17T02:46:13.767445+0000","last_unstale":"2024-08-17T02:46:13.776587+0000","last_undegraded":"2024-08-17T02:46:13.776587+0000","last_fullsized":"2024-08-17T02:46:13.776587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.759052+0000","last_change":"2024-08-17T02:46:12.770898+0000","last_active":"2024-08-17T02:46:13.759052+0000","last_peered":"2024-08-17T02:46:13.759052+0000","last_clean":"2024-08-17T02:46:13.759052+0000","last_became_active":"2024-08-17T02:46:12.770596+0000","last_became_peered":"2024-08-17T02:46:12.770596+0000","last_unstale":"2024-08-17T02:46:13.759052+0000","last_undegraded":"2024-08-17T02:46:13.759052+0000","last_fullsized":"2024-08-17T02:46:13.759052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:27.985897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775335+0000","last_change":"2024-08-17T02:46:13.764756+0000","last_active":"2024-08-17T02:46:13.775335+0000","last_peered":"2024-08-17T02:46:13.775335+0000","last_clean":"2024-08-17T02:46:13.775335+0000","last_became_active":"2024-08-17T02:46:13.764423+0000","last_became_peered":"2024-08-17T02:46:13.764423+0000","last_unstale":"2024-08-17T02:46:13.775335+0000","last_undegraded":"2024-08-17T02:46:13.775335+0000","last_fullsized":"2024-08-17T02:46:13.775335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:14.756598+0000","last_change":"2024-08-17T02:46:12.770698+0000","last_active":"2024-08-17T02:46:14.756598+0000","last_peered":"2024-08-17T02:46:14.756598+0000","last_clean":"2024-08-17T02:46:14.756598+0000","last_became_active":"2024-08-17T02:46:12.770432+0000","last_became_peered":"2024-08-17T02:46:12.770432+0000","last_unstale":"2024-08-17T02:46:14.756598+0000","last_undegraded":"2024-08-17T02:46:14.756598+0000","last_fullsized":"2024-08-17T02:46:14.756598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787077+0000","last_change":"2024-08-17T02:46:13.785768+0000","last_active":"2024-08-17T02:46:13.787077+0000","last_peered":"2024-08-17T02:46:13.787077+0000","last_clean":"2024-08-17T02:46:13.787077+0000","last_became_active":"2024-08-17T02:46:13.784611+0000","last_became_peered":"2024-08-17T02:46:13.784611+0000","last_unstale":"2024-08-17T02:46:13.787077+0000","last_undegraded":"2024-08-17T02:46:13.787077+0000","last_fullsized":"2024-08-17T02:46:13.787077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786933+0000","last_change":"2024-08-17T02:46:12.766695+0000","last_active":"2024-08-17T02:46:13.786933+0000","last_peered":"2024-08-17T02:46:13.786933+0000","last_clean":"2024-08-17T02:46:13.786933+0000","last_became_active":"2024-08-17T02:46:12.766389+0000","last_became_peered":"2024-08-17T02:46:12.766389+0000","last_unstale":"2024-08-17T02:46:13.786933+0000","last_undegraded":"2024-08-17T02:46:13.786933+0000","last_fullsized":"2024-08-17T02:46:13.786933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.785500+0000","last_change":"2024-08-17T02:46:13.775750+0000","last_active":"2024-08-17T02:46:13.785500+0000","last_peered":"2024-08-17T02:46:13.785500+0000","last_clean":"2024-08-17T02:46:13.785500+0000","last_became_active":"2024-08-17T02:46:13.775487+0000","last_became_peered":"2024-08-17T02:46:13.775487+0000","last_unstale":"2024-08-17T02:46:13.785500+0000","last_undegraded":"2024-08-17T02:46:13.785500+0000","last_fullsized":"2024-08-17T02:46:13.785500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756242+0000","last_change":"2024-08-17T02:46:12.769354+0000","last_active":"2024-08-17T02:46:13.756242+0000","last_peered":"2024-08-17T02:46:13.756242+0000","last_clean":"2024-08-17T02:46:13.756242+0000","last_became_active":"2024-08-17T02:46:12.769061+0000","last_became_peered":"2024-08-17T02:46:12.769061+0000","last_unstale":"2024-08-17T02:46:13.756242+0000","last_undegraded":"2024-08-17T02:46:13.756242+0000","last_fullsized":"2024-08-17T02:46:13.756242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:16.510354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.760836+0000","last_change":"2024-08-17T02:46:13.758278+0000","last_active":"2024-08-17T02:46:13.760836+0000","last_peered":"2024-08-17T02:46:13.760836+0000","last_clean":"2024-08-17T02:46:13.760836+0000","last_became_active":"2024-08-17T02:46:13.758028+0000","last_became_peered":"2024-08-17T02:46:13.758028+0000","last_unstale":"2024-08-17T02:46:13.760836+0000","last_undegraded":"2024-08-17T02:46:13.760836+0000","last_fullsized":"2024-08-17T02:46:13.760836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:26.668711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.751025+0000","last_change":"2024-08-17T02:46:12.766160+0000","last_active":"2024-08-17T02:46:13.751025+0000","last_peered":"2024-08-17T02:46:13.751025+0000","last_clean":"2024-08-17T02:46:13.751025+0000","last_became_active":"2024-08-17T02:46:12.765813+0000","last_became_peered":"2024-08-17T02:46:12.765813+0000","last_unstale":"2024-08-17T02:46:13.751025+0000","last_undegraded":"2024-08-17T02:46:13.751025+0000","last_fullsized":"2024-08-17T02:46:13.751025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:19.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.767346+0000","last_change":"2024-08-17T02:46:13.765879+0000","last_active":"2024-08-17T02:46:13.767346+0000","last_peered":"2024-08-17T02:46:13.767346+0000","last_clean":"2024-08-17T02:46:13.767346+0000","last_became_active":"2024-08-17T02:46:13.765623+0000","last_became_peered":"2024-08-17T02:46:13.765623+0000","last_unstale":"2024-08-17T02:46:13.767346+0000","last_undegraded":"2024-08-17T02:46:13.767346+0000","last_fullsized":"2024-08-17T02:46:13.767346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756732+0000","last_change":"2024-08-17T02:46:12.761258+0000","last_active":"2024-08-17T02:46:13.756732+0000","last_peered":"2024-08-17T02:46:13.756732+0000","last_clean":"2024-08-17T02:46:13.756732+0000","last_became_active":"2024-08-17T02:46:12.760997+0000","last_became_peered":"2024-08-17T02:46:12.760997+0000","last_unstale":"2024-08-17T02:46:13.756732+0000","last_undegraded":"2024-08-17T02:46:13.756732+0000","last_fullsized":"2024-08-17T02:46:13.756732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786999+0000","last_change":"2024-08-17T02:46:13.780356+0000","last_active":"2024-08-17T02:46:13.786999+0000","last_peered":"2024-08-17T02:46:13.786999+0000","last_clean":"2024-08-17T02:46:13.786999+0000","last_became_active":"2024-08-17T02:46:13.779734+0000","last_became_peered":"2024-08-17T02:46:13.779734+0000","last_unstale":"2024-08-17T02:46:13.786999+0000","last_undegraded":"2024-08-17T02:46:13.786999+0000","last_fullsized":"2024-08-17T02:46:13.786999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787809+0000","last_change":"2024-08-17T02:46:12.765599+0000","last_active":"2024-08-17T02:46:13.787809+0000","last_peered":"2024-08-17T02:46:13.787809+0000","last_clean":"2024-08-17T02:46:13.787809+0000","last_became_active":"2024-08-17T02:46:12.765154+0000","last_became_peered":"2024-08-17T02:46:12.765154+0000","last_unstale":"2024-08-17T02:46:13.787809+0000","last_undegraded":"2024-08-17T02:46:13.787809+0000","last_fullsized":"2024-08-17T02:46:13.787809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772892+0000","last_change":"2024-08-17T02:46:13.765726+0000","last_active":"2024-08-17T02:46:13.772892+0000","last_peered":"2024-08-17T02:46:13.772892+0000","last_clean":"2024-08-17T02:46:13.772892+0000","last_became_active":"2024-08-17T02:46:13.765458+0000","last_became_peered":"2024-08-17T02:46:13.765458+0000","last_unstale":"2024-08-17T02:46:13.772892+0000","last_undegraded":"2024-08-17T02:46:13.772892+0000","last_fullsized":"2024-08-17T02:46:13.772892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763706+0000","last_change":"2024-08-17T02:46:13.762591+0000","last_active":"2024-08-17T02:46:13.763706+0000","last_peered":"2024-08-17T02:46:13.763706+0000","last_clean":"2024-08-17T02:46:13.763706+0000","last_became_active":"2024-08-17T02:46:13.762278+0000","last_became_peered":"2024-08-17T02:46:13.762278+0000","last_unstale":"2024-08-17T02:46:13.763706+0000","last_undegraded":"2024-08-17T02:46:13.763706+0000","last_fullsized":"2024-08-17T02:46:13.763706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788027+0000","last_change":"2024-08-17T02:46:12.775104+0000","last_active":"2024-08-17T02:46:13.788027+0000","last_peered":"2024-08-17T02:46:13.788027+0000","last_clean":"2024-08-17T02:46:13.788027+0000","last_became_active":"2024-08-17T02:46:12.774744+0000","last_became_peered":"2024-08-17T02:46:12.774744+0000","last_unstale":"2024-08-17T02:46:13.788027+0000","last_undegraded":"2024-08-17T02:46:13.788027+0000","last_fullsized":"2024-08-17T02:46:13.788027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:19.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764417+0000","last_change":"2024-08-17T02:46:13.763165+0000","last_active":"2024-08-17T02:46:13.764417+0000","last_peered":"2024-08-17T02:46:13.764417+0000","last_clean":"2024-08-17T02:46:13.764417+0000","last_became_active":"2024-08-17T02:46:13.762821+0000","last_became_peered":"2024-08-17T02:46:13.762821+0000","last_unstale":"2024-08-17T02:46:13.764417+0000","last_undegraded":"2024-08-17T02:46:13.764417+0000","last_fullsized":"2024-08-17T02:46:13.764417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:30.671696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784385+0000","last_change":"2024-08-17T02:46:12.768599+0000","last_active":"2024-08-17T02:46:13.784385+0000","last_peered":"2024-08-17T02:46:13.784385+0000","last_clean":"2024-08-17T02:46:13.784385+0000","last_became_active":"2024-08-17T02:46:12.768318+0000","last_became_peered":"2024-08-17T02:46:12.768318+0000","last_unstale":"2024-08-17T02:46:13.784385+0000","last_undegraded":"2024-08-17T02:46:13.784385+0000","last_fullsized":"2024-08-17T02:46:13.784385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:42.088973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777974+0000","last_change":"2024-08-17T02:46:13.772324+0000","last_active":"2024-08-17T02:46:13.777974+0000","last_peered":"2024-08-17T02:46:13.777974+0000","last_clean":"2024-08-17T02:46:13.777974+0000","last_became_active":"2024-08-17T02:46:13.771998+0000","last_became_peered":"2024-08-17T02:46:13.771998+0000","last_unstale":"2024-08-17T02:46:13.777974+0000","last_undegraded":"2024-08-17T02:46:13.777974+0000","last_fullsized":"2024-08-17T02:46:13.777974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787723+0000","last_change":"2024-08-17T02:46:12.762044+0000","last_active":"2024-08-17T02:46:13.787723+0000","last_peered":"2024-08-17T02:46:13.787723+0000","last_clean":"2024-08-17T02:46:13.787723+0000","last_became_active":"2024-08-17T02:46:12.761769+0000","last_became_peered":"2024-08-17T02:46:12.761769+0000","last_unstale":"2024-08-17T02:46:13.787723+0000","last_undegraded":"2024-08-17T02:46:13.787723+0000","last_fullsized":"2024-08-17T02:46:13.787723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:29.351136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764812+0000","last_change":"2024-08-17T02:46:13.762933+0000","last_active":"2024-08-17T02:46:13.764812+0000","last_peered":"2024-08-17T02:46:13.764812+0000","last_clean":"2024-08-17T02:46:13.764812+0000","last_became_active":"2024-08-17T02:46:13.762614+0000","last_became_peered":"2024-08-17T02:46:13.762614+0000","last_unstale":"2024-08-17T02:46:13.764812+0000","last_undegraded":"2024-08-17T02:46:13.764812+0000","last_fullsized":"2024-08-17T02:46:13.764812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786378+0000","last_change":"2024-08-17T02:46:12.767446+0000","last_active":"2024-08-17T02:46:13.786378+0000","last_peered":"2024-08-17T02:46:13.786378+0000","last_clean":"2024-08-17T02:46:13.786378+0000","last_became_active":"2024-08-17T02:46:12.767136+0000","last_became_peered":"2024-08-17T02:46:12.767136+0000","last_unstale":"2024-08-17T02:46:13.786378+0000","last_undegraded":"2024-08-17T02:46:13.786378+0000","last_fullsized":"2024-08-17T02:46:13.786378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:29.351136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.149}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.0810000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9740000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.0499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.845}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2690000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6240000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2789999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.673}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5609999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:23.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:46:23.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.276+0000 7fe2f6400640 1 Processor -- start 2024-08-17T02:46:23.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.276+0000 7fe2f6400640 1 -- start start 2024-08-17T02:46:23.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2f6400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2f00afca0 0x7fe2f00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2f6400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00acf10 0x7fe2f0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2f6400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f015a4e0 con 0x7fe2f01589a0 2024-08-17T02:46:23.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2f6400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00b0980 con 0x7fe2f00afca0 2024-08-17T02:46:23.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2f6400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00c92b0 con 0x7fe2f00acf10 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2ef400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2f00afca0 0x7fe2f00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2ef400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2f00afca0 0x7fe2f00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:52234/0 (socket says 172.21.15.2:52234) 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2ef400640 1 -- 172.21.15.2:0/643519600 learned_addr learned my addr 172.21.15.2:0/643519600 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2e7e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00acf10 0x7fe2f0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.278+0000 7fe2efe00640 1 --1- 172.21.15.2:0/643519600 >> v1:172.21.15.26:6789/0 conn(0x7fe2f01589a0 0x7fe2f006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:57352/0 (socket says 172.21.15.2:57352) 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.279+0000 7fe2ef400640 1 -- 172.21.15.2:0/643519600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00acf10 msgr2=0x7fe2f0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.279+0000 7fe2ef400640 1 --2- 172.21.15.2:0/643519600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00acf10 0x7fe2f0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.279+0000 7fe2ef400640 1 -- 172.21.15.2:0/643519600 >> v1:172.21.15.26:6789/0 conn(0x7fe2f01589a0 legacy=0x7fe2f006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.279+0000 7fe2ef400640 1 -- 172.21.15.2:0/643519600 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00ad480 con 0x7fe2f00afca0 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.280+0000 7fe2ef400640 1 --2- 172.21.15.2:0/643519600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00afca0 0x7fe2f00b0070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009940 tx=0x7fe2e00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=422aa1d7f1255942 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.280+0000 7fe2eea00640 1 -- 172.21.15.2:0/643519600 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e002ae40 con 0x7fe2f00afca0 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.280+0000 7fe2eea00640 1 -- 172.21.15.2:0/643519600 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0032440 con 0x7fe2f00afca0 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.280+0000 7fe2eea00640 1 -- 172.21.15.2:0/643519600 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0032820 con 0x7fe2f00afca0 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.280+0000 7fe2f6400640 1 -- 172.21.15.2:0/643519600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00afca0 msgr2=0x7fe2f00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.280+0000 7fe2f6400640 1 --2- 172.21.15.2:0/643519600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00afca0 0x7fe2f00b0070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009940 tx=0x7fe2e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.281+0000 7fe2f6400640 1 -- 172.21.15.2:0/643519600 shutdown_connections 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.281+0000 7fe2f6400640 1 --2- 172.21.15.2:0/643519600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00acf10 0x7fe2f0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.281+0000 7fe2f6400640 1 --2- 172.21.15.2:0/643519600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f00afca0 0x7fe2f00b0070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.281+0000 7fe2f6400640 1 -- 172.21.15.2:0/643519600 >> 172.21.15.2:0/643519600 conn(0x7fe2f0066e60 msgr2=0x7fe2f0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.281+0000 7fe2f6400640 1 -- 172.21.15.2:0/643519600 shutdown_connections 2024-08-17T02:46:23.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.281+0000 7fe2f6400640 1 -- 172.21.15.2:0/643519600 wait complete. 2024-08-17T02:46:23.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.282+0000 7fe2f6400640 1 Processor -- start 2024-08-17T02:46:23.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.282+0000 7fe2f6400640 1 -- start start 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.283+0000 7fe2f6400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f00acf10 0x7fe2f00ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.283+0000 7fe2f6400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00afca0 0x7fe2f014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.283+0000 7fe2f6400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f01589a0 0x7fe2f014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.283+0000 7fe2f6400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0149010 con 0x7fe2f00acf10 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.283+0000 7fe2f6400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00c9a20 con 0x7fe2f01589a0 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.283+0000 7fe2f6400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0148cc0 con 0x7fe2f00afca0 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.283+0000 7fe2ef400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f00acf10 0x7fe2f00ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2ef400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f00acf10 0x7fe2f00ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37832/0 (socket says 172.21.15.2:37832) 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2ef400640 1 -- 172.21.15.2:0/1973091432 learned_addr learned my addr 172.21.15.2:0/1973091432 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:23.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2efe00640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f01589a0 0x7fe2f014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2e7e00640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00afca0 0x7fe2f014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2ef400640 1 -- 172.21.15.2:0/1973091432 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00afca0 msgr2=0x7fe2f014e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2ef400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00afca0 0x7fe2f014e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2ef400640 1 -- 172.21.15.2:0/1973091432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f01589a0 msgr2=0x7fe2f014e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2ef400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f01589a0 0x7fe2f014e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2ef400640 1 -- 172.21.15.2:0/1973091432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0009450 con 0x7fe2f00acf10 2024-08-17T02:46:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.284+0000 7fe2ef400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f00acf10 0x7fe2f00ca220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0035040 tx=0x7fe2e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.285+0000 7fe2e6a00640 1 -- 172.21.15.2:0/1973091432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0031c80 con 0x7fe2f00acf10 2024-08-17T02:46:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.285+0000 7fe2e6a00640 1 -- 172.21.15.2:0/1973091432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0031e40 con 0x7fe2f00acf10 2024-08-17T02:46:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.285+0000 7fe2e6a00640 1 -- 172.21.15.2:0/1973091432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e003d670 con 0x7fe2f00acf10 2024-08-17T02:46:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.285+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f014eda0 con 0x7fe2f00acf10 2024-08-17T02:46:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.285+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f014f360 con 0x7fe2f00acf10 2024-08-17T02:46:23.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.286+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f0063fb0 con 0x7fe2f00acf10 2024-08-17T02:46:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.286+0000 7fe2e6a00640 1 -- 172.21.15.2:0/1973091432 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2e0039040 con 0x7fe2f00acf10 2024-08-17T02:46:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.287+0000 7fe2e6a00640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2cc065150 0x7fe2cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.287+0000 7fe2e6a00640 1 -- 172.21.15.2:0/1973091432 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2e002ae40 con 0x7fe2f00acf10 2024-08-17T02:46:23.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.288+0000 7fe2e7e00640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2cc065150 0x7fe2cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.288+0000 7fe2e7e00640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2cc065150 0x7fe2cc067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00c95b0 tx=0x7fe2d80090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.291+0000 7fe2e6a00640 1 -- 172.21.15.2:0/1973091432 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2e00703d0 con 0x7fe2f00acf10 2024-08-17T02:46:23.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.468+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2f0149150 con 0x7fe2cc065150 2024-08-17T02:46:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.475+0000 7fe2e6a00640 1 -- 172.21.15.2:0/1973091432 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264440 (secure 0 0 0) 0x7fe2d8009a40 con 0x7fe2cc065150 2024-08-17T02:46:23.479 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:46:23.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2cc065150 msgr2=0x7fe2cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2cc065150 0x7fe2cc067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00c95b0 tx=0x7fe2d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f00acf10 msgr2=0x7fe2f00ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f00acf10 0x7fe2f00ca220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0035040 tx=0x7fe2e0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 shutdown_connections 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2f01589a0 0x7fe2f014e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2cc065150 0x7fe2cc067600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe2f00afca0 0x7fe2f014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 --2- 172.21.15.2:0/1973091432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f00acf10 0x7fe2f00ca220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.478+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 >> 172.21.15.2:0/1973091432 conn(0x7fe2f0066e60 msgr2=0x7fe2f01483a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.479+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 shutdown_connections 2024-08-17T02:46:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.479+0000 7fe2f6400640 1 -- 172.21.15.2:0/1973091432 wait complete. 2024-08-17T02:46:23.495 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:46:23.016436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2415072,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752559648,"statfs":{"total":773094113280,"available":770621079552,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.274596"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783449+0000","last_change":"2024-08-17T02:46:13.782069+0000","last_active":"2024-08-17T02:46:13.783449+0000","last_peered":"2024-08-17T02:46:13.783449+0000","last_clean":"2024-08-17T02:46:13.783449+0000","last_became_active":"2024-08-17T02:46:13.780634+0000","last_became_peered":"2024-08-17T02:46:13.780634+0000","last_unstale":"2024-08-17T02:46:13.783449+0000","last_undegraded":"2024-08-17T02:46:13.783449+0000","last_fullsized":"2024-08-17T02:46:13.783449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:48.296428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788581+0000","last_change":"2024-08-17T02:46:13.787373+0000","last_active":"2024-08-17T02:46:13.788581+0000","last_peered":"2024-08-17T02:46:13.788581+0000","last_clean":"2024-08-17T02:46:13.788581+0000","last_became_active":"2024-08-17T02:46:13.785874+0000","last_became_peered":"2024-08-17T02:46:13.785874+0000","last_unstale":"2024-08-17T02:46:13.788581+0000","last_undegraded":"2024-08-17T02:46:13.788581+0000","last_fullsized":"2024-08-17T02:46:13.788581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.771809+0000","last_change":"2024-08-17T02:46:13.756970+0000","last_active":"2024-08-17T02:46:13.771809+0000","last_peered":"2024-08-17T02:46:13.771809+0000","last_clean":"2024-08-17T02:46:13.771809+0000","last_became_active":"2024-08-17T02:46:13.756661+0000","last_became_peered":"2024-08-17T02:46:13.756661+0000","last_unstale":"2024-08-17T02:46:13.771809+0000","last_undegraded":"2024-08-17T02:46:13.771809+0000","last_fullsized":"2024-08-17T02:46:13.771809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763017+0000","last_change":"2024-08-17T02:46:13.760375+0000","last_active":"2024-08-17T02:46:13.763017+0000","last_peered":"2024-08-17T02:46:13.763017+0000","last_clean":"2024-08-17T02:46:13.763017+0000","last_became_active":"2024-08-17T02:46:13.759323+0000","last_became_peered":"2024-08-17T02:46:13.759323+0000","last_unstale":"2024-08-17T02:46:13.763017+0000","last_undegraded":"2024-08-17T02:46:13.763017+0000","last_fullsized":"2024-08-17T02:46:13.763017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:53.437116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787628+0000","last_change":"2024-08-17T02:46:13.778338+0000","last_active":"2024-08-17T02:46:13.787628+0000","last_peered":"2024-08-17T02:46:13.787628+0000","last_clean":"2024-08-17T02:46:13.787628+0000","last_became_active":"2024-08-17T02:46:13.771574+0000","last_became_peered":"2024-08-17T02:46:13.771574+0000","last_unstale":"2024-08-17T02:46:13.787628+0000","last_undegraded":"2024-08-17T02:46:13.787628+0000","last_fullsized":"2024-08-17T02:46:13.787628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:53.437116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777529+0000","last_change":"2024-08-17T02:46:13.774672+0000","last_active":"2024-08-17T02:46:13.777529+0000","last_peered":"2024-08-17T02:46:13.777529+0000","last_clean":"2024-08-17T02:46:13.777529+0000","last_became_active":"2024-08-17T02:46:13.774417+0000","last_became_peered":"2024-08-17T02:46:13.774417+0000","last_unstale":"2024-08-17T02:46:13.777529+0000","last_undegraded":"2024-08-17T02:46:13.777529+0000","last_fullsized":"2024-08-17T02:46:13.777529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777974+0000","last_change":"2024-08-17T02:46:13.777018+0000","last_active":"2024-08-17T02:46:13.777974+0000","last_peered":"2024-08-17T02:46:13.777974+0000","last_clean":"2024-08-17T02:46:13.777974+0000","last_became_active":"2024-08-17T02:46:13.776494+0000","last_became_peered":"2024-08-17T02:46:13.776494+0000","last_unstale":"2024-08-17T02:46:13.777974+0000","last_undegraded":"2024-08-17T02:46:13.777974+0000","last_fullsized":"2024-08-17T02:46:13.777974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:13.882288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777982+0000","last_change":"2024-08-17T02:46:13.772303+0000","last_active":"2024-08-17T02:46:13.777982+0000","last_peered":"2024-08-17T02:46:13.777982+0000","last_clean":"2024-08-17T02:46:13.777982+0000","last_became_active":"2024-08-17T02:46:13.770496+0000","last_became_peered":"2024-08-17T02:46:13.770496+0000","last_unstale":"2024-08-17T02:46:13.777982+0000","last_undegraded":"2024-08-17T02:46:13.777982+0000","last_fullsized":"2024-08-17T02:46:13.777982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783745+0000","last_change":"2024-08-17T02:46:13.782542+0000","last_active":"2024-08-17T02:46:13.783745+0000","last_peered":"2024-08-17T02:46:13.783745+0000","last_clean":"2024-08-17T02:46:13.783745+0000","last_became_active":"2024-08-17T02:46:13.781512+0000","last_became_peered":"2024-08-17T02:46:13.781512+0000","last_unstale":"2024-08-17T02:46:13.783745+0000","last_undegraded":"2024-08-17T02:46:13.783745+0000","last_fullsized":"2024-08-17T02:46:13.783745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:31.909156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774645+0000","last_change":"2024-08-17T02:46:13.772207+0000","last_active":"2024-08-17T02:46:13.774645+0000","last_peered":"2024-08-17T02:46:13.774645+0000","last_clean":"2024-08-17T02:46:13.774645+0000","last_became_active":"2024-08-17T02:46:13.771965+0000","last_became_peered":"2024-08-17T02:46:13.771965+0000","last_unstale":"2024-08-17T02:46:13.774645+0000","last_undegraded":"2024-08-17T02:46:13.774645+0000","last_fullsized":"2024-08-17T02:46:13.774645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774903+0000","last_change":"2024-08-17T02:46:13.772803+0000","last_active":"2024-08-17T02:46:13.774903+0000","last_peered":"2024-08-17T02:46:13.774903+0000","last_clean":"2024-08-17T02:46:13.774903+0000","last_became_active":"2024-08-17T02:46:13.772356+0000","last_became_peered":"2024-08-17T02:46:13.772356+0000","last_unstale":"2024-08-17T02:46:13.774903+0000","last_undegraded":"2024-08-17T02:46:13.774903+0000","last_fullsized":"2024-08-17T02:46:13.774903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774317+0000","last_change":"2024-08-17T02:46:13.765594+0000","last_active":"2024-08-17T02:46:13.774317+0000","last_peered":"2024-08-17T02:46:13.774317+0000","last_clean":"2024-08-17T02:46:13.774317+0000","last_became_active":"2024-08-17T02:46:13.765142+0000","last_became_peered":"2024-08-17T02:46:13.765142+0000","last_unstale":"2024-08-17T02:46:13.774317+0000","last_undegraded":"2024-08-17T02:46:13.774317+0000","last_fullsized":"2024-08-17T02:46:13.774317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:17.516179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764835+0000","last_change":"2024-08-17T02:46:13.762927+0000","last_active":"2024-08-17T02:46:13.764835+0000","last_peered":"2024-08-17T02:46:13.764835+0000","last_clean":"2024-08-17T02:46:13.764835+0000","last_became_active":"2024-08-17T02:46:13.762593+0000","last_became_peered":"2024-08-17T02:46:13.762593+0000","last_unstale":"2024-08-17T02:46:13.764835+0000","last_undegraded":"2024-08-17T02:46:13.764835+0000","last_fullsized":"2024-08-17T02:46:13.764835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786511+0000","last_change":"2024-08-17T02:46:13.779226+0000","last_active":"2024-08-17T02:46:13.786511+0000","last_peered":"2024-08-17T02:46:13.786511+0000","last_clean":"2024-08-17T02:46:13.786511+0000","last_became_active":"2024-08-17T02:46:13.778514+0000","last_became_peered":"2024-08-17T02:46:13.778514+0000","last_unstale":"2024-08-17T02:46:13.786511+0000","last_undegraded":"2024-08-17T02:46:13.786511+0000","last_fullsized":"2024-08-17T02:46:13.786511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775996+0000","last_change":"2024-08-17T02:46:13.764824+0000","last_active":"2024-08-17T02:46:13.775996+0000","last_peered":"2024-08-17T02:46:13.775996+0000","last_clean":"2024-08-17T02:46:13.775996+0000","last_became_active":"2024-08-17T02:46:13.764423+0000","last_became_peered":"2024-08-17T02:46:13.764423+0000","last_unstale":"2024-08-17T02:46:13.775996+0000","last_undegraded":"2024-08-17T02:46:13.775996+0000","last_fullsized":"2024-08-17T02:46:13.775996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.762356+0000","last_change":"2024-08-17T02:46:13.758109+0000","last_active":"2024-08-17T02:46:13.762356+0000","last_peered":"2024-08-17T02:46:13.762356+0000","last_clean":"2024-08-17T02:46:13.762356+0000","last_became_active":"2024-08-17T02:46:13.757727+0000","last_became_peered":"2024-08-17T02:46:13.757727+0000","last_unstale":"2024-08-17T02:46:13.762356+0000","last_undegraded":"2024-08-17T02:46:13.762356+0000","last_fullsized":"2024-08-17T02:46:13.762356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:29.582747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775780+0000","last_change":"2024-08-17T02:46:13.770315+0000","last_active":"2024-08-17T02:46:13.775780+0000","last_peered":"2024-08-17T02:46:13.775780+0000","last_clean":"2024-08-17T02:46:13.775780+0000","last_became_active":"2024-08-17T02:46:13.770058+0000","last_became_peered":"2024-08-17T02:46:13.770058+0000","last_unstale":"2024-08-17T02:46:13.775780+0000","last_undegraded":"2024-08-17T02:46:13.775780+0000","last_fullsized":"2024-08-17T02:46:13.775780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:13.882288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.765237+0000","last_change":"2024-08-17T02:46:13.762473+0000","last_active":"2024-08-17T02:46:13.765237+0000","last_peered":"2024-08-17T02:46:13.765237+0000","last_clean":"2024-08-17T02:46:13.765237+0000","last_became_active":"2024-08-17T02:46:13.762210+0000","last_became_peered":"2024-08-17T02:46:13.762210+0000","last_unstale":"2024-08-17T02:46:13.765237+0000","last_undegraded":"2024-08-17T02:46:13.765237+0000","last_fullsized":"2024-08-17T02:46:13.765237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:28.991722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781197+0000","last_change":"2024-08-17T02:46:13.774494+0000","last_active":"2024-08-17T02:46:13.781197+0000","last_peered":"2024-08-17T02:46:13.781197+0000","last_clean":"2024-08-17T02:46:13.781197+0000","last_became_active":"2024-08-17T02:46:13.774173+0000","last_became_peered":"2024-08-17T02:46:13.774173+0000","last_unstale":"2024-08-17T02:46:13.781197+0000","last_undegraded":"2024-08-17T02:46:13.781197+0000","last_fullsized":"2024-08-17T02:46:13.781197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:10.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774059+0000","last_change":"2024-08-17T02:46:13.766560+0000","last_active":"2024-08-17T02:46:13.774059+0000","last_peered":"2024-08-17T02:46:13.774059+0000","last_clean":"2024-08-17T02:46:13.774059+0000","last_became_active":"2024-08-17T02:46:13.765745+0000","last_became_peered":"2024-08-17T02:46:13.765745+0000","last_unstale":"2024-08-17T02:46:13.774059+0000","last_undegraded":"2024-08-17T02:46:13.774059+0000","last_fullsized":"2024-08-17T02:46:13.774059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776545+0000","last_change":"2024-08-17T02:46:13.765254+0000","last_active":"2024-08-17T02:46:13.776545+0000","last_peered":"2024-08-17T02:46:13.776545+0000","last_clean":"2024-08-17T02:46:13.776545+0000","last_became_active":"2024-08-17T02:46:13.756647+0000","last_became_peered":"2024-08-17T02:46:13.756647+0000","last_unstale":"2024-08-17T02:46:13.776545+0000","last_undegraded":"2024-08-17T02:46:13.776545+0000","last_fullsized":"2024-08-17T02:46:13.776545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.770703+0000","last_change":"2024-08-17T02:46:13.765508+0000","last_active":"2024-08-17T02:46:13.770703+0000","last_peered":"2024-08-17T02:46:13.770703+0000","last_clean":"2024-08-17T02:46:13.770703+0000","last_became_active":"2024-08-17T02:46:13.765136+0000","last_became_peered":"2024-08-17T02:46:13.765136+0000","last_unstale":"2024-08-17T02:46:13.770703+0000","last_undegraded":"2024-08-17T02:46:13.770703+0000","last_fullsized":"2024-08-17T02:46:13.770703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:48.296428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.773564+0000","last_change":"2024-08-17T02:46:13.766938+0000","last_active":"2024-08-17T02:46:13.773564+0000","last_peered":"2024-08-17T02:46:13.773564+0000","last_clean":"2024-08-17T02:46:13.773564+0000","last_became_active":"2024-08-17T02:46:13.766711+0000","last_became_peered":"2024-08-17T02:46:13.766711+0000","last_unstale":"2024-08-17T02:46:13.773564+0000","last_undegraded":"2024-08-17T02:46:13.773564+0000","last_fullsized":"2024-08-17T02:46:13.773564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763233+0000","last_change":"2024-08-17T02:46:13.761055+0000","last_active":"2024-08-17T02:46:13.763233+0000","last_peered":"2024-08-17T02:46:13.763233+0000","last_clean":"2024-08-17T02:46:13.763233+0000","last_became_active":"2024-08-17T02:46:13.760766+0000","last_became_peered":"2024-08-17T02:46:13.760766+0000","last_unstale":"2024-08-17T02:46:13.763233+0000","last_undegraded":"2024-08-17T02:46:13.763233+0000","last_fullsized":"2024-08-17T02:46:13.763233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:10.558419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776693+0000","last_change":"2024-08-17T02:46:13.769437+0000","last_active":"2024-08-17T02:46:13.776693+0000","last_peered":"2024-08-17T02:46:13.776693+0000","last_clean":"2024-08-17T02:46:13.776693+0000","last_became_active":"2024-08-17T02:46:13.768078+0000","last_became_peered":"2024-08-17T02:46:13.768078+0000","last_unstale":"2024-08-17T02:46:13.776693+0000","last_undegraded":"2024-08-17T02:46:13.776693+0000","last_fullsized":"2024-08-17T02:46:13.776693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.782708+0000","last_change":"2024-08-17T02:46:13.780502+0000","last_active":"2024-08-17T02:46:13.782708+0000","last_peered":"2024-08-17T02:46:13.782708+0000","last_clean":"2024-08-17T02:46:13.782708+0000","last_became_active":"2024-08-17T02:46:13.780234+0000","last_became_peered":"2024-08-17T02:46:13.780234+0000","last_unstale":"2024-08-17T02:46:13.782708+0000","last_undegraded":"2024-08-17T02:46:13.782708+0000","last_fullsized":"2024-08-17T02:46:13.782708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776104+0000","last_change":"2024-08-17T02:46:13.765975+0000","last_active":"2024-08-17T02:46:13.776104+0000","last_peered":"2024-08-17T02:46:13.776104+0000","last_clean":"2024-08-17T02:46:13.776104+0000","last_became_active":"2024-08-17T02:46:13.765732+0000","last_became_peered":"2024-08-17T02:46:13.765732+0000","last_unstale":"2024-08-17T02:46:13.776104+0000","last_undegraded":"2024-08-17T02:46:13.776104+0000","last_fullsized":"2024-08-17T02:46:13.776104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781638+0000","last_change":"2024-08-17T02:46:13.768145+0000","last_active":"2024-08-17T02:46:13.781638+0000","last_peered":"2024-08-17T02:46:13.781638+0000","last_clean":"2024-08-17T02:46:13.781638+0000","last_became_active":"2024-08-17T02:46:13.767826+0000","last_became_peered":"2024-08-17T02:46:13.767826+0000","last_unstale":"2024-08-17T02:46:13.781638+0000","last_undegraded":"2024-08-17T02:46:13.781638+0000","last_fullsized":"2024-08-17T02:46:13.781638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787886+0000","last_change":"2024-08-17T02:46:13.773416+0000","last_active":"2024-08-17T02:46:13.787886+0000","last_peered":"2024-08-17T02:46:13.787886+0000","last_clean":"2024-08-17T02:46:13.787886+0000","last_became_active":"2024-08-17T02:46:13.773114+0000","last_became_peered":"2024-08-17T02:46:13.773114+0000","last_unstale":"2024-08-17T02:46:13.787886+0000","last_undegraded":"2024-08-17T02:46:13.787886+0000","last_fullsized":"2024-08-17T02:46:13.787886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:00.627300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.765708+0000","last_change":"2024-08-17T02:46:13.759659+0000","last_active":"2024-08-17T02:46:13.765708+0000","last_peered":"2024-08-17T02:46:13.765708+0000","last_clean":"2024-08-17T02:46:13.765708+0000","last_became_active":"2024-08-17T02:46:13.759333+0000","last_became_peered":"2024-08-17T02:46:13.759333+0000","last_unstale":"2024-08-17T02:46:13.765708+0000","last_undegraded":"2024-08-17T02:46:13.765708+0000","last_fullsized":"2024-08-17T02:46:13.765708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772382+0000","last_change":"2024-08-17T02:46:13.768988+0000","last_active":"2024-08-17T02:46:13.772382+0000","last_peered":"2024-08-17T02:46:13.772382+0000","last_clean":"2024-08-17T02:46:13.772382+0000","last_became_active":"2024-08-17T02:46:13.768739+0000","last_became_peered":"2024-08-17T02:46:13.768739+0000","last_unstale":"2024-08-17T02:46:13.772382+0000","last_undegraded":"2024-08-17T02:46:13.772382+0000","last_fullsized":"2024-08-17T02:46:13.772382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:43.094798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777504+0000","last_change":"2024-08-17T02:46:13.776020+0000","last_active":"2024-08-17T02:46:13.777504+0000","last_peered":"2024-08-17T02:46:13.777504+0000","last_clean":"2024-08-17T02:46:13.777504+0000","last_became_active":"2024-08-17T02:46:13.775579+0000","last_became_peered":"2024-08-17T02:46:13.775579+0000","last_unstale":"2024-08-17T02:46:13.777504+0000","last_undegraded":"2024-08-17T02:46:13.777504+0000","last_fullsized":"2024-08-17T02:46:13.777504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787097+0000","last_change":"2024-08-17T02:46:13.785306+0000","last_active":"2024-08-17T02:46:13.787097+0000","last_peered":"2024-08-17T02:46:13.787097+0000","last_clean":"2024-08-17T02:46:13.787097+0000","last_became_active":"2024-08-17T02:46:13.783412+0000","last_became_peered":"2024-08-17T02:46:13.783412+0000","last_unstale":"2024-08-17T02:46:13.787097+0000","last_undegraded":"2024-08-17T02:46:13.787097+0000","last_fullsized":"2024-08-17T02:46:13.787097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:29.033682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787958+0000","last_change":"2024-08-17T02:46:12.766141+0000","last_active":"2024-08-17T02:46:13.787958+0000","last_peered":"2024-08-17T02:46:13.787958+0000","last_clean":"2024-08-17T02:46:13.787958+0000","last_became_active":"2024-08-17T02:46:12.763492+0000","last_became_peered":"2024-08-17T02:46:12.763492+0000","last_unstale":"2024-08-17T02:46:13.787958+0000","last_undegraded":"2024-08-17T02:46:13.787958+0000","last_fullsized":"2024-08-17T02:46:13.787958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784653+0000","last_change":"2024-08-17T02:46:13.772658+0000","last_active":"2024-08-17T02:46:13.784653+0000","last_peered":"2024-08-17T02:46:13.784653+0000","last_clean":"2024-08-17T02:46:13.784653+0000","last_became_active":"2024-08-17T02:46:13.765586+0000","last_became_peered":"2024-08-17T02:46:13.765586+0000","last_unstale":"2024-08-17T02:46:13.784653+0000","last_undegraded":"2024-08-17T02:46:13.784653+0000","last_fullsized":"2024-08-17T02:46:13.784653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788422+0000","last_change":"2024-08-17T02:46:12.765654+0000","last_active":"2024-08-17T02:46:13.788422+0000","last_peered":"2024-08-17T02:46:13.788422+0000","last_clean":"2024-08-17T02:46:13.788422+0000","last_became_active":"2024-08-17T02:46:12.765358+0000","last_became_peered":"2024-08-17T02:46:12.765358+0000","last_unstale":"2024-08-17T02:46:13.788422+0000","last_undegraded":"2024-08-17T02:46:13.788422+0000","last_fullsized":"2024-08-17T02:46:13.788422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.746879+0000","last_change":"2024-08-17T02:46:12.757374+0000","last_active":"2024-08-17T02:46:13.746879+0000","last_peered":"2024-08-17T02:46:13.746879+0000","last_clean":"2024-08-17T02:46:13.746879+0000","last_became_active":"2024-08-17T02:46:12.757064+0000","last_became_peered":"2024-08-17T02:46:12.757064+0000","last_unstale":"2024-08-17T02:46:13.746879+0000","last_undegraded":"2024-08-17T02:46:13.746879+0000","last_fullsized":"2024-08-17T02:46:13.746879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:32.171597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.758714+0000","last_change":"2024-08-17T02:46:13.757800+0000","last_active":"2024-08-17T02:46:13.758714+0000","last_peered":"2024-08-17T02:46:13.758714+0000","last_clean":"2024-08-17T02:46:13.758714+0000","last_became_active":"2024-08-17T02:46:13.757609+0000","last_became_peered":"2024-08-17T02:46:13.757609+0000","last_unstale":"2024-08-17T02:46:13.758714+0000","last_undegraded":"2024-08-17T02:46:13.758714+0000","last_fullsized":"2024-08-17T02:46:13.758714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:17.680506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.752836+0000","last_change":"2024-08-17T02:46:12.771509+0000","last_active":"2024-08-17T02:46:13.752836+0000","last_peered":"2024-08-17T02:46:13.752836+0000","last_clean":"2024-08-17T02:46:13.752836+0000","last_became_active":"2024-08-17T02:46:12.765884+0000","last_became_peered":"2024-08-17T02:46:12.765884+0000","last_unstale":"2024-08-17T02:46:13.752836+0000","last_undegraded":"2024-08-17T02:46:13.752836+0000","last_fullsized":"2024-08-17T02:46:13.752836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772441+0000","last_change":"2024-08-17T02:46:13.760432+0000","last_active":"2024-08-17T02:46:13.772441+0000","last_peered":"2024-08-17T02:46:13.772441+0000","last_clean":"2024-08-17T02:46:13.772441+0000","last_became_active":"2024-08-17T02:46:13.757461+0000","last_became_peered":"2024-08-17T02:46:13.757461+0000","last_unstale":"2024-08-17T02:46:13.772441+0000","last_undegraded":"2024-08-17T02:46:13.772441+0000","last_fullsized":"2024-08-17T02:46:13.772441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.760005+0000","last_change":"2024-08-17T02:46:12.771440+0000","last_active":"2024-08-17T02:46:13.760005+0000","last_peered":"2024-08-17T02:46:13.760005+0000","last_clean":"2024-08-17T02:46:13.760005+0000","last_became_active":"2024-08-17T02:46:12.771171+0000","last_became_peered":"2024-08-17T02:46:12.771171+0000","last_unstale":"2024-08-17T02:46:13.760005+0000","last_undegraded":"2024-08-17T02:46:13.760005+0000","last_fullsized":"2024-08-17T02:46:13.760005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776159+0000","last_change":"2024-08-17T02:46:13.770867+0000","last_active":"2024-08-17T02:46:13.776159+0000","last_peered":"2024-08-17T02:46:13.776159+0000","last_clean":"2024-08-17T02:46:13.776159+0000","last_became_active":"2024-08-17T02:46:13.770367+0000","last_became_peered":"2024-08-17T02:46:13.770367+0000","last_unstale":"2024-08-17T02:46:13.776159+0000","last_undegraded":"2024-08-17T02:46:13.776159+0000","last_fullsized":"2024-08-17T02:46:13.776159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:59.549871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749408+0000","last_change":"2024-08-17T02:46:12.773955+0000","last_active":"2024-08-17T02:46:13.749408+0000","last_peered":"2024-08-17T02:46:13.749408+0000","last_clean":"2024-08-17T02:46:13.749408+0000","last_became_active":"2024-08-17T02:46:12.772243+0000","last_became_peered":"2024-08-17T02:46:12.772243+0000","last_unstale":"2024-08-17T02:46:13.749408+0000","last_undegraded":"2024-08-17T02:46:13.749408+0000","last_fullsized":"2024-08-17T02:46:13.749408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786276+0000","last_change":"2024-08-17T02:46:13.777529+0000","last_active":"2024-08-17T02:46:13.786276+0000","last_peered":"2024-08-17T02:46:13.786276+0000","last_clean":"2024-08-17T02:46:13.786276+0000","last_became_active":"2024-08-17T02:46:13.776596+0000","last_became_peered":"2024-08-17T02:46:13.776596+0000","last_unstale":"2024-08-17T02:46:13.786276+0000","last_undegraded":"2024-08-17T02:46:13.786276+0000","last_fullsized":"2024-08-17T02:46:13.786276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784145+0000","last_change":"2024-08-17T02:46:12.771541+0000","last_active":"2024-08-17T02:46:13.784145+0000","last_peered":"2024-08-17T02:46:13.784145+0000","last_clean":"2024-08-17T02:46:13.784145+0000","last_became_active":"2024-08-17T02:46:12.771307+0000","last_became_peered":"2024-08-17T02:46:12.771307+0000","last_unstale":"2024-08-17T02:46:13.784145+0000","last_undegraded":"2024-08-17T02:46:13.784145+0000","last_fullsized":"2024-08-17T02:46:13.784145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.771994+0000","last_change":"2024-08-17T02:46:13.765422+0000","last_active":"2024-08-17T02:46:13.771994+0000","last_peered":"2024-08-17T02:46:13.771994+0000","last_clean":"2024-08-17T02:46:13.771994+0000","last_became_active":"2024-08-17T02:46:13.764854+0000","last_became_peered":"2024-08-17T02:46:13.764854+0000","last_unstale":"2024-08-17T02:46:13.771994+0000","last_undegraded":"2024-08-17T02:46:13.771994+0000","last_fullsized":"2024-08-17T02:46:13.771994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:20.767461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.790295+0000","last_change":"2024-08-17T02:46:12.763643+0000","last_active":"2024-08-17T02:46:13.790295+0000","last_peered":"2024-08-17T02:46:13.790295+0000","last_clean":"2024-08-17T02:46:13.790295+0000","last_became_active":"2024-08-17T02:46:12.763196+0000","last_became_peered":"2024-08-17T02:46:12.763196+0000","last_unstale":"2024-08-17T02:46:13.790295+0000","last_undegraded":"2024-08-17T02:46:13.790295+0000","last_fullsized":"2024-08-17T02:46:13.790295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.781185+0000","last_change":"2024-08-17T02:46:13.768744+0000","last_active":"2024-08-17T02:46:13.781185+0000","last_peered":"2024-08-17T02:46:13.781185+0000","last_clean":"2024-08-17T02:46:13.781185+0000","last_became_active":"2024-08-17T02:46:13.768433+0000","last_became_peered":"2024-08-17T02:46:13.768433+0000","last_unstale":"2024-08-17T02:46:13.781185+0000","last_undegraded":"2024-08-17T02:46:13.781185+0000","last_fullsized":"2024-08-17T02:46:13.781185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:30.671696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788049+0000","last_change":"2024-08-17T02:46:12.764570+0000","last_active":"2024-08-17T02:46:13.788049+0000","last_peered":"2024-08-17T02:46:13.788049+0000","last_clean":"2024-08-17T02:46:13.788049+0000","last_became_active":"2024-08-17T02:46:12.763764+0000","last_became_peered":"2024-08-17T02:46:12.763764+0000","last_unstale":"2024-08-17T02:46:13.788049+0000","last_undegraded":"2024-08-17T02:46:13.788049+0000","last_fullsized":"2024-08-17T02:46:13.788049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:08:32.171597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.778773+0000","last_change":"2024-08-17T02:46:13.764855+0000","last_active":"2024-08-17T02:46:13.778773+0000","last_peered":"2024-08-17T02:46:13.778773+0000","last_clean":"2024-08-17T02:46:13.778773+0000","last_became_active":"2024-08-17T02:46:13.764494+0000","last_became_peered":"2024-08-17T02:46:13.764494+0000","last_unstale":"2024-08-17T02:46:13.778773+0000","last_undegraded":"2024-08-17T02:46:13.778773+0000","last_fullsized":"2024-08-17T02:46:13.778773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:26.668711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749487+0000","last_change":"2024-08-17T02:46:12.763292+0000","last_active":"2024-08-17T02:46:13.749487+0000","last_peered":"2024-08-17T02:46:13.749487+0000","last_clean":"2024-08-17T02:46:13.749487+0000","last_became_active":"2024-08-17T02:46:12.762486+0000","last_became_peered":"2024-08-17T02:46:12.762486+0000","last_unstale":"2024-08-17T02:46:13.749487+0000","last_undegraded":"2024-08-17T02:46:13.749487+0000","last_fullsized":"2024-08-17T02:46:13.749487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788571+0000","last_change":"2024-08-17T02:46:13.787493+0000","last_active":"2024-08-17T02:46:13.788571+0000","last_peered":"2024-08-17T02:46:13.788571+0000","last_clean":"2024-08-17T02:46:13.788571+0000","last_became_active":"2024-08-17T02:46:13.778178+0000","last_became_peered":"2024-08-17T02:46:13.778178+0000","last_unstale":"2024-08-17T02:46:13.788571+0000","last_undegraded":"2024-08-17T02:46:13.788571+0000","last_fullsized":"2024-08-17T02:46:13.788571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:59.549871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.759786+0000","last_change":"2024-08-17T02:46:12.760312+0000","last_active":"2024-08-17T02:46:13.759786+0000","last_peered":"2024-08-17T02:46:13.759786+0000","last_clean":"2024-08-17T02:46:13.759786+0000","last_became_active":"2024-08-17T02:46:12.760019+0000","last_became_peered":"2024-08-17T02:46:12.760019+0000","last_unstale":"2024-08-17T02:46:13.759786+0000","last_undegraded":"2024-08-17T02:46:13.759786+0000","last_fullsized":"2024-08-17T02:46:13.759786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777485+0000","last_change":"2024-08-17T02:46:13.775855+0000","last_active":"2024-08-17T02:46:13.777485+0000","last_peered":"2024-08-17T02:46:13.777485+0000","last_clean":"2024-08-17T02:46:13.777485+0000","last_became_active":"2024-08-17T02:46:13.775232+0000","last_became_peered":"2024-08-17T02:46:13.775232+0000","last_unstale":"2024-08-17T02:46:13.777485+0000","last_undegraded":"2024-08-17T02:46:13.777485+0000","last_fullsized":"2024-08-17T02:46:13.777485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:22:17.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788359+0000","last_change":"2024-08-17T02:46:12.761768+0000","last_active":"2024-08-17T02:46:13.788359+0000","last_peered":"2024-08-17T02:46:13.788359+0000","last_clean":"2024-08-17T02:46:13.788359+0000","last_became_active":"2024-08-17T02:46:12.761478+0000","last_became_peered":"2024-08-17T02:46:12.761478+0000","last_unstale":"2024-08-17T02:46:13.788359+0000","last_undegraded":"2024-08-17T02:46:13.788359+0000","last_fullsized":"2024-08-17T02:46:13.788359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784569+0000","last_change":"2024-08-17T02:46:13.780280+0000","last_active":"2024-08-17T02:46:13.784569+0000","last_peered":"2024-08-17T02:46:13.784569+0000","last_clean":"2024-08-17T02:46:13.784569+0000","last_became_active":"2024-08-17T02:46:13.779454+0000","last_became_peered":"2024-08-17T02:46:13.779454+0000","last_unstale":"2024-08-17T02:46:13.784569+0000","last_undegraded":"2024-08-17T02:46:13.784569+0000","last_fullsized":"2024-08-17T02:46:13.784569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788136+0000","last_change":"2024-08-17T02:46:12.769206+0000","last_active":"2024-08-17T02:46:13.788136+0000","last_peered":"2024-08-17T02:46:13.788136+0000","last_clean":"2024-08-17T02:46:13.788136+0000","last_became_active":"2024-08-17T02:46:12.768891+0000","last_became_peered":"2024-08-17T02:46:12.768891+0000","last_unstale":"2024-08-17T02:46:13.788136+0000","last_undegraded":"2024-08-17T02:46:13.788136+0000","last_fullsized":"2024-08-17T02:46:13.788136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:59:55.270622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.774129+0000","last_change":"2024-08-17T02:46:13.769837+0000","last_active":"2024-08-17T02:46:13.774129+0000","last_peered":"2024-08-17T02:46:13.774129+0000","last_clean":"2024-08-17T02:46:13.774129+0000","last_became_active":"2024-08-17T02:46:13.769478+0000","last_became_peered":"2024-08-17T02:46:13.769478+0000","last_unstale":"2024-08-17T02:46:13.774129+0000","last_undegraded":"2024-08-17T02:46:13.774129+0000","last_fullsized":"2024-08-17T02:46:13.774129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:47.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783670+0000","last_change":"2024-08-17T02:46:12.755672+0000","last_active":"2024-08-17T02:46:13.783670+0000","last_peered":"2024-08-17T02:46:13.783670+0000","last_clean":"2024-08-17T02:46:13.783670+0000","last_became_active":"2024-08-17T02:46:12.754437+0000","last_became_peered":"2024-08-17T02:46:12.754437+0000","last_unstale":"2024-08-17T02:46:13.783670+0000","last_undegraded":"2024-08-17T02:46:13.783670+0000","last_fullsized":"2024-08-17T02:46:13.783670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783726+0000","last_change":"2024-08-17T02:46:13.782246+0000","last_active":"2024-08-17T02:46:13.783726+0000","last_peered":"2024-08-17T02:46:13.783726+0000","last_clean":"2024-08-17T02:46:13.783726+0000","last_became_active":"2024-08-17T02:46:13.781368+0000","last_became_peered":"2024-08-17T02:46:13.781368+0000","last_unstale":"2024-08-17T02:46:13.783726+0000","last_undegraded":"2024-08-17T02:46:13.783726+0000","last_fullsized":"2024-08-17T02:46:13.783726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786712+0000","last_change":"2024-08-17T02:46:12.761505+0000","last_active":"2024-08-17T02:46:13.786712+0000","last_peered":"2024-08-17T02:46:13.786712+0000","last_clean":"2024-08-17T02:46:13.786712+0000","last_became_active":"2024-08-17T02:46:12.760373+0000","last_became_peered":"2024-08-17T02:46:12.760373+0000","last_unstale":"2024-08-17T02:46:13.786712+0000","last_undegraded":"2024-08-17T02:46:13.786712+0000","last_fullsized":"2024-08-17T02:46:13.786712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:16.510354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763000+0000","last_change":"2024-08-17T02:46:13.758103+0000","last_active":"2024-08-17T02:46:13.763000+0000","last_peered":"2024-08-17T02:46:13.763000+0000","last_clean":"2024-08-17T02:46:13.763000+0000","last_became_active":"2024-08-17T02:46:13.757785+0000","last_became_peered":"2024-08-17T02:46:13.757785+0000","last_unstale":"2024-08-17T02:46:13.763000+0000","last_undegraded":"2024-08-17T02:46:13.763000+0000","last_fullsized":"2024-08-17T02:46:13.763000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:47.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.751133+0000","last_change":"2024-08-17T02:46:12.773394+0000","last_active":"2024-08-17T02:46:13.751133+0000","last_peered":"2024-08-17T02:46:13.751133+0000","last_clean":"2024-08-17T02:46:13.751133+0000","last_became_active":"2024-08-17T02:46:12.773045+0000","last_became_peered":"2024-08-17T02:46:12.773045+0000","last_unstale":"2024-08-17T02:46:13.751133+0000","last_undegraded":"2024-08-17T02:46:13.751133+0000","last_fullsized":"2024-08-17T02:46:13.751133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783423+0000","last_change":"2024-08-17T02:46:13.782165+0000","last_active":"2024-08-17T02:46:13.783423+0000","last_peered":"2024-08-17T02:46:13.783423+0000","last_clean":"2024-08-17T02:46:13.783423+0000","last_became_active":"2024-08-17T02:46:13.781292+0000","last_became_peered":"2024-08-17T02:46:13.781292+0000","last_unstale":"2024-08-17T02:46:13.783423+0000","last_undegraded":"2024-08-17T02:46:13.783423+0000","last_fullsized":"2024-08-17T02:46:13.783423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:14.050922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756445+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:46:13.756445+0000","last_peered":"2024-08-17T02:46:13.756445+0000","last_clean":"2024-08-17T02:46:13.756445+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:46:13.756445+0000","last_undegraded":"2024-08-17T02:46:13.756445+0000","last_fullsized":"2024-08-17T02:46:13.756445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.747542+0000","last_change":"2024-08-17T02:46:12.761371+0000","last_active":"2024-08-17T02:46:13.747542+0000","last_peered":"2024-08-17T02:46:13.747542+0000","last_clean":"2024-08-17T02:46:13.747542+0000","last_became_active":"2024-08-17T02:46:12.761066+0000","last_became_peered":"2024-08-17T02:46:12.761066+0000","last_unstale":"2024-08-17T02:46:13.747542+0000","last_undegraded":"2024-08-17T02:46:13.747542+0000","last_fullsized":"2024-08-17T02:46:13.747542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.778045+0000","last_change":"2024-08-17T02:46:13.773410+0000","last_active":"2024-08-17T02:46:13.778045+0000","last_peered":"2024-08-17T02:46:13.778045+0000","last_clean":"2024-08-17T02:46:13.778045+0000","last_became_active":"2024-08-17T02:46:13.771934+0000","last_became_peered":"2024-08-17T02:46:13.771934+0000","last_unstale":"2024-08-17T02:46:13.778045+0000","last_undegraded":"2024-08-17T02:46:13.778045+0000","last_fullsized":"2024-08-17T02:46:13.778045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:29.582747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756352+0000","last_change":"2024-08-17T02:46:12.766920+0000","last_active":"2024-08-17T02:46:13.756352+0000","last_peered":"2024-08-17T02:46:13.756352+0000","last_clean":"2024-08-17T02:46:13.756352+0000","last_became_active":"2024-08-17T02:46:12.766386+0000","last_became_peered":"2024-08-17T02:46:12.766386+0000","last_unstale":"2024-08-17T02:46:13.756352+0000","last_undegraded":"2024-08-17T02:46:13.756352+0000","last_fullsized":"2024-08-17T02:46:13.756352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.783602+0000","last_change":"2024-08-17T02:46:13.765726+0000","last_active":"2024-08-17T02:46:13.783602+0000","last_peered":"2024-08-17T02:46:13.783602+0000","last_clean":"2024-08-17T02:46:13.783602+0000","last_became_active":"2024-08-17T02:46:13.765377+0000","last_became_peered":"2024-08-17T02:46:13.765377+0000","last_unstale":"2024-08-17T02:46:13.783602+0000","last_undegraded":"2024-08-17T02:46:13.783602+0000","last_fullsized":"2024-08-17T02:46:13.783602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.750833+0000","last_change":"2024-08-17T02:46:12.754881+0000","last_active":"2024-08-17T02:46:13.750833+0000","last_peered":"2024-08-17T02:46:13.750833+0000","last_clean":"2024-08-17T02:46:13.750833+0000","last_became_active":"2024-08-17T02:46:12.753763+0000","last_became_peered":"2024-08-17T02:46:12.753763+0000","last_unstale":"2024-08-17T02:46:13.750833+0000","last_undegraded":"2024-08-17T02:46:13.750833+0000","last_fullsized":"2024-08-17T02:46:13.750833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:44.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772407+0000","last_change":"2024-08-17T02:46:13.759314+0000","last_active":"2024-08-17T02:46:13.772407+0000","last_peered":"2024-08-17T02:46:13.772407+0000","last_clean":"2024-08-17T02:46:13.772407+0000","last_became_active":"2024-08-17T02:46:13.759005+0000","last_became_peered":"2024-08-17T02:46:13.759005+0000","last_unstale":"2024-08-17T02:46:13.772407+0000","last_undegraded":"2024-08-17T02:46:13.772407+0000","last_fullsized":"2024-08-17T02:46:13.772407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.749580+0000","last_change":"2024-08-17T02:46:12.764920+0000","last_active":"2024-08-17T02:46:13.749580+0000","last_peered":"2024-08-17T02:46:13.749580+0000","last_clean":"2024-08-17T02:46:13.749580+0000","last_became_active":"2024-08-17T02:46:12.764463+0000","last_became_peered":"2024-08-17T02:46:12.764463+0000","last_unstale":"2024-08-17T02:46:13.749580+0000","last_undegraded":"2024-08-17T02:46:13.749580+0000","last_fullsized":"2024-08-17T02:46:13.749580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:54:11.895018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.773750+0000","last_change":"2024-08-17T02:46:13.768129+0000","last_active":"2024-08-17T02:46:13.773750+0000","last_peered":"2024-08-17T02:46:13.773750+0000","last_clean":"2024-08-17T02:46:13.773750+0000","last_became_active":"2024-08-17T02:46:13.767922+0000","last_became_peered":"2024-08-17T02:46:13.767922+0000","last_unstale":"2024-08-17T02:46:13.773750+0000","last_undegraded":"2024-08-17T02:46:13.773750+0000","last_fullsized":"2024-08-17T02:46:13.773750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:28.991722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.752673+0000","last_change":"2024-08-17T02:46:12.768892+0000","last_active":"2024-08-17T02:46:13.752673+0000","last_peered":"2024-08-17T02:46:13.752673+0000","last_clean":"2024-08-17T02:46:13.752673+0000","last_became_active":"2024-08-17T02:46:12.768653+0000","last_became_peered":"2024-08-17T02:46:12.768653+0000","last_unstale":"2024-08-17T02:46:13.752673+0000","last_undegraded":"2024-08-17T02:46:13.752673+0000","last_fullsized":"2024-08-17T02:46:13.752673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.776587+0000","last_change":"2024-08-17T02:46:13.768046+0000","last_active":"2024-08-17T02:46:13.776587+0000","last_peered":"2024-08-17T02:46:13.776587+0000","last_clean":"2024-08-17T02:46:13.776587+0000","last_became_active":"2024-08-17T02:46:13.767445+0000","last_became_peered":"2024-08-17T02:46:13.767445+0000","last_unstale":"2024-08-17T02:46:13.776587+0000","last_undegraded":"2024-08-17T02:46:13.776587+0000","last_fullsized":"2024-08-17T02:46:13.776587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.759052+0000","last_change":"2024-08-17T02:46:12.770898+0000","last_active":"2024-08-17T02:46:13.759052+0000","last_peered":"2024-08-17T02:46:13.759052+0000","last_clean":"2024-08-17T02:46:13.759052+0000","last_became_active":"2024-08-17T02:46:12.770596+0000","last_became_peered":"2024-08-17T02:46:12.770596+0000","last_unstale":"2024-08-17T02:46:13.759052+0000","last_undegraded":"2024-08-17T02:46:13.759052+0000","last_fullsized":"2024-08-17T02:46:13.759052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:27.985897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.775335+0000","last_change":"2024-08-17T02:46:13.764756+0000","last_active":"2024-08-17T02:46:13.775335+0000","last_peered":"2024-08-17T02:46:13.775335+0000","last_clean":"2024-08-17T02:46:13.775335+0000","last_became_active":"2024-08-17T02:46:13.764423+0000","last_became_peered":"2024-08-17T02:46:13.764423+0000","last_unstale":"2024-08-17T02:46:13.775335+0000","last_undegraded":"2024-08-17T02:46:13.775335+0000","last_fullsized":"2024-08-17T02:46:13.775335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:46:14.756598+0000","last_change":"2024-08-17T02:46:12.770698+0000","last_active":"2024-08-17T02:46:14.756598+0000","last_peered":"2024-08-17T02:46:14.756598+0000","last_clean":"2024-08-17T02:46:14.756598+0000","last_became_active":"2024-08-17T02:46:12.770432+0000","last_became_peered":"2024-08-17T02:46:12.770432+0000","last_unstale":"2024-08-17T02:46:14.756598+0000","last_undegraded":"2024-08-17T02:46:14.756598+0000","last_fullsized":"2024-08-17T02:46:14.756598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:55:43.179630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787077+0000","last_change":"2024-08-17T02:46:13.785768+0000","last_active":"2024-08-17T02:46:13.787077+0000","last_peered":"2024-08-17T02:46:13.787077+0000","last_clean":"2024-08-17T02:46:13.787077+0000","last_became_active":"2024-08-17T02:46:13.784611+0000","last_became_peered":"2024-08-17T02:46:13.784611+0000","last_unstale":"2024-08-17T02:46:13.787077+0000","last_undegraded":"2024-08-17T02:46:13.787077+0000","last_fullsized":"2024-08-17T02:46:13.787077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:54.445276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786933+0000","last_change":"2024-08-17T02:46:12.766695+0000","last_active":"2024-08-17T02:46:13.786933+0000","last_peered":"2024-08-17T02:46:13.786933+0000","last_clean":"2024-08-17T02:46:13.786933+0000","last_became_active":"2024-08-17T02:46:12.766389+0000","last_became_peered":"2024-08-17T02:46:12.766389+0000","last_unstale":"2024-08-17T02:46:13.786933+0000","last_undegraded":"2024-08-17T02:46:13.786933+0000","last_fullsized":"2024-08-17T02:46:13.786933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.785500+0000","last_change":"2024-08-17T02:46:13.775750+0000","last_active":"2024-08-17T02:46:13.785500+0000","last_peered":"2024-08-17T02:46:13.785500+0000","last_clean":"2024-08-17T02:46:13.785500+0000","last_became_active":"2024-08-17T02:46:13.775487+0000","last_became_peered":"2024-08-17T02:46:13.775487+0000","last_unstale":"2024-08-17T02:46:13.785500+0000","last_undegraded":"2024-08-17T02:46:13.785500+0000","last_fullsized":"2024-08-17T02:46:13.785500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:11.174649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756242+0000","last_change":"2024-08-17T02:46:12.769354+0000","last_active":"2024-08-17T02:46:13.756242+0000","last_peered":"2024-08-17T02:46:13.756242+0000","last_clean":"2024-08-17T02:46:13.756242+0000","last_became_active":"2024-08-17T02:46:12.769061+0000","last_became_peered":"2024-08-17T02:46:12.769061+0000","last_unstale":"2024-08-17T02:46:13.756242+0000","last_undegraded":"2024-08-17T02:46:13.756242+0000","last_fullsized":"2024-08-17T02:46:13.756242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:16.510354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.760836+0000","last_change":"2024-08-17T02:46:13.758278+0000","last_active":"2024-08-17T02:46:13.760836+0000","last_peered":"2024-08-17T02:46:13.760836+0000","last_clean":"2024-08-17T02:46:13.760836+0000","last_became_active":"2024-08-17T02:46:13.758028+0000","last_became_peered":"2024-08-17T02:46:13.758028+0000","last_unstale":"2024-08-17T02:46:13.760836+0000","last_undegraded":"2024-08-17T02:46:13.760836+0000","last_fullsized":"2024-08-17T02:46:13.760836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:26.668711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.751025+0000","last_change":"2024-08-17T02:46:12.766160+0000","last_active":"2024-08-17T02:46:13.751025+0000","last_peered":"2024-08-17T02:46:13.751025+0000","last_clean":"2024-08-17T02:46:13.751025+0000","last_became_active":"2024-08-17T02:46:12.765813+0000","last_became_peered":"2024-08-17T02:46:12.765813+0000","last_unstale":"2024-08-17T02:46:13.751025+0000","last_undegraded":"2024-08-17T02:46:13.751025+0000","last_fullsized":"2024-08-17T02:46:13.751025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:19.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.767346+0000","last_change":"2024-08-17T02:46:13.765879+0000","last_active":"2024-08-17T02:46:13.767346+0000","last_peered":"2024-08-17T02:46:13.767346+0000","last_clean":"2024-08-17T02:46:13.767346+0000","last_became_active":"2024-08-17T02:46:13.765623+0000","last_became_peered":"2024-08-17T02:46:13.765623+0000","last_unstale":"2024-08-17T02:46:13.767346+0000","last_undegraded":"2024-08-17T02:46:13.767346+0000","last_fullsized":"2024-08-17T02:46:13.767346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:56:20.143925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.756732+0000","last_change":"2024-08-17T02:46:12.761258+0000","last_active":"2024-08-17T02:46:13.756732+0000","last_peered":"2024-08-17T02:46:13.756732+0000","last_clean":"2024-08-17T02:46:13.756732+0000","last_became_active":"2024-08-17T02:46:12.760997+0000","last_became_peered":"2024-08-17T02:46:12.760997+0000","last_unstale":"2024-08-17T02:46:13.756732+0000","last_undegraded":"2024-08-17T02:46:13.756732+0000","last_fullsized":"2024-08-17T02:46:13.756732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:17:28.027857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786999+0000","last_change":"2024-08-17T02:46:13.780356+0000","last_active":"2024-08-17T02:46:13.786999+0000","last_peered":"2024-08-17T02:46:13.786999+0000","last_clean":"2024-08-17T02:46:13.786999+0000","last_became_active":"2024-08-17T02:46:13.779734+0000","last_became_peered":"2024-08-17T02:46:13.779734+0000","last_unstale":"2024-08-17T02:46:13.786999+0000","last_undegraded":"2024-08-17T02:46:13.786999+0000","last_fullsized":"2024-08-17T02:46:13.786999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:54:10.568139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787809+0000","last_change":"2024-08-17T02:46:12.765599+0000","last_active":"2024-08-17T02:46:13.787809+0000","last_peered":"2024-08-17T02:46:13.787809+0000","last_clean":"2024-08-17T02:46:13.787809+0000","last_became_active":"2024-08-17T02:46:12.765154+0000","last_became_peered":"2024-08-17T02:46:12.765154+0000","last_unstale":"2024-08-17T02:46:13.787809+0000","last_undegraded":"2024-08-17T02:46:13.787809+0000","last_fullsized":"2024-08-17T02:46:13.787809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:25.662886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.772892+0000","last_change":"2024-08-17T02:46:13.765726+0000","last_active":"2024-08-17T02:46:13.772892+0000","last_peered":"2024-08-17T02:46:13.772892+0000","last_clean":"2024-08-17T02:46:13.772892+0000","last_became_active":"2024-08-17T02:46:13.765458+0000","last_became_peered":"2024-08-17T02:46:13.765458+0000","last_unstale":"2024-08-17T02:46:13.772892+0000","last_undegraded":"2024-08-17T02:46:13.772892+0000","last_fullsized":"2024-08-17T02:46:13.772892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:42:07.400325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.763706+0000","last_change":"2024-08-17T02:46:13.762591+0000","last_active":"2024-08-17T02:46:13.763706+0000","last_peered":"2024-08-17T02:46:13.763706+0000","last_clean":"2024-08-17T02:46:13.763706+0000","last_became_active":"2024-08-17T02:46:13.762278+0000","last_became_peered":"2024-08-17T02:46:13.762278+0000","last_unstale":"2024-08-17T02:46:13.763706+0000","last_undegraded":"2024-08-17T02:46:13.763706+0000","last_fullsized":"2024-08-17T02:46:13.763706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:08.141784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.788027+0000","last_change":"2024-08-17T02:46:12.775104+0000","last_active":"2024-08-17T02:46:13.788027+0000","last_peered":"2024-08-17T02:46:13.788027+0000","last_clean":"2024-08-17T02:46:13.788027+0000","last_became_active":"2024-08-17T02:46:12.774744+0000","last_became_peered":"2024-08-17T02:46:12.774744+0000","last_unstale":"2024-08-17T02:46:13.788027+0000","last_undegraded":"2024-08-17T02:46:13.788027+0000","last_fullsized":"2024-08-17T02:46:13.788027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:19.761636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764417+0000","last_change":"2024-08-17T02:46:13.763165+0000","last_active":"2024-08-17T02:46:13.764417+0000","last_peered":"2024-08-17T02:46:13.764417+0000","last_clean":"2024-08-17T02:46:13.764417+0000","last_became_active":"2024-08-17T02:46:13.762821+0000","last_became_peered":"2024-08-17T02:46:13.762821+0000","last_unstale":"2024-08-17T02:46:13.764417+0000","last_undegraded":"2024-08-17T02:46:13.764417+0000","last_fullsized":"2024-08-17T02:46:13.764417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:30.671696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.784385+0000","last_change":"2024-08-17T02:46:12.768599+0000","last_active":"2024-08-17T02:46:13.784385+0000","last_peered":"2024-08-17T02:46:13.784385+0000","last_clean":"2024-08-17T02:46:13.784385+0000","last_became_active":"2024-08-17T02:46:12.768318+0000","last_became_peered":"2024-08-17T02:46:12.768318+0000","last_unstale":"2024-08-17T02:46:13.784385+0000","last_undegraded":"2024-08-17T02:46:13.784385+0000","last_fullsized":"2024-08-17T02:46:13.784385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:42.088973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.777974+0000","last_change":"2024-08-17T02:46:13.772324+0000","last_active":"2024-08-17T02:46:13.777974+0000","last_peered":"2024-08-17T02:46:13.777974+0000","last_clean":"2024-08-17T02:46:13.777974+0000","last_became_active":"2024-08-17T02:46:13.771998+0000","last_became_peered":"2024-08-17T02:46:13.771998+0000","last_unstale":"2024-08-17T02:46:13.777974+0000","last_undegraded":"2024-08-17T02:46:13.777974+0000","last_fullsized":"2024-08-17T02:46:13.777974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:15:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.787723+0000","last_change":"2024-08-17T02:46:12.762044+0000","last_active":"2024-08-17T02:46:13.787723+0000","last_peered":"2024-08-17T02:46:13.787723+0000","last_clean":"2024-08-17T02:46:13.787723+0000","last_became_active":"2024-08-17T02:46:12.761769+0000","last_became_peered":"2024-08-17T02:46:12.761769+0000","last_unstale":"2024-08-17T02:46:13.787723+0000","last_undegraded":"2024-08-17T02:46:13.787723+0000","last_fullsized":"2024-08-17T02:46:13.787723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:29.351136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.764812+0000","last_change":"2024-08-17T02:46:13.762933+0000","last_active":"2024-08-17T02:46:13.764812+0000","last_peered":"2024-08-17T02:46:13.764812+0000","last_clean":"2024-08-17T02:46:13.764812+0000","last_became_active":"2024-08-17T02:46:13.762614+0000","last_became_peered":"2024-08-17T02:46:13.762614+0000","last_unstale":"2024-08-17T02:46:13.764812+0000","last_undegraded":"2024-08-17T02:46:13.764812+0000","last_fullsized":"2024-08-17T02:46:13.764812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:12.732229+0000","last_clean_scrub_stamp":"2024-08-17T02:46:12.732229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:40.029684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:46:13.786378+0000","last_change":"2024-08-17T02:46:12.767446+0000","last_active":"2024-08-17T02:46:13.786378+0000","last_peered":"2024-08-17T02:46:13.786378+0000","last_clean":"2024-08-17T02:46:13.786378+0000","last_became_active":"2024-08-17T02:46:12.767136+0000","last_became_peered":"2024-08-17T02:46:12.767136+0000","last_unstale":"2024-08-17T02:46:13.786378+0000","last_undegraded":"2024-08-17T02:46:13.786378+0000","last_fullsized":"2024-08-17T02:46:13.786378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:11.726404+0000","last_clean_scrub_stamp":"2024-08-17T02:46:11.726404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:29:29.351136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.149}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.0810000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9740000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.0499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.845}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2690000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6240000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2789999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.673}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5609999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:46:23.499 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:46:23.499 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:46:23.500 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:46:23.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:46:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.686+0000 7fe3e3e00640 1 Processor -- start 2024-08-17T02:46:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.686+0000 7fe3e3e00640 1 -- start start 2024-08-17T02:46:23.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ad960 0x7fe3dc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e3e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3dc0ca050 0x7fe3dc156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e3e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc15b5e0 con 0x7fe3dc0add30 2024-08-17T02:46:23.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e3e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc0cb160 con 0x7fe3dc0ca050 2024-08-17T02:46:23.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e3e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0b0d10 con 0x7fe3dc0ad960 2024-08-17T02:46:23.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e1400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ad960 0x7fe3dc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e0a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3dc0ca050 0x7fe3dc156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e1400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ad960 0x7fe3dc15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:36428/0 (socket says 172.21.15.2:36428) 2024-08-17T02:46:23.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e1400640 1 -- 172.21.15.2:0/1269211709 learned_addr learned my addr 172.21.15.2:0/1269211709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:23.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e1400640 1 -- 172.21.15.2:0/1269211709 >> v2:172.21.15.26:3300/0 conn(0x7fe3dc0ca050 msgr2=0x7fe3dc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:23.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e1400640 1 --2- 172.21.15.2:0/1269211709 >> v2:172.21.15.26:3300/0 conn(0x7fe3dc0ca050 0x7fe3dc156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e1400640 1 -- 172.21.15.2:0/1269211709 >> v1:172.21.15.26:6789/0 conn(0x7fe3dc0add30 legacy=0x7fe3dc156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.688+0000 7fe3e1400640 1 -- 172.21.15.2:0/1269211709 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0ca550 con 0x7fe3dc0ad960 2024-08-17T02:46:23.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.689+0000 7fe3e1400640 1 --2- 172.21.15.2:0/1269211709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ad960 0x7fe3dc15b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009910 tx=0x7fe3d00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7d1d9fb053843e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3dbe00640 1 -- 172.21.15.2:0/1269211709 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0032440 con 0x7fe3dc0ad960 2024-08-17T02:46:23.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3dbe00640 1 -- 172.21.15.2:0/1269211709 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d00325a0 con 0x7fe3dc0ad960 2024-08-17T02:46:23.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3dbe00640 1 -- 172.21.15.2:0/1269211709 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0032980 con 0x7fe3dc0ad960 2024-08-17T02:46:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1269211709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ad960 msgr2=0x7fe3dc15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1269211709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ad960 0x7fe3dc15b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009910 tx=0x7fe3d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1269211709 shutdown_connections 2024-08-17T02:46:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1269211709 >> v2:172.21.15.26:3300/0 conn(0x7fe3dc0ca050 0x7fe3dc156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1269211709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ad960 0x7fe3dc15b0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1269211709 >> 172.21.15.2:0/1269211709 conn(0x7fe3dc066e60 msgr2=0x7fe3dc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1269211709 shutdown_connections 2024-08-17T02:46:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.690+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1269211709 wait complete. 2024-08-17T02:46:23.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.692+0000 7fe3e3e00640 1 Processor -- start 2024-08-17T02:46:23.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.692+0000 7fe3e3e00640 1 -- start start 2024-08-17T02:46:23.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3dc0ad960 0x7fe3dc1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3dc0add30 0x7fe3dc1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e3e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ca050 0x7fe3dc154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e3e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0a9740 con 0x7fe3dc0ad960 2024-08-17T02:46:23.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e3e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0a88e0 con 0x7fe3dc0add30 2024-08-17T02:46:23.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e3e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc158610 con 0x7fe3dc0ca050 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3dc0ad960 0x7fe3dc1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3dc0ad960 0x7fe3dc1580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37834/0 (socket says 172.21.15.2:37834) 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e1400640 1 -- 172.21.15.2:0/1672936630 learned_addr learned my addr 172.21.15.2:0/1672936630 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e0a00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3dc0add30 0x7fe3dc1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e1e00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ca050 0x7fe3dc154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.693+0000 7fe3e1400640 1 -- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ca050 msgr2=0x7fe3dc154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3e1400640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ca050 0x7fe3dc154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3e1400640 1 -- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3dc0add30 msgr2=0x7fe3dc1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3e1400640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3dc0add30 0x7fe3dc1503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3e1400640 1 -- 172.21.15.2:0/1672936630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0009450 con 0x7fe3dc0ad960 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3e1e00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ca050 0x7fe3dc154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3e1400640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3dc0ad960 0x7fe3dc1580d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0035040 tx=0x7fe3d0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3d8c00640 1 -- 172.21.15.2:0/1672936630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0031a60 con 0x7fe3dc0ad960 2024-08-17T02:46:23.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3d8c00640 1 -- 172.21.15.2:0/1672936630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d0031c20 con 0x7fe3dc0ad960 2024-08-17T02:46:23.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3d8c00640 1 -- 172.21.15.2:0/1672936630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d003d420 con 0x7fe3dc0ad960 2024-08-17T02:46:23.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc0a8b30 con 0x7fe3dc0ad960 2024-08-17T02:46:23.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.694+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc0a90f0 con 0x7fe3dc0ad960 2024-08-17T02:46:23.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.695+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc063fb0 con 0x7fe3dc0ad960 2024-08-17T02:46:23.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.696+0000 7fe3d8c00640 1 -- 172.21.15.2:0/1672936630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3d0039040 con 0x7fe3dc0ad960 2024-08-17T02:46:23.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.697+0000 7fe3d8c00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3bc065180 0x7fe3bc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:23.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.697+0000 7fe3d8c00640 1 -- 172.21.15.2:0/1672936630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3d00a2130 con 0x7fe3dc0ad960 2024-08-17T02:46:23.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.697+0000 7fe3e0a00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3bc065180 0x7fe3bc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.698+0000 7fe3e0a00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3bc065180 0x7fe3bc067630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc155690 tx=0x7fe3c80090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:23.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.701+0000 7fe3d8c00640 1 -- 172.21.15.2:0/1672936630 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe3d0070200 con 0x7fe3dc0ad960 2024-08-17T02:46:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.922+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe3dc15a970 con 0x7fe3dc0ad960 2024-08-17T02:46:23.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.922+0000 7fe3d8c00640 1 -- 172.21.15.2:0/1672936630 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe3d0073820 con 0x7fe3dc0ad960 2024-08-17T02:46:23.924 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:23.924 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:46:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3bc065180 msgr2=0x7fe3bc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3bc065180 0x7fe3bc067630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc155690 tx=0x7fe3c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3dc0ad960 msgr2=0x7fe3dc1580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:23.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3dc0ad960 0x7fe3dc1580d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0035040 tx=0x7fe3d0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 shutdown_connections 2024-08-17T02:46:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3bc065180 0x7fe3bc067630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe3dc0ca050 0x7fe3dc154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3dc0add30 0x7fe3dc1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 --2- 172.21.15.2:0/1672936630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3dc0ad960 0x7fe3dc1580d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 >> 172.21.15.2:0/1672936630 conn(0x7fe3dc066e60 msgr2=0x7fe3dc153110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 shutdown_connections 2024-08-17T02:46:23.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:23.925+0000 7fe3e3e00640 1 -- 172.21.15.2:0/1672936630 wait complete. 2024-08-17T02:46:23.941 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:46:23.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:24.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.092+0000 7f7802a00640 1 Processor -- start 2024-08-17T02:46:24.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.092+0000 7f7802a00640 1 -- start start 2024-08-17T02:46:24.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7802a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc158bf0 0x7f77fc0a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7802a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77fc0aa880 0x7f77fc15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7802a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc0a88e0 con 0x7f77fc0aa430 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7802a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc0a9180 con 0x7f77fc0aa880 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7802a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc15a0e0 con 0x7f77fc158bf0 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f77f3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f77fc0aa430 0x7f77fc15a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56554/0 (socket says 172.21.15.2:56554) 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f77f3e00640 1 -- 172.21.15.2:0/458952815 learned_addr learned my addr 172.21.15.2:0/458952815 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7800a00640 1 --2- 172.21.15.2:0/458952815 >> v2:172.21.15.2:3300/0 conn(0x7f77fc0aa880 0x7f77fc15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f77fbe00640 1 --2- 172.21.15.2:0/458952815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc158bf0 0x7f77fc0a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f77fb400640 1 -- 172.21.15.2:0/458952815 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081249828 0 0) 0x7f77fc0a88e0 con 0x7f77fc0aa430 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f77fb400640 1 -- 172.21.15.2:0/458952815 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e00034e0 con 0x7f77fc0aa430 2024-08-17T02:46:24.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7800a00640 1 -- 172.21.15.2:0/458952815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc158bf0 msgr2=0x7f77fc0a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7800a00640 1 --2- 172.21.15.2:0/458952815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc158bf0 0x7f77fc0a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7800a00640 1 -- 172.21.15.2:0/458952815 >> v1:172.21.15.2:6789/0 conn(0x7f77fc0aa430 legacy=0x7f77fc15a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.094+0000 7f7800a00640 1 -- 172.21.15.2:0/458952815 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0a8b30 con 0x7f77fc0aa880 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.095+0000 7f7800a00640 1 --2- 172.21.15.2:0/458952815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc0aa880 0x7f77fc15abe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009e60 tx=0x7f77f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55512dfb34005b50 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f77fb400640 1 -- 172.21.15.2:0/458952815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4007550 con 0x7f77fc0aa880 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f77fb400640 1 -- 172.21.15.2:0/458952815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f402d050 con 0x7f77fc0aa880 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f77fb400640 1 -- 172.21.15.2:0/458952815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4007920 con 0x7f77fc0aa880 2024-08-17T02:46:24.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f7802a00640 1 -- 172.21.15.2:0/458952815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc0aa880 msgr2=0x7f77fc15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f7802a00640 1 --2- 172.21.15.2:0/458952815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc0aa880 0x7f77fc15abe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009e60 tx=0x7f77f4009780 comp rx=0 tx=0).stop 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f7802a00640 1 -- 172.21.15.2:0/458952815 shutdown_connections 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f7802a00640 1 --2- 172.21.15.2:0/458952815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc0aa880 0x7f77fc15abe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f7802a00640 1 --2- 172.21.15.2:0/458952815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc158bf0 0x7f77fc0a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f7802a00640 1 -- 172.21.15.2:0/458952815 >> 172.21.15.2:0/458952815 conn(0x7f77fc066e60 msgr2=0x7f77fc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f7802a00640 1 -- 172.21.15.2:0/458952815 shutdown_connections 2024-08-17T02:46:24.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.096+0000 7f7802a00640 1 -- 172.21.15.2:0/458952815 wait complete. 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.098+0000 7f7802a00640 1 Processor -- start 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.098+0000 7f7802a00640 1 -- start start 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7802a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc0aa430 0x7f77fc0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7802a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77fc0aa880 0x7f77fc0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7802a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc158bf0 0x7f77fc14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7802a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0ae0b0 con 0x7f77fc158bf0 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7802a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0ad4a0 con 0x7f77fc0aa880 2024-08-17T02:46:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7802a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0ad780 con 0x7f77fc0aa430 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7800a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc158bf0 0x7f77fc14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7800a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc158bf0 0x7f77fc14b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37844/0 (socket says 172.21.15.2:37844) 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f7800a00640 1 -- 172.21.15.2:0/1777092748 learned_addr learned my addr 172.21.15.2:0/1777092748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f77fbe00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc0aa430 0x7f77fc0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.099+0000 7f77f3e00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77fc0aa880 0x7f77fc0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f7800a00640 1 -- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc0aa430 msgr2=0x7f77fc0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f7800a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc0aa430 0x7f77fc0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f7800a00640 1 -- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77fc0aa880 msgr2=0x7f77fc0acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f7800a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77fc0aa880 0x7f77fc0acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f7800a00640 1 -- 172.21.15.2:0/1777092748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4009a20 con 0x7f77fc158bf0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f77f3e00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77fc0aa880 0x7f77fc0acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f7800a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc158bf0 0x7f77fc14b1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77f40099f0 tx=0x7f77f4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f77f3400640 1 -- 172.21.15.2:0/1777092748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40079d0 con 0x7f77fc158bf0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f77f3400640 1 -- 172.21.15.2:0/1777092748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4040070 con 0x7f77fc158bf0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f77f3400640 1 -- 172.21.15.2:0/1777092748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4031ae0 con 0x7f77fc158bf0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc0ada60 con 0x7f77fc158bf0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.100+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc0ad1b0 con 0x7f77fc158bf0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.101+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc06aba0 con 0x7f77fc158bf0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.102+0000 7f77f3400640 1 -- 172.21.15.2:0/1777092748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f77f4042030 con 0x7f77fc158bf0 2024-08-17T02:46:24.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.103+0000 7f77f3400640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f77d8065150 0x7f77d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.103+0000 7f77f3400640 1 -- 172.21.15.2:0/1777092748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77f40a3bb0 con 0x7f77fc158bf0 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.103+0000 7f77fbe00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f77d8065150 0x7f77d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.104+0000 7f77fbe00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f77d8065150 0x7f77d8067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009c80 tx=0x7f77ec0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.107+0000 7f77f3400640 1 -- 172.21.15.2:0/1777092748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f77fc06aba0 con 0x7f77fc158bf0 2024-08-17T02:46:24.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.289+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77fc06aba0 con 0x7f77fc158bf0 2024-08-17T02:46:24.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.290+0000 7f77f3400640 1 -- 172.21.15.2:0/1777092748 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f77fc06aba0 con 0x7f77fc158bf0 2024-08-17T02:46:24.291 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:24.291 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.291+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f77d8065150 msgr2=0x7f77d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.291+0000 7f7802a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f77d8065150 0x7f77d8067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009c80 tx=0x7f77ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.291+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc158bf0 msgr2=0x7f77fc14b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.291+0000 7f7802a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc158bf0 0x7f77fc14b1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77f40099f0 tx=0x7f77f4037000 comp rx=0 tx=0).stop 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.292+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 shutdown_connections 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.292+0000 7f7802a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77fc158bf0 0x7f77fc14b1c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.292+0000 7f7802a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77fc0aa880 0x7f77fc0acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.292+0000 7f7802a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f77d8065150 0x7f77d8067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.292+0000 7f7802a00640 1 --2- 172.21.15.2:0/1777092748 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77fc0aa430 0x7f77fc0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.292+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 >> 172.21.15.2:0/1777092748 conn(0x7f77fc066e60 msgr2=0x7f77fc156940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.292+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 shutdown_connections 2024-08-17T02:46:24.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.292+0000 7f7802a00640 1 -- 172.21.15.2:0/1777092748 wait complete. 2024-08-17T02:46:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:10.965028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:12.163837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:24.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.460+0000 7ff7f1c00640 1 Processor -- start 2024-08-17T02:46:24.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.461+0000 7ff7f1c00640 1 -- start start 2024-08-17T02:46:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7f1c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7f1c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7ec0ae6c0 0x7ff7ec0aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7f1c00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ec159640 con 0x7ff7ec06d900 2024-08-17T02:46:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7f1c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ec156e50 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7f1c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec1565b0 con 0x7ff7ec06dcd0 2024-08-17T02:46:24.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7f1200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7ec0ae6c0 0x7ff7ec0aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7eb400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7f1200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7ec0ae6c0 0x7ff7ec0aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:52266/0 (socket says 172.21.15.2:52266) 2024-08-17T02:46:24.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7f1200640 1 -- 172.21.15.2:0/210627607 learned_addr learned my addr 172.21.15.2:0/210627607 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:24.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.462+0000 7ff7ebe00640 1 --1- 172.21.15.2:0/210627607 >> v1:172.21.15.26:6789/0 conn(0x7ff7ec06d900 0x7ff7ec155db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:57364/0 (socket says 172.21.15.2:57364) 2024-08-17T02:46:24.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.463+0000 7ff7eb400640 1 -- 172.21.15.2:0/210627607 >> v2:172.21.15.26:3300/0 conn(0x7ff7ec0ae6c0 msgr2=0x7ff7ec0aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.463+0000 7ff7eb400640 1 --2- 172.21.15.2:0/210627607 >> v2:172.21.15.26:3300/0 conn(0x7ff7ec0ae6c0 0x7ff7ec0aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.463+0000 7ff7eb400640 1 -- 172.21.15.2:0/210627607 >> v1:172.21.15.26:6789/0 conn(0x7ff7ec06d900 legacy=0x7ff7ec155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.463+0000 7ff7eb400640 1 -- 172.21.15.2:0/210627607 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec156890 con 0x7ff7ec06dcd0 2024-08-17T02:46:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.464+0000 7ff7eb400640 1 --2- 172.21.15.2:0/210627607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec0ade50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009850 tx=0x7ff7d80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b37772d2005cdc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.464+0000 7ff7eaa00640 1 -- 172.21.15.2:0/210627607 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d802ad80 con 0x7ff7ec06dcd0 2024-08-17T02:46:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.464+0000 7ff7eaa00640 1 -- 172.21.15.2:0/210627607 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d8032440 con 0x7ff7ec06dcd0 2024-08-17T02:46:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.464+0000 7ff7eaa00640 1 -- 172.21.15.2:0/210627607 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8032820 con 0x7ff7ec06dcd0 2024-08-17T02:46:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.465+0000 7ff7f1c00640 1 -- 172.21.15.2:0/210627607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 msgr2=0x7ff7ec0ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.465+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/210627607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec0ade50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009850 tx=0x7ff7d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.465+0000 7ff7f1c00640 1 -- 172.21.15.2:0/210627607 shutdown_connections 2024-08-17T02:46:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.465+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/210627607 >> v2:172.21.15.26:3300/0 conn(0x7ff7ec0ae6c0 0x7ff7ec0aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.465+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/210627607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec0ade50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.465+0000 7ff7f1c00640 1 -- 172.21.15.2:0/210627607 >> 172.21.15.2:0/210627607 conn(0x7ff7ec0cb770 msgr2=0x7ff7ec0cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.465+0000 7ff7f1c00640 1 -- 172.21.15.2:0/210627607 shutdown_connections 2024-08-17T02:46:24.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.465+0000 7ff7f1c00640 1 -- 172.21.15.2:0/210627607 wait complete. 2024-08-17T02:46:24.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.466+0000 7ff7f1c00640 1 Processor -- start 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.466+0000 7ff7f1c00640 1 -- start start 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7ec06d900 0x7ff7ec142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ec0ae6c0 0x7ff7ec14cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec14e210 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec14e7d0 con 0x7ff7ec06d900 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec143900 con 0x7ff7ec06dcd0 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ec0ae6c0 0x7ff7ec14cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ec0ae6c0 0x7ff7ec14cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37846/0 (socket says 172.21.15.2:37846) 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.467+0000 7ff7f1200640 1 -- 172.21.15.2:0/1815449940 learned_addr learned my addr 172.21.15.2:0/1815449940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7ebe00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7ec06d900 0x7ff7ec142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7eb400640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7f1200640 1 -- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 msgr2=0x7ff7ec140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7f1200640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7f1200640 1 -- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7ec06d900 msgr2=0x7ff7ec142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7f1200640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7ec06d900 0x7ff7ec142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7f1200640 1 -- 172.21.15.2:0/1815449940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8009390 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7ebe00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7ec06d900 0x7ff7ec142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7f1200640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ec0ae6c0 0x7ff7ec14cf10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009e80 tx=0x7ff7e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7e3400640 1 -- 172.21.15.2:0/1815449940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4009320 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7e3400640 1 -- 172.21.15.2:0/1815449940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e400f040 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7e3400640 1 -- 172.21.15.2:0/1815449940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400cd60 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.468+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ec143be0 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.469+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ec1434f0 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.470+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ec070720 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.470+0000 7ff7e3400640 1 -- 172.21.15.2:0/1815449940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff7e4014650 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.471+0000 7ff7e3400640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff7cc065150 0x7ff7cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.471+0000 7ff7e3400640 1 -- 172.21.15.2:0/1815449940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7e4082cd0 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.471+0000 7ff7ebe00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff7cc065150 0x7ff7cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.472+0000 7ff7ebe00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff7cc065150 0x7ff7cc067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0057b0 tx=0x7ff7dc007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.475+0000 7ff7e3400640 1 -- 172.21.15.2:0/1815449940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff7e4050cf0 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.654+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7ec0ad700 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.654+0000 7ff7e3400640 1 -- 172.21.15.2:0/1815449940 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7e4054310 con 0x7ff7ec0ae6c0 2024-08-17T02:46:24.655 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:24.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff7cc065150 msgr2=0x7ff7cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff7cc065150 0x7ff7cc067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0057b0 tx=0x7ff7dc007d80 comp rx=0 tx=0).stop 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ec0ae6c0 msgr2=0x7ff7ec14cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ec0ae6c0 0x7ff7ec14cf10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009e80 tx=0x7ff7e400b040 comp rx=0 tx=0).stop 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 shutdown_connections 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ec0ae6c0 0x7ff7ec14cf10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff7cc065150 0x7ff7cc067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff7ec06dcd0 0x7ff7ec140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 --2- 172.21.15.2:0/1815449940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7ec06d900 0x7ff7ec142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 >> 172.21.15.2:0/1815449940 conn(0x7ff7ec0cb770 msgr2=0x7ff7ec0698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 shutdown_connections 2024-08-17T02:46:24.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.656+0000 7ff7f1c00640 1 -- 172.21.15.2:0/1815449940 wait complete. 2024-08-17T02:46:24.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:24.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.824+0000 7f0c06c00640 1 Processor -- start 2024-08-17T02:46:24.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.824+0000 7f0c06c00640 1 -- start start 2024-08-17T02:46:24.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0c06c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c001590b0 0x7f0c000b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0c06c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c000c92b0 con 0x7f0c000afca0 2024-08-17T02:46:24.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0c06c00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c000ad480 con 0x7f0c000acf10 2024-08-17T02:46:24.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0c06c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000b0980 con 0x7f0c001590b0 2024-08-17T02:46:24.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0bffe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0c000afca0 0x7f0c001589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56558/0 (socket says 172.21.15.2:56558) 2024-08-17T02:46:24.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0bffe00640 1 -- 172.21.15.2:0/3020253551 learned_addr learned my addr 172.21.15.2:0/3020253551 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0bff400640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c001590b0 0x7f0c000b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226208016 0 0) 0x7f0c000c92b0 con 0x7f0c000afca0 2024-08-17T02:46:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.826+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0be40034e0 con 0x7f0c000afca0 2024-08-17T02:46:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1892447157 0 0) 0x7f0be40034e0 con 0x7f0c000afca0 2024-08-17T02:46:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c001590b0 msgr2=0x7f0c000b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c001590b0 0x7f0c000b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 >> v1:172.21.15.26:6789/0 conn(0x7f0c000acf10 legacy=0x7f0c000c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c000ad760 con 0x7f0c000afca0 2024-08-17T02:46:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f0bf0001470 con 0x7f0c000afca0 2024-08-17T02:46:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 >> v1:172.21.15.2:6789/0 conn(0x7f0c000afca0 legacy=0x7f0c001589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0be4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c001590b0 0x7f0be4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0be4004cc0 0x7f0be4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be400dd70 con 0x7f0be4004cc0 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be400deb0 con 0x7f0be4003a00 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be400e070 con 0x7f0c001590b0 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bffe00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0be4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0c04c00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0be4004cc0 0x7f0be4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bff400640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c001590b0 0x7f0be4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bffe00640 1 -- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c001590b0 msgr2=0x7f0be4004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bffe00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c001590b0 0x7f0be4004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bffe00640 1 -- 172.21.15.2:0/3020253551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0be4004cc0 msgr2=0x7f0be4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bffe00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0be4004cc0 0x7f0be4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.827+0000 7f0bffe00640 1 -- 172.21.15.2:0/3020253551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40034e0 con 0x7f0be4003a00 2024-08-17T02:46:24.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.828+0000 7f0bffe00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0be4003e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c160 tx=0x7f0c000683f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1fdb360c62340ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.829+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0005890 con 0x7f0be4003a00 2024-08-17T02:46:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.829+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf002d070 con 0x7f0be4003a00 2024-08-17T02:46:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.829+0000 7f0bfea00640 1 -- 172.21.15.2:0/3020253551 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0005a70 con 0x7f0be4003a00 2024-08-17T02:46:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.829+0000 7f0c06c00640 1 -- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 msgr2=0x7f0be4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.829+0000 7f0c06c00640 1 --2- 172.21.15.2:0/3020253551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0be4003e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c160 tx=0x7f0c000683f0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.829+0000 7f0c04c00640 1 -- 172.21.15.2:0/3020253551 reap_dead start 2024-08-17T02:46:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.829+0000 7f0c06c00640 1 -- 172.21.15.2:0/3020253551 shutdown_connections 2024-08-17T02:46:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.829+0000 7f0c06c00640 1 -- 172.21.15.2:0/3020253551 >> 172.21.15.2:0/3020253551 conn(0x7f0c00066e60 msgr2=0x7f0c00067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.830+0000 7f0c06c00640 1 -- 172.21.15.2:0/3020253551 shutdown_connections 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.830+0000 7f0c06c00640 1 -- 172.21.15.2:0/3020253551 wait complete. 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.831+0000 7f0c06c00640 1 Processor -- start 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.831+0000 7f0c06c00640 1 -- start start 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c06c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0c001519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c06c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c000c37c0 0x7f0c000aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c06c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c0015aa20 0x7f0c0015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c06c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00151f00 con 0x7f0c0015aa20 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c06c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0015b3e0 con 0x7f0be4003a00 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c06c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000c4860 con 0x7f0c000c37c0 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c04c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c0015aa20 0x7f0c0015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c04c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c0015aa20 0x7f0c0015aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37866/0 (socket says 172.21.15.2:37866) 2024-08-17T02:46:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c04c00640 1 -- 172.21.15.2:0/4252911600 learned_addr learned my addr 172.21.15.2:0/4252911600 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0bffe00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0c001519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0bff400640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c000c37c0 0x7f0c000aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c04c00640 1 -- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c000c37c0 msgr2=0x7f0c000aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c04c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c000c37c0 0x7f0c000aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c04c00640 1 -- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 msgr2=0x7f0c001519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c04c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0c001519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0c04c00640 1 -- 172.21.15.2:0/4252911600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c000c3c50 con 0x7f0c0015aa20 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0bffe00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0c001519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.832+0000 7f0bff400640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c000c37c0 0x7f0c000aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.833+0000 7f0c04c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c0015aa20 0x7f0c0015aea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0be4004700 tx=0x7f0bf8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.833+0000 7f0bf7400640 1 -- 172.21.15.2:0/4252911600 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8017070 con 0x7f0c0015aa20 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.833+0000 7f0bf7400640 1 -- 172.21.15.2:0/4252911600 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf8006b10 con 0x7f0c0015aa20 2024-08-17T02:46:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.833+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c000c3f30 con 0x7f0c0015aa20 2024-08-17T02:46:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.833+0000 7f0bf7400640 1 -- 172.21.15.2:0/4252911600 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8007020 con 0x7f0c0015aa20 2024-08-17T02:46:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.833+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c000c44f0 con 0x7f0c0015aa20 2024-08-17T02:46:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.834+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c000c4a10 con 0x7f0c0015aa20 2024-08-17T02:46:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.835+0000 7f0bf7400640 1 -- 172.21.15.2:0/4252911600 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0bf80073d0 con 0x7f0c0015aa20 2024-08-17T02:46:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.836+0000 7f0bf7400640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0be0065150 0x7f0be0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.836+0000 7f0bf7400640 1 -- 172.21.15.2:0/4252911600 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bf8081350 con 0x7f0c0015aa20 2024-08-17T02:46:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.836+0000 7f0bffe00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0be0065150 0x7f0be0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:24.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.837+0000 7f0bffe00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0be0065150 0x7f0be0067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0032000 tx=0x7f0bf0033000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:24.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:24.840+0000 7f0bf7400640 1 -- 172.21.15.2:0/4252911600 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0bf804ce40 con 0x7f0c0015aa20 2024-08-17T02:46:25.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.023+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c00063fb0 con 0x7f0c0015aa20 2024-08-17T02:46:25.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.024+0000 7f0bf7400640 1 -- 172.21.15.2:0/4252911600 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c000c4a10 con 0x7f0c0015aa20 2024-08-17T02:46:25.025 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:46:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0be0065150 msgr2=0x7f0be0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0be0065150 0x7f0be0067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0032000 tx=0x7f0bf0033000 comp rx=0 tx=0).stop 2024-08-17T02:46:25.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c0015aa20 msgr2=0x7f0c0015aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c0015aa20 0x7f0c0015aea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0be4004700 tx=0x7f0bf8007f90 comp rx=0 tx=0).stop 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 shutdown_connections 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c0015aa20 0x7f0c0015aea0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0be0065150 0x7f0be0067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f0c000c37c0 0x7f0c000aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 --2- 172.21.15.2:0/4252911600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be4003a00 0x7f0c001519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 >> 172.21.15.2:0/4252911600 conn(0x7f0c00066e60 msgr2=0x7f0c0006ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 shutdown_connections 2024-08-17T02:46:25.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.026+0000 7f0c06c00640 1 -- 172.21.15.2:0/4252911600 wait complete. 2024-08-17T02:46:25.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:25.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.196+0000 7f811f600640 1 Processor -- start 2024-08-17T02:46:25.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.196+0000 7f811f600640 1 -- start start 2024-08-17T02:46:25.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f811f600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f81180b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f811f600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81180acf10 0x7f8118159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f811f600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81181589a0 0x7f8118158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f811f600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81180b0980 con 0x7f81180acf10 2024-08-17T02:46:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f811f600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811815a4e0 con 0x7f81181589a0 2024-08-17T02:46:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f811f600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81180c92b0 con 0x7f81180afca0 2024-08-17T02:46:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f8117e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81180acf10 0x7f8118159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f8117e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81180acf10 0x7f8118159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37878/0 (socket says 172.21.15.2:37878) 2024-08-17T02:46:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.197+0000 7f8117e00640 1 -- 172.21.15.2:0/1070503072 learned_addr learned my addr 172.21.15.2:0/1070503072 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.198+0000 7f811cc00640 1 --2- 172.21.15.2:0/1070503072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f81180b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.198+0000 7f811d600640 1 --2- 172.21.15.2:0/1070503072 >> v2:172.21.15.26:3300/0 conn(0x7f81181589a0 0x7f8118158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.198+0000 7f8117e00640 1 -- 172.21.15.2:0/1070503072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 msgr2=0x7f81180b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.198+0000 7f8117e00640 1 --2- 172.21.15.2:0/1070503072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f81180b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.198+0000 7f8117e00640 1 -- 172.21.15.2:0/1070503072 >> v2:172.21.15.26:3300/0 conn(0x7f81181589a0 msgr2=0x7f8118158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.198+0000 7f8117e00640 1 --2- 172.21.15.2:0/1070503072 >> v2:172.21.15.26:3300/0 conn(0x7f81181589a0 0x7f8118158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.198+0000 7f8117e00640 1 -- 172.21.15.2:0/1070503072 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118159360 con 0x7f81180acf10 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.198+0000 7f811d600640 1 --2- 172.21.15.2:0/1070503072 >> v2:172.21.15.26:3300/0 conn(0x7f81181589a0 0x7f8118158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.199+0000 7f8117e00640 1 --2- 172.21.15.2:0/1070503072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81180acf10 0x7f8118159fa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8104009940 tx=0x7f81040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a21d239fc641b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.199+0000 7f8117400640 1 -- 172.21.15.2:0/1070503072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810402ade0 con 0x7f81180acf10 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.199+0000 7f8117400640 1 -- 172.21.15.2:0/1070503072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104032440 con 0x7f81180acf10 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.199+0000 7f8117400640 1 -- 172.21.15.2:0/1070503072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040327e0 con 0x7f81180acf10 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 -- 172.21.15.2:0/1070503072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81180acf10 msgr2=0x7f8118159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 --2- 172.21.15.2:0/1070503072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81180acf10 0x7f8118159fa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8104009940 tx=0x7f81040091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 -- 172.21.15.2:0/1070503072 shutdown_connections 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 --2- 172.21.15.2:0/1070503072 >> v2:172.21.15.26:3300/0 conn(0x7f81181589a0 0x7f8118158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 --2- 172.21.15.2:0/1070503072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81180acf10 0x7f8118159fa0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 --2- 172.21.15.2:0/1070503072 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f81180b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 -- 172.21.15.2:0/1070503072 >> 172.21.15.2:0/1070503072 conn(0x7f8118066e60 msgr2=0x7f8118067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 -- 172.21.15.2:0/1070503072 shutdown_connections 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.200+0000 7f811f600640 1 -- 172.21.15.2:0/1070503072 wait complete. 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.201+0000 7f811f600640 1 Processor -- start 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.201+0000 7f811f600640 1 -- start start 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811f600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81180acf10 0x7f81181453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811f600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f811814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811f600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81181589a0 0x7f81181461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811f600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81180c3880 con 0x7f81181589a0 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811f600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81180c1700 con 0x7f81180acf10 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811f600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81180c0af0 con 0x7f81180afca0 2024-08-17T02:46:25.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811d600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81181589a0 0x7f81181461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811d600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81181589a0 0x7f81181461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37892/0 (socket says 172.21.15.2:37892) 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.202+0000 7f811d600640 1 -- 172.21.15.2:0/682200393 learned_addr learned my addr 172.21.15.2:0/682200393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811cc00640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81180acf10 0x7f81181453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f8117e00640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f811814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811d600640 1 -- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 msgr2=0x7f811814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811d600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f811814c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811d600640 1 -- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81180acf10 msgr2=0x7f81181453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811d600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81180acf10 0x7f81181453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811d600640 1 -- 172.21.15.2:0/682200393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104009450 con 0x7f81181589a0 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f8117e00640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f811814c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811cc00640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81180acf10 0x7f81181453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811d600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81181589a0 0x7f81181461e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f811000a380 tx=0x7f8110007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f810be00640 1 -- 172.21.15.2:0/682200393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000d650 con 0x7f81181589a0 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f810be00640 1 -- 172.21.15.2:0/682200393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811000d7b0 con 0x7f81181589a0 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81180c0dd0 con 0x7f81181589a0 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f810be00640 1 -- 172.21.15.2:0/682200393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000db70 con 0x7f81181589a0 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.203+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81180c1410 con 0x7f81181589a0 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.205+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81180c08a0 con 0x7f81181589a0 2024-08-17T02:46:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.205+0000 7f810be00640 1 -- 172.21.15.2:0/682200393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f811001e3b0 con 0x7f81181589a0 2024-08-17T02:46:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.206+0000 7f810be00640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f80f8065180 0x7f80f8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.207+0000 7f810be00640 1 -- 172.21.15.2:0/682200393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8110082e80 con 0x7f81181589a0 2024-08-17T02:46:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.207+0000 7f811cc00640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f80f8065180 0x7f80f8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.207+0000 7f811cc00640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f80f8065180 0x7f80f8067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.210+0000 7f810be00640 1 -- 172.21.15.2:0/682200393 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8110050f20 con 0x7f81181589a0 2024-08-17T02:46:25.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.390+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8118063fb0 con 0x7f81181589a0 2024-08-17T02:46:25.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.391+0000 7f810be00640 1 -- 172.21.15.2:0/682200393 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f811001a0a0 con 0x7f81181589a0 2024-08-17T02:46:25.392 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:46:25.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f80f8065180 msgr2=0x7f80f8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f80f8065180 0x7f80f8067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:25.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81181589a0 msgr2=0x7f81181461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81181589a0 0x7f81181461e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f811000a380 tx=0x7f8110007900 comp rx=0 tx=0).stop 2024-08-17T02:46:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 shutdown_connections 2024-08-17T02:46:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81181589a0 0x7f81181461e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f80f8065180 0x7f80f8067630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f81180afca0 0x7f811814c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 --2- 172.21.15.2:0/682200393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81180acf10 0x7f81181453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 >> 172.21.15.2:0/682200393 conn(0x7f8118066e60 msgr2=0x7f81180ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 shutdown_connections 2024-08-17T02:46:25.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.393+0000 7f811f600640 1 -- 172.21.15.2:0/682200393 wait complete. 2024-08-17T02:46:25.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.558+0000 7ff4c2000640 1 Processor -- start 2024-08-17T02:46:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.558+0000 7ff4c2000640 1 -- start start 2024-08-17T02:46:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.559+0000 7ff4c2000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4bc0ad960 0x7ff4bc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4c2000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc15b5e0 con 0x7ff4bc0ca050 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4c2000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc0cb160 con 0x7ff4bc0add30 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4c2000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b0d10 con 0x7ff4bc0ad960 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4b3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff4bc0ca050 0x7ff4bc156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56560/0 (socket says 172.21.15.2:56560) 2024-08-17T02:46:25.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4b3e00640 1 -- 172.21.15.2:0/1772251389 learned_addr learned my addr 172.21.15.2:0/1772251389 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4bb400640 1 --2- 172.21.15.2:0/1772251389 >> v2:172.21.15.26:3300/0 conn(0x7ff4bc0ad960 0x7ff4bc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877468417 0 0) 0x7ff4a4001110 con 0x7ff4bc0ca050 2024-08-17T02:46:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a00034e0 con 0x7ff4bc0ca050 2024-08-17T02:46:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771751412 0 0) 0x7ff4bc0cb160 con 0x7ff4bc0add30 2024-08-17T02:46:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.560+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a4001110 con 0x7ff4bc0add30 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755854336 0 0) 0x7ff4a00034e0 con 0x7ff4bc0ca050 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 >> v2:172.21.15.26:3300/0 conn(0x7ff4bc0ad960 msgr2=0x7ff4bc15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 --2- 172.21.15.2:0/1772251389 >> v2:172.21.15.26:3300/0 conn(0x7ff4bc0ad960 0x7ff4bc15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 >> v1:172.21.15.26:6789/0 conn(0x7ff4bc0add30 legacy=0x7ff4bc0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0ca550 con 0x7ff4bc0ca050 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7ff4a4001600 con 0x7ff4bc0ca050 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 >> v1:172.21.15.2:6789/0 conn(0x7ff4bc0ca050 legacy=0x7ff4bc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4a0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a0004780 0x7ff4a0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4a0005130 0x7ff4a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b0d10 con 0x7ff4a0003b60 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a000c020 con 0x7ff4a0004780 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a000c1e0 con 0x7ff4a0005130 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4bb400640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4a0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4b3e00640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a0004780 0x7ff4a0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4bbe00640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4a0005130 0x7ff4a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4bb400640 1 -- 172.21.15.2:0/1772251389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4a0005130 msgr2=0x7ff4a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4bb400640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4a0005130 0x7ff4a000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4bb400640 1 -- 172.21.15.2:0/1772251389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a0004780 msgr2=0x7ff4a0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4bb400640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a0004780 0x7ff4a0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4bb400640 1 -- 172.21.15.2:0/1772251389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a00034e0 con 0x7ff4a0003b60 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.561+0000 7ff4bbe00640 1 -- 172.21.15.2:0/1772251389 reap_dead start 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.562+0000 7ff4bb400640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4a0003f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009b70 tx=0x7ff4ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22c8e690dc44d6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac031400 con 0x7ff4a0003b60 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac02d050 con 0x7ff4a0003b60 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4baa00640 1 -- 172.21.15.2:0/1772251389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac031790 con 0x7ff4a0003b60 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4c2000640 1 -- 172.21.15.2:0/1772251389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 msgr2=0x7ff4a0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4c2000640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4a0003f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009b70 tx=0x7ff4ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4c2000640 1 -- 172.21.15.2:0/1772251389 shutdown_connections 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4c2000640 1 --2- 172.21.15.2:0/1772251389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4a0003f50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4c2000640 1 -- 172.21.15.2:0/1772251389 >> 172.21.15.2:0/1772251389 conn(0x7ff4bc066e60 msgr2=0x7ff4bc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4c2000640 1 -- 172.21.15.2:0/1772251389 shutdown_connections 2024-08-17T02:46:25.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.563+0000 7ff4c2000640 1 -- 172.21.15.2:0/1772251389 wait complete. 2024-08-17T02:46:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.565+0000 7ff4c2000640 1 Processor -- start 2024-08-17T02:46:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.565+0000 7ff4c2000640 1 -- start start 2024-08-17T02:46:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4c2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4bc0aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4c2000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc156b00 0x7ff4bc0a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4c2000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4bc0a91a0 0x7ff4bc0ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4c2000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc1571e0 con 0x7ff4a0003b60 2024-08-17T02:46:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4c2000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0ab4c0 con 0x7ff4bc156b00 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4c2000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0ac000 con 0x7ff4bc0a91a0 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4bc0aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4bc0aac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37924/0 (socket says 172.21.15.2:37924) 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bb400640 1 -- 172.21.15.2:0/2662636952 learned_addr learned my addr 172.21.15.2:0/2662636952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bbe00640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4bc0a91a0 0x7ff4bc0ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4b3e00640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc156b00 0x7ff4bc0a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bb400640 1 -- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4bc0a91a0 msgr2=0x7ff4bc0ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bb400640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4bc0a91a0 0x7ff4bc0ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bb400640 1 -- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc156b00 msgr2=0x7ff4bc0a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bb400640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc156b00 0x7ff4bc0a8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bb400640 1 -- 172.21.15.2:0/2662636952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc156f70 con 0x7ff4a0003b60 2024-08-17T02:46:25.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4b3e00640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc156b00 0x7ff4bc0a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.566+0000 7ff4bbe00640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4bc0a91a0 0x7ff4bc0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.567+0000 7ff4bb400640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4bc0aac00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac02aac0 tx=0x7ff4ac035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.567+0000 7ff4b2a00640 1 -- 172.21.15.2:0/2662636952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac000c40 con 0x7ff4a0003b60 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.567+0000 7ff4b2a00640 1 -- 172.21.15.2:0/2662636952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac030a60 con 0x7ff4a0003b60 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.567+0000 7ff4b2a00640 1 -- 172.21.15.2:0/2662636952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac030e20 con 0x7ff4a0003b60 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.567+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc0ab6d0 con 0x7ff4a0003b60 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.567+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc0abc90 con 0x7ff4a0003b60 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.568+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc063fb0 con 0x7ff4a0003b60 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.569+0000 7ff4b2a00640 1 -- 172.21.15.2:0/2662636952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff4ac045620 con 0x7ff4a0003b60 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.570+0000 7ff4b2a00640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff498065180 0x7ff498067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.570+0000 7ff4b2a00640 1 -- 172.21.15.2:0/2662636952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4ac0a3640 con 0x7ff4a0003b60 2024-08-17T02:46:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.570+0000 7ff4b3e00640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff498065180 0x7ff498067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.570+0000 7ff4b3e00640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff498065180 0x7ff498067630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4000e10 tx=0x7ff4a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.573+0000 7ff4b2a00640 1 -- 172.21.15.2:0/2662636952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff4ac071660 con 0x7ff4a0003b60 2024-08-17T02:46:25.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.795+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4bc150fa0 con 0x7ff4a0003b60 2024-08-17T02:46:25.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.795+0000 7ff4b2a00640 1 -- 172.21.15.2:0/2662636952 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7ff4ac074c80 con 0x7ff4a0003b60 2024-08-17T02:46:25.797 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:25.797 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:13.176093+0000","modified":"2024-08-17T02:46:16.759354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff498065180 msgr2=0x7ff498067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff498065180 0x7ff498067630 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4000e10 tx=0x7ff4a4009040 comp rx=0 tx=0).stop 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 msgr2=0x7ff4bc0aac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4bc0aac00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac02aac0 tx=0x7ff4ac035000 comp rx=0 tx=0).stop 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 shutdown_connections 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff498065180 0x7ff498067630 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4bc0a91a0 0x7ff4bc0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4bc156b00 0x7ff4bc0a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 --2- 172.21.15.2:0/2662636952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a0003b60 0x7ff4bc0aac00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 >> 172.21.15.2:0/2662636952 conn(0x7ff4bc066e60 msgr2=0x7ff4bc06a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.797+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 shutdown_connections 2024-08-17T02:46:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.798+0000 7ff4c2000640 1 -- 172.21.15.2:0/2662636952 wait complete. 2024-08-17T02:46:25.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:25.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.963+0000 7fa97d200640 1 Processor -- start 2024-08-17T02:46:25.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.964+0000 7fa97d200640 1 -- start start 2024-08-17T02:46:25.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa97d200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa9780ad790 0x7fa9780adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa97d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9781559e0 0x7fa9780ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa97d200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780ca6b0 con 0x7fa9780c9d20 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa97d200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780cb180 con 0x7fa9781559e0 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa97d200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780af530 con 0x7fa9780ad790 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa977e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9781559e0 0x7fa9780ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa977e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9781559e0 0x7fa9780ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37936/0 (socket says 172.21.15.2:37936) 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa977e00640 1 -- 172.21.15.2:0/2847772658 learned_addr learned my addr 172.21.15.2:0/2847772658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.965+0000 7fa977400640 1 --2- 172.21.15.2:0/2847772658 >> v2:172.21.15.26:3300/0 conn(0x7fa9780ad790 0x7fa9780adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.966+0000 7fa977e00640 1 -- 172.21.15.2:0/2847772658 >> v2:172.21.15.26:3300/0 conn(0x7fa9780ad790 msgr2=0x7fa9780adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.966+0000 7fa977e00640 1 --2- 172.21.15.2:0/2847772658 >> v2:172.21.15.26:3300/0 conn(0x7fa9780ad790 0x7fa9780adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.966+0000 7fa977e00640 1 -- 172.21.15.2:0/2847772658 >> v1:172.21.15.26:6789/0 conn(0x7fa9780c9d20 legacy=0x7fa9781552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.966+0000 7fa977e00640 1 -- 172.21.15.2:0/2847772658 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780ca8e0 con 0x7fa9781559e0 2024-08-17T02:46:25.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.967+0000 7fa977e00640 1 --2- 172.21.15.2:0/2847772658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9781559e0 0x7fa9780ca170 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa97806a890 tx=0x7fa970009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa486b5368408a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.967+0000 7fa976a00640 1 -- 172.21.15.2:0/2847772658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970031400 con 0x7fa9781559e0 2024-08-17T02:46:25.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.967+0000 7fa976a00640 1 -- 172.21.15.2:0/2847772658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97002d050 con 0x7fa9781559e0 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.967+0000 7fa976a00640 1 -- 172.21.15.2:0/2847772658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700317d0 con 0x7fa9781559e0 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.967+0000 7fa97d200640 1 -- 172.21.15.2:0/2847772658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9781559e0 msgr2=0x7fa9780ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.967+0000 7fa97d200640 1 --2- 172.21.15.2:0/2847772658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9781559e0 0x7fa9780ca170 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa97806a890 tx=0x7fa970009840 comp rx=0 tx=0).stop 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.968+0000 7fa97d200640 1 -- 172.21.15.2:0/2847772658 shutdown_connections 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.968+0000 7fa97d200640 1 --2- 172.21.15.2:0/2847772658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9781559e0 0x7fa9780ca170 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.968+0000 7fa97d200640 1 --2- 172.21.15.2:0/2847772658 >> v2:172.21.15.26:3300/0 conn(0x7fa9780ad790 0x7fa9780adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.968+0000 7fa97d200640 1 -- 172.21.15.2:0/2847772658 >> 172.21.15.2:0/2847772658 conn(0x7fa978062af0 msgr2=0x7fa978062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.968+0000 7fa97d200640 1 -- 172.21.15.2:0/2847772658 shutdown_connections 2024-08-17T02:46:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.968+0000 7fa97d200640 1 -- 172.21.15.2:0/2847772658 wait complete. 2024-08-17T02:46:25.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.969+0000 7fa97d200640 1 Processor -- start 2024-08-17T02:46:25.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.969+0000 7fa97d200640 1 -- start start 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa97d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9780ad790 0x7fa978166e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa97d200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9780c9d20 0x7fa978148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa97d200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9781559e0 0x7fa9781497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa97d200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978155f00 con 0x7fa9780ad790 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa97d200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781567a0 con 0x7fa9781559e0 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa97d200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa978167390 con 0x7fa9780c9d20 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa977400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9780ad790 0x7fa978166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa977400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9780ad790 0x7fa978166e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37942/0 (socket says 172.21.15.2:37942) 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa977400640 1 -- 172.21.15.2:0/971127194 learned_addr learned my addr 172.21.15.2:0/971127194 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa977e00640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9781559e0 0x7fa9781497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.970+0000 7fa96fe00640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9780c9d20 0x7fa978148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa977400640 1 -- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9780c9d20 msgr2=0x7fa978148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa977400640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9780c9d20 0x7fa978148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa977400640 1 -- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9781559e0 msgr2=0x7fa9781497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa977400640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9781559e0 0x7fa9781497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa977400640 1 -- 172.21.15.2:0/971127194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009ae0 con 0x7fa9780ad790 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa977e00640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9781559e0 0x7fa9781497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa977400640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9780ad790 0x7fa978166e50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa96800e930 tx=0x7fa9680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa96ea00640 1 -- 172.21.15.2:0/971127194 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968009480 con 0x7fa9780ad790 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa96ea00640 1 -- 172.21.15.2:0/971127194 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800c8e0 con 0x7fa9780ad790 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa978148840 con 0x7fa9780ad790 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa96ea00640 1 -- 172.21.15.2:0/971127194 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96800cc60 con 0x7fa9780ad790 2024-08-17T02:46:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.971+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa978156150 con 0x7fa9780ad790 2024-08-17T02:46:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.972+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978070720 con 0x7fa9780ad790 2024-08-17T02:46:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.973+0000 7fa96ea00640 1 -- 172.21.15.2:0/971127194 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa968013680 con 0x7fa9780ad790 2024-08-17T02:46:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.974+0000 7fa96ea00640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa954065150 0x7fa954067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.974+0000 7fa96ea00640 1 -- 172.21.15.2:0/971127194 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa968082600 con 0x7fa9780ad790 2024-08-17T02:46:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.974+0000 7fa96fe00640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa954065150 0x7fa954067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:25.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.975+0000 7fa96fe00640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa954065150 0x7fa954067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa978154f40 tx=0x7fa960009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:25.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:25.978+0000 7fa96ea00640 1 -- 172.21.15.2:0/971127194 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa968050620 con 0x7fa9780ad790 2024-08-17T02:46:26.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.160+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9781564f0 con 0x7fa9780ad790 2024-08-17T02:46:26.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.161+0000 7fa96ea00640 1 -- 172.21.15.2:0/971127194 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fa968053c40 con 0x7fa9780ad790 2024-08-17T02:46:26.162 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:26.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa954065150 msgr2=0x7fa954067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa954065150 0x7fa954067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa978154f40 tx=0x7fa960009040 comp rx=0 tx=0).stop 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9780ad790 msgr2=0x7fa978166e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9780ad790 0x7fa978166e50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa96800e930 tx=0x7fa9680090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 shutdown_connections 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9781559e0 0x7fa9781497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa954065150 0x7fa954067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9780c9d20 0x7fa978148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 --2- 172.21.15.2:0/971127194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9780ad790 0x7fa978166e50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.163+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 >> 172.21.15.2:0/971127194 conn(0x7fa978062af0 msgr2=0x7fa9780aae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.164+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 shutdown_connections 2024-08-17T02:46:26.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.164+0000 7fa97d200640 1 -- 172.21.15.2:0/971127194 wait complete. 2024-08-17T02:46:26.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:10.965028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:12.163837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:26.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.333+0000 7fd2b4000640 1 Processor -- start 2024-08-17T02:46:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.333+0000 7fd2b4000640 1 -- start start 2024-08-17T02:46:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.334+0000 7fd2b4000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2ac0adf90 0x7fd2ac0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.334+0000 7fd2b4000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0ac040 con 0x7fd2ac156bd0 2024-08-17T02:46:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.334+0000 7fd2b4000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0ab150 con 0x7fd2ac0b1280 2024-08-17T02:46:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.334+0000 7fd2b4000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac067810 con 0x7fd2ac0adf90 2024-08-17T02:46:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.334+0000 7fd2b2000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd2ac0adf90 0x7fd2ac0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.334+0000 7fd2b1600640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd2ac156bd0 0x7fd2ac0b0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56566/0 (socket says 172.21.15.2:56566) 2024-08-17T02:46:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.334+0000 7fd2b1600640 1 -- 172.21.15.2:0/3892178008 learned_addr learned my addr 172.21.15.2:0/3892178008 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.335+0000 7fd2b2000640 1 -- 172.21.15.2:0/3892178008 >> v1:172.21.15.26:6789/0 conn(0x7fd2ac0b1280 legacy=0x7fd2ac0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.335+0000 7fd2b2000640 1 -- 172.21.15.2:0/3892178008 >> v1:172.21.15.2:6789/0 conn(0x7fd2ac156bd0 legacy=0x7fd2ac0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.335+0000 7fd2b2000640 1 -- 172.21.15.2:0/3892178008 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac0ab430 con 0x7fd2ac0adf90 2024-08-17T02:46:26.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.336+0000 7fd2b2000640 1 --2- 172.21.15.2:0/3892178008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac0adf90 0x7fd2ac0ca5f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009e60 tx=0x7fd2a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ddac745553d14f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.336+0000 7fd2abe00640 1 -- 172.21.15.2:0/3892178008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4007550 con 0x7fd2ac0adf90 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.336+0000 7fd2abe00640 1 -- 172.21.15.2:0/3892178008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a402d050 con 0x7fd2ac0adf90 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.336+0000 7fd2abe00640 1 -- 172.21.15.2:0/3892178008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4007920 con 0x7fd2ac0adf90 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.336+0000 7fd2b4000640 1 -- 172.21.15.2:0/3892178008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac0adf90 msgr2=0x7fd2ac0ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.336+0000 7fd2b4000640 1 --2- 172.21.15.2:0/3892178008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac0adf90 0x7fd2ac0ca5f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009e60 tx=0x7fd2a4009780 comp rx=0 tx=0).stop 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.337+0000 7fd2b4000640 1 -- 172.21.15.2:0/3892178008 shutdown_connections 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.337+0000 7fd2b4000640 1 --2- 172.21.15.2:0/3892178008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac0adf90 0x7fd2ac0ca5f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.337+0000 7fd2b4000640 1 -- 172.21.15.2:0/3892178008 >> 172.21.15.2:0/3892178008 conn(0x7fd2ac0cc390 msgr2=0x7fd2ac066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.337+0000 7fd2b4000640 1 -- 172.21.15.2:0/3892178008 shutdown_connections 2024-08-17T02:46:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.337+0000 7fd2b4000640 1 -- 172.21.15.2:0/3892178008 wait complete. 2024-08-17T02:46:26.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.338+0000 7fd2b4000640 1 Processor -- start 2024-08-17T02:46:26.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.338+0000 7fd2b4000640 1 -- start start 2024-08-17T02:46:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b4000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2ac0adf90 0x7fd2ac159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b4000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2ac0b1280 0x7fd2ac150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b4000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac156bd0 0x7fd2ac0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b4000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac158cd0 con 0x7fd2ac156bd0 2024-08-17T02:46:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b4000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0b07b0 con 0x7fd2ac0b1280 2024-08-17T02:46:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b4000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac158680 con 0x7fd2ac0adf90 2024-08-17T02:46:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac156bd0 0x7fd2ac0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac156bd0 0x7fd2ac0aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37962/0 (socket says 172.21.15.2:37962) 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b2000640 1 -- 172.21.15.2:0/518897945 learned_addr learned my addr 172.21.15.2:0/518897945 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2b1600640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2ac0adf90 0x7fd2ac159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.339+0000 7fd2b0c00640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2ac0b1280 0x7fd2ac150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2b2000640 1 -- 172.21.15.2:0/518897945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2ac0adf90 msgr2=0x7fd2ac159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2b2000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2ac0adf90 0x7fd2ac159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2b2000640 1 -- 172.21.15.2:0/518897945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2ac0b1280 msgr2=0x7fd2ac150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2b2000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2ac0b1280 0x7fd2ac150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2b2000640 1 -- 172.21.15.2:0/518897945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4009a20 con 0x7fd2ac156bd0 2024-08-17T02:46:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2b2000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac156bd0 0x7fd2ac0aa100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40099f0 tx=0x7fd2a4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2a8c00640 1 -- 172.21.15.2:0/518897945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4031a00 con 0x7fd2ac156bd0 2024-08-17T02:46:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.340+0000 7fd2a8c00640 1 -- 172.21.15.2:0/518897945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a4040070 con 0x7fd2ac156bd0 2024-08-17T02:46:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.341+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac158960 con 0x7fd2ac156bd0 2024-08-17T02:46:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.341+0000 7fd2a8c00640 1 -- 172.21.15.2:0/518897945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4031db0 con 0x7fd2ac156bd0 2024-08-17T02:46:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.341+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac158350 con 0x7fd2ac156bd0 2024-08-17T02:46:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.342+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac063fb0 con 0x7fd2ac156bd0 2024-08-17T02:46:26.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.343+0000 7fd2a8c00640 1 -- 172.21.15.2:0/518897945 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd2a4042030 con 0x7fd2ac156bd0 2024-08-17T02:46:26.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.343+0000 7fd2a8c00640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd28c065150 0x7fd28c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.343+0000 7fd2a8c00640 1 -- 172.21.15.2:0/518897945 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2a40a3dc0 con 0x7fd2ac156bd0 2024-08-17T02:46:26.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.344+0000 7fd2b1600640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd28c065150 0x7fd28c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.344+0000 7fd2b1600640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd28c065150 0x7fd28c067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00018c0 tx=0x7fd2a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.348+0000 7fd2a8c00640 1 -- 172.21.15.2:0/518897945 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd2a4071e90 con 0x7fd2ac156bd0 2024-08-17T02:46:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.530+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2ac068940 con 0x7fd2ac156bd0 2024-08-17T02:46:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.531+0000 7fd2a8c00640 1 -- 172.21.15.2:0/518897945 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2a40754b0 con 0x7fd2ac156bd0 2024-08-17T02:46:26.532 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.532+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd28c065150 msgr2=0x7fd28c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.532+0000 7fd2b4000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd28c065150 0x7fd28c067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00018c0 tx=0x7fd2a0009040 comp rx=0 tx=0).stop 2024-08-17T02:46:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.532+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac156bd0 msgr2=0x7fd2ac0aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.532+0000 7fd2b4000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac156bd0 0x7fd2ac0aa100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40099f0 tx=0x7fd2a4037000 comp rx=0 tx=0).stop 2024-08-17T02:46:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.533+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 shutdown_connections 2024-08-17T02:46:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.533+0000 7fd2b4000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2ac156bd0 0x7fd2ac0aa100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.533+0000 7fd2b4000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2ac0b1280 0x7fd2ac150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.533+0000 7fd2b4000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd28c065150 0x7fd28c067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.533+0000 7fd2b4000640 1 --2- 172.21.15.2:0/518897945 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2ac0adf90 0x7fd2ac159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.533+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 >> 172.21.15.2:0/518897945 conn(0x7fd2ac0cc390 msgr2=0x7fd2ac06ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.533+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 shutdown_connections 2024-08-17T02:46:26.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.533+0000 7fd2b4000640 1 -- 172.21.15.2:0/518897945 wait complete. 2024-08-17T02:46:26.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.700+0000 7f0577400640 1 Processor -- start 2024-08-17T02:46:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.700+0000 7f0577400640 1 -- start start 2024-08-17T02:46:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.701+0000 7f0577400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05700ca050 0x7f0570156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f0577400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700cb160 con 0x7f05700ad960 2024-08-17T02:46:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f0577400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700b0d10 con 0x7f05700add30 2024-08-17T02:46:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f0577400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700ca550 con 0x7f05700ca050 2024-08-17T02:46:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f0574a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f05700ad960 0x7f0570156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56568/0 (socket says 172.21.15.2:56568) 2024-08-17T02:46:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f0574a00640 1 -- 172.21.15.2:0/4250435037 learned_addr learned my addr 172.21.15.2:0/4250435037 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f056fe00640 1 --2- 172.21.15.2:0/4250435037 >> v2:172.21.15.26:3300/0 conn(0x7f05700ca050 0x7f0570156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f056f400640 1 -- 172.21.15.2:0/4250435037 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545237600 0 0) 0x7f05700cb160 con 0x7f05700ad960 2024-08-17T02:46:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f056f400640 1 -- 172.21.15.2:0/4250435037 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05580034e0 con 0x7f05700ad960 2024-08-17T02:46:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f056fe00640 1 -- 172.21.15.2:0/4250435037 >> v1:172.21.15.26:6789/0 conn(0x7f05700add30 legacy=0x7f05700aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.702+0000 7f056f400640 1 -- 172.21.15.2:0/4250435037 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214485002 0 0) 0x7f05700b0d10 con 0x7f05700add30 2024-08-17T02:46:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.703+0000 7f056fe00640 1 -- 172.21.15.2:0/4250435037 >> v1:172.21.15.2:6789/0 conn(0x7f05700ad960 legacy=0x7f0570156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.703+0000 7f056fe00640 1 -- 172.21.15.2:0/4250435037 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700ca830 con 0x7f05700ca050 2024-08-17T02:46:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f056fe00640 1 --2- 172.21.15.2:0/4250435037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05700ca050 0x7f0570156b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f055c009850 tx=0x7f055c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f9904f6cfc8333d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f056f400640 1 -- 172.21.15.2:0/4250435037 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c032440 con 0x7f05700ca050 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f056f400640 1 -- 172.21.15.2:0/4250435037 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c0325a0 con 0x7f05700ca050 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f056f400640 1 -- 172.21.15.2:0/4250435037 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c032940 con 0x7f05700ca050 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f0577400640 1 -- 172.21.15.2:0/4250435037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05700ca050 msgr2=0x7f0570156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f0577400640 1 --2- 172.21.15.2:0/4250435037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05700ca050 0x7f0570156b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f055c009850 tx=0x7f055c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f0577400640 1 -- 172.21.15.2:0/4250435037 shutdown_connections 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f0577400640 1 --2- 172.21.15.2:0/4250435037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05700ca050 0x7f0570156b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.704+0000 7f0577400640 1 -- 172.21.15.2:0/4250435037 >> 172.21.15.2:0/4250435037 conn(0x7f0570066e60 msgr2=0x7f0570067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.705+0000 7f0577400640 1 -- 172.21.15.2:0/4250435037 shutdown_connections 2024-08-17T02:46:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.705+0000 7f0577400640 1 -- 172.21.15.2:0/4250435037 wait complete. 2024-08-17T02:46:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.706+0000 7f0577400640 1 Processor -- start 2024-08-17T02:46:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.706+0000 7f0577400640 1 -- start start 2024-08-17T02:46:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0577400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05700ad960 0x7f057014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0577400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05700add30 0x7f0570159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0577400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05700ca050 0x7f05700aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0577400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057014d740 con 0x7f05700ca050 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0577400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057014cb30 con 0x7f05700add30 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0577400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057014ce10 con 0x7f05700ad960 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0575400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05700ca050 0x7f05700aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0575400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05700ca050 0x7f05700aabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37972/0 (socket says 172.21.15.2:37972) 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0575400640 1 -- 172.21.15.2:0/1243439618 learned_addr learned my addr 172.21.15.2:0/1243439618 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0575400640 1 -- 172.21.15.2:0/1243439618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05700ad960 msgr2=0x7f057014c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0575400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05700ad960 0x7f057014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0575400640 1 -- 172.21.15.2:0/1243439618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05700add30 msgr2=0x7f0570159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0575400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05700add30 0x7f0570159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.707+0000 7f0575400640 1 -- 172.21.15.2:0/1243439618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c009390 con 0x7f05700ca050 2024-08-17T02:46:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.708+0000 7f0575400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05700ca050 0x7f05700aabc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0568001560 tx=0x7f05680016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.708+0000 7f0563e00640 1 -- 172.21.15.2:0/1243439618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800a7f0 con 0x7f05700ca050 2024-08-17T02:46:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.708+0000 7f0563e00640 1 -- 172.21.15.2:0/1243439618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056800a950 con 0x7f05700ca050 2024-08-17T02:46:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.708+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057014d0f0 con 0x7f05700ca050 2024-08-17T02:46:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.708+0000 7f0563e00640 1 -- 172.21.15.2:0/1243439618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800ad10 con 0x7f05700ca050 2024-08-17T02:46:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.708+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05700ab100 con 0x7f05700ca050 2024-08-17T02:46:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.709+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570063fb0 con 0x7f05700ca050 2024-08-17T02:46:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.710+0000 7f0563e00640 1 -- 172.21.15.2:0/1243439618 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0568003030 con 0x7f05700ca050 2024-08-17T02:46:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.711+0000 7f0563e00640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0550065150 0x7f0550067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.711+0000 7f0563e00640 1 -- 172.21.15.2:0/1243439618 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05680825d0 con 0x7f05700ca050 2024-08-17T02:46:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.711+0000 7f0574a00640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0550065150 0x7f0550067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.712+0000 7f0574a00640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0550065150 0x7f0550067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0564005840 tx=0x7f0564007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.715+0000 7f0563e00640 1 -- 172.21.15.2:0/1243439618 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f05680505f0 con 0x7f05700ca050 2024-08-17T02:46:26.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.895+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f057014d880 con 0x7f05700ca050 2024-08-17T02:46:26.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.895+0000 7f0563e00640 1 -- 172.21.15.2:0/1243439618 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0568053c10 con 0x7f05700ca050 2024-08-17T02:46:26.896 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.897+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0550065150 msgr2=0x7f0550067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.897+0000 7f0577400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0550065150 0x7f0550067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0564005840 tx=0x7f0564007940 comp rx=0 tx=0).stop 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.897+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05700ca050 msgr2=0x7f05700aabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.897+0000 7f0577400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05700ca050 0x7f05700aabc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0568001560 tx=0x7f05680016c0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.898+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 shutdown_connections 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.898+0000 7f0577400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05700ca050 0x7f05700aabc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.898+0000 7f0577400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05700add30 0x7f0570159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.898+0000 7f0577400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0550065150 0x7f0550067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.898+0000 7f0577400640 1 --2- 172.21.15.2:0/1243439618 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05700ad960 0x7f057014c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:26.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.898+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 >> 172.21.15.2:0/1243439618 conn(0x7f0570066e60 msgr2=0x7f05700aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:26.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.898+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 shutdown_connections 2024-08-17T02:46:26.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:26.898+0000 7f0577400640 1 -- 172.21.15.2:0/1243439618 wait complete. 2024-08-17T02:46:26.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:27.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.067+0000 7ff33fe00640 1 Processor -- start 2024-08-17T02:46:27.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.067+0000 7ff33fe00640 1 -- start start 2024-08-17T02:46:27.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff3380afca0 0x7ff3380b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33fe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff3381590b0 0x7ff338159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33fe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33815a4e0 con 0x7ff3380acf10 2024-08-17T02:46:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3380b0980 con 0x7ff3380afca0 2024-08-17T02:46:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33fe00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3380c92b0 con 0x7ff3381590b0 2024-08-17T02:46:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33ca00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff3380acf10 0x7ff3381589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56584/0 (socket says 172.21.15.2:56584) 2024-08-17T02:46:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33ca00640 1 -- 172.21.15.2:0/521146684 learned_addr learned my addr 172.21.15.2:0/521146684 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33d400640 1 --2- 172.21.15.2:0/521146684 >> v2:172.21.15.2:3300/0 conn(0x7ff3380afca0 0x7ff3380b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33de00640 1 --2- 172.21.15.2:0/521146684 >> v2:172.21.15.26:3300/0 conn(0x7ff3381590b0 0x7ff338159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33d400640 1 -- 172.21.15.2:0/521146684 >> v2:172.21.15.26:3300/0 conn(0x7ff3381590b0 msgr2=0x7ff338159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33d400640 1 --2- 172.21.15.2:0/521146684 >> v2:172.21.15.26:3300/0 conn(0x7ff3381590b0 0x7ff338159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33d400640 1 -- 172.21.15.2:0/521146684 >> v1:172.21.15.2:6789/0 conn(0x7ff3380acf10 legacy=0x7ff3381589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.069+0000 7ff33d400640 1 -- 172.21.15.2:0/521146684 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380ad480 con 0x7ff3380afca0 2024-08-17T02:46:27.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.070+0000 7ff33d400640 1 --2- 172.21.15.2:0/521146684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff3380b0070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff3380cb4a0 tx=0x7ff32c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4082fd13ad8cceb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff337e00640 1 -- 172.21.15.2:0/521146684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c02adb0 con 0x7ff3380afca0 2024-08-17T02:46:27.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff337e00640 1 -- 172.21.15.2:0/521146684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c032440 con 0x7ff3380afca0 2024-08-17T02:46:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff337e00640 1 -- 172.21.15.2:0/521146684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c032820 con 0x7ff3380afca0 2024-08-17T02:46:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff33fe00640 1 -- 172.21.15.2:0/521146684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 msgr2=0x7ff3380b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff33fe00640 1 --2- 172.21.15.2:0/521146684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff3380b0070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff3380cb4a0 tx=0x7ff32c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff33fe00640 1 -- 172.21.15.2:0/521146684 shutdown_connections 2024-08-17T02:46:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff33fe00640 1 --2- 172.21.15.2:0/521146684 >> v2:172.21.15.26:3300/0 conn(0x7ff3381590b0 0x7ff338159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff33fe00640 1 --2- 172.21.15.2:0/521146684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff3380b0070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff33fe00640 1 -- 172.21.15.2:0/521146684 >> 172.21.15.2:0/521146684 conn(0x7ff338066e60 msgr2=0x7ff338067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff33fe00640 1 -- 172.21.15.2:0/521146684 shutdown_connections 2024-08-17T02:46:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.071+0000 7ff33fe00640 1 -- 172.21.15.2:0/521146684 wait complete. 2024-08-17T02:46:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.073+0000 7ff33fe00640 1 Processor -- start 2024-08-17T02:46:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.073+0000 7ff33fe00640 1 -- start start 2024-08-17T02:46:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3380acf10 0x7ff33814dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff338150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3381590b0 0x7ff33814b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff338153e60 con 0x7ff3380afca0 2024-08-17T02:46:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33fe00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381525d0 con 0x7ff3381590b0 2024-08-17T02:46:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33fe00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33814b920 con 0x7ff3380acf10 2024-08-17T02:46:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff338150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff338150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37986/0 (socket says 172.21.15.2:37986) 2024-08-17T02:46:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33ca00640 1 -- 172.21.15.2:0/3309403803 learned_addr learned my addr 172.21.15.2:0/3309403803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33d400640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3380acf10 0x7ff33814dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33de00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3381590b0 0x7ff33814b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33ca00640 1 -- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3380acf10 msgr2=0x7ff33814dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33ca00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3380acf10 0x7ff33814dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33ca00640 1 -- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3381590b0 msgr2=0x7ff33814b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33ca00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3381590b0 0x7ff33814b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33ca00640 1 -- 172.21.15.2:0/3309403803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c009390 con 0x7ff3380afca0 2024-08-17T02:46:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.074+0000 7ff33de00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3381590b0 0x7ff33814b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.075+0000 7ff33ca00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff338150f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c590 tx=0x7ff324007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.075+0000 7ff334c00640 1 -- 172.21.15.2:0/3309403803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324005aa0 con 0x7ff3380afca0 2024-08-17T02:46:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.075+0000 7ff334c00640 1 -- 172.21.15.2:0/3309403803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff324005c60 con 0x7ff3380afca0 2024-08-17T02:46:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.075+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33814e300 con 0x7ff3380afca0 2024-08-17T02:46:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.075+0000 7ff334c00640 1 -- 172.21.15.2:0/3309403803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3240070d0 con 0x7ff3380afca0 2024-08-17T02:46:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.075+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff338153920 con 0x7ff3380afca0 2024-08-17T02:46:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.076+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff338063fb0 con 0x7ff3380afca0 2024-08-17T02:46:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.077+0000 7ff334c00640 1 -- 172.21.15.2:0/3309403803 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff324007500 con 0x7ff3380afca0 2024-08-17T02:46:27.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.078+0000 7ff334c00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff318065150 0x7ff318067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.078+0000 7ff334c00640 1 -- 172.21.15.2:0/3309403803 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff324081750 con 0x7ff3380afca0 2024-08-17T02:46:27.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.078+0000 7ff33d400640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff318065150 0x7ff318067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.079+0000 7ff33d400640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff318065150 0x7ff318067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff32c034000 tx=0x7ff32c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.081+0000 7ff334c00640 1 -- 172.21.15.2:0/3309403803 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff32404f8e0 con 0x7ff3380afca0 2024-08-17T02:46:27.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.261+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff33815b660 con 0x7ff3380afca0 2024-08-17T02:46:27.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.262+0000 7ff334c00640 1 -- 172.21.15.2:0/3309403803 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff33815b660 con 0x7ff3380afca0 2024-08-17T02:46:27.263 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:46:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff318065150 msgr2=0x7ff318067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff318065150 0x7ff318067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff32c034000 tx=0x7ff32c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 msgr2=0x7ff338150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff338150f70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c590 tx=0x7ff324007f40 comp rx=0 tx=0).stop 2024-08-17T02:46:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 shutdown_connections 2024-08-17T02:46:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3381590b0 0x7ff33814b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3380afca0 0x7ff338150f70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff318065150 0x7ff318067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 --2- 172.21.15.2:0/3309403803 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff3380acf10 0x7ff33814dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 >> 172.21.15.2:0/3309403803 conn(0x7ff338066e60 msgr2=0x7ff3381546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 shutdown_connections 2024-08-17T02:46:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.264+0000 7ff33fe00640 1 -- 172.21.15.2:0/3309403803 wait complete. 2024-08-17T02:46:27.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.431+0000 7fe41a200640 1 Processor -- start 2024-08-17T02:46:27.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.431+0000 7fe41a200640 1 -- start start 2024-08-17T02:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe41a200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe414158b10 0x7fe4140b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe41a200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe414067570 0x7fe4140aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe41a200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4140a9620 con 0x7fe4140b25c0 2024-08-17T02:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe41a200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4140aa420 con 0x7fe414158b10 2024-08-17T02:46:27.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe41a200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140a9850 con 0x7fe414067570 2024-08-17T02:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe418e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe414158b10 0x7fe4140b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe419800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe414067570 0x7fe4140aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe418e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe414158b10 0x7fe4140b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:52412/0 (socket says 172.21.15.2:52412) 2024-08-17T02:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe418e00640 1 -- 172.21.15.2:0/1939461163 learned_addr learned my addr 172.21.15.2:0/1939461163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:27.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.432+0000 7fe413e00640 1 --1- 172.21.15.2:0/1939461163 >> v1:172.21.15.26:6789/0 conn(0x7fe4140b25c0 0x7fe414066e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:57408/0 (socket says 172.21.15.2:57408) 2024-08-17T02:46:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.433+0000 7fe413400640 1 -- 172.21.15.2:0/1939461163 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24848696 0 0) 0x7fe4140a9620 con 0x7fe4140b25c0 2024-08-17T02:46:27.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.433+0000 7fe418e00640 1 -- 172.21.15.2:0/1939461163 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe414067570 msgr2=0x7fe4140aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.433+0000 7fe418e00640 1 --2- 172.21.15.2:0/1939461163 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe414067570 0x7fe4140aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.433+0000 7fe418e00640 1 -- 172.21.15.2:0/1939461163 >> v1:172.21.15.26:6789/0 conn(0x7fe4140b25c0 legacy=0x7fe414066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.433+0000 7fe418e00640 1 -- 172.21.15.2:0/1939461163 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414067c40 con 0x7fe414158b10 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.433+0000 7fe419800640 1 --2- 172.21.15.2:0/1939461163 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe414067570 0x7fe4140aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.434+0000 7fe418e00640 1 --2- 172.21.15.2:0/1939461163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 0x7fe4140b2080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe408009910 tx=0x7fe4080091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e63e3dbf679a962a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.434+0000 7fe413400640 1 -- 172.21.15.2:0/1939461163 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40802add0 con 0x7fe414158b10 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.434+0000 7fe413400640 1 -- 172.21.15.2:0/1939461163 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408032440 con 0x7fe414158b10 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.434+0000 7fe413400640 1 -- 172.21.15.2:0/1939461163 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080327e0 con 0x7fe414158b10 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.434+0000 7fe41a200640 1 -- 172.21.15.2:0/1939461163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 msgr2=0x7fe4140b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.434+0000 7fe41a200640 1 --2- 172.21.15.2:0/1939461163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 0x7fe4140b2080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe408009910 tx=0x7fe4080091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.435+0000 7fe41a200640 1 -- 172.21.15.2:0/1939461163 shutdown_connections 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.435+0000 7fe41a200640 1 --2- 172.21.15.2:0/1939461163 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe414067570 0x7fe4140aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.435+0000 7fe41a200640 1 --2- 172.21.15.2:0/1939461163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 0x7fe4140b2080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.435+0000 7fe41a200640 1 -- 172.21.15.2:0/1939461163 >> 172.21.15.2:0/1939461163 conn(0x7fe414095a70 msgr2=0x7fe414095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.435+0000 7fe41a200640 1 -- 172.21.15.2:0/1939461163 shutdown_connections 2024-08-17T02:46:27.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.435+0000 7fe41a200640 1 -- 172.21.15.2:0/1939461163 wait complete. 2024-08-17T02:46:27.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.436+0000 7fe41a200640 1 Processor -- start 2024-08-17T02:46:27.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.436+0000 7fe41a200640 1 -- start start 2024-08-17T02:46:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe41a200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe414067570 0x7fe414152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe41a200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4140b25c0 0x7fe41415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe41a200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 0x7fe41414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe41a200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415d670 con 0x7fe414067570 2024-08-17T02:46:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe41a200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415dea0 con 0x7fe414158b10 2024-08-17T02:46:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe41a200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41415bfd0 con 0x7fe4140b25c0 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe418e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe414067570 0x7fe414152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe418e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe414067570 0x7fe414152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37990/0 (socket says 172.21.15.2:37990) 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe418e00640 1 -- 172.21.15.2:0/949527533 learned_addr learned my addr 172.21.15.2:0/949527533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe419800640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 0x7fe41414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.437+0000 7fe413e00640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4140b25c0 0x7fe41415b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe418e00640 1 -- 172.21.15.2:0/949527533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4140b25c0 msgr2=0x7fe41415b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe418e00640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4140b25c0 0x7fe41415b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe418e00640 1 -- 172.21.15.2:0/949527533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 msgr2=0x7fe41414e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe418e00640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 0x7fe41414e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe418e00640 1 -- 172.21.15.2:0/949527533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c009a20 con 0x7fe414067570 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe418e00640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe414067570 0x7fe414152090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe408035040 tx=0x7fe408032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe407e00640 1 -- 172.21.15.2:0/949527533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408031c80 con 0x7fe414067570 2024-08-17T02:46:27.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe407e00640 1 -- 172.21.15.2:0/949527533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408031e00 con 0x7fe414067570 2024-08-17T02:46:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe407e00640 1 -- 172.21.15.2:0/949527533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40803d670 con 0x7fe414067570 2024-08-17T02:46:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe408009450 con 0x7fe414067570 2024-08-17T02:46:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.438+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41415db30 con 0x7fe414067570 2024-08-17T02:46:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.439+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4141583e0 con 0x7fe414067570 2024-08-17T02:46:27.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.440+0000 7fe407e00640 1 -- 172.21.15.2:0/949527533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe408039040 con 0x7fe414067570 2024-08-17T02:46:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.441+0000 7fe407e00640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.441+0000 7fe407e00640 1 -- 172.21.15.2:0/949527533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4080a22b0 con 0x7fe414067570 2024-08-17T02:46:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.441+0000 7fe413e00640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.442+0000 7fe413e00640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe414064110 tx=0x7fe400007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.445+0000 7fe407e00640 1 -- 172.21.15.2:0/949527533 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe4141583e0 con 0x7fe414067570 2024-08-17T02:46:27.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.663+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4141583e0 con 0x7fe414067570 2024-08-17T02:46:27.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.663+0000 7fe407e00640 1 -- 172.21.15.2:0/949527533 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fe4141583e0 con 0x7fe414067570 2024-08-17T02:46:27.665 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:27.665 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:13.176093+0000","modified":"2024-08-17T02:46:16.759354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-08-17T02:46:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 msgr2=0x7fe3f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe414064110 tx=0x7fe400007cc0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe414067570 msgr2=0x7fe414152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe414067570 0x7fe414152090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe408035040 tx=0x7fe408032000 comp rx=0 tx=0).stop 2024-08-17T02:46:27.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 shutdown_connections 2024-08-17T02:46:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe414158b10 0x7fe41414e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe3f4065150 0x7fe3f4067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4140b25c0 0x7fe41415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 --2- 172.21.15.2:0/949527533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe414067570 0x7fe414152090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 >> 172.21.15.2:0/949527533 conn(0x7fe414095a70 msgr2=0x7fe414156660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.665+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 shutdown_connections 2024-08-17T02:46:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.666+0000 7fe41a200640 1 -- 172.21.15.2:0/949527533 wait complete. 2024-08-17T02:46:27.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:27.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.833+0000 7fb359a00640 1 Processor -- start 2024-08-17T02:46:27.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.833+0000 7fb359a00640 1 -- start start 2024-08-17T02:46:27.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.834+0000 7fb359a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb3540ad960 0x7fb35415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.834+0000 7fb359a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3540add30 0x7fb354156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.834+0000 7fb359a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35415b5e0 con 0x7fb3540ca050 2024-08-17T02:46:27.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.834+0000 7fb359a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3540cb160 con 0x7fb3540ad960 2024-08-17T02:46:27.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.834+0000 7fb359a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3540b0d10 con 0x7fb3540add30 2024-08-17T02:46:27.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb352a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb3540ad960 0x7fb35415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb34be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb3540ca050 0x7fb354156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56596/0 (socket says 172.21.15.2:56596) 2024-08-17T02:46:27.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb34be00640 1 -- 172.21.15.2:0/484609904 learned_addr learned my addr 172.21.15.2:0/484609904 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:27.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb353400640 1 --2- 172.21.15.2:0/484609904 >> v2:172.21.15.26:3300/0 conn(0x7fb3540add30 0x7fb354156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb352a00640 1 -- 172.21.15.2:0/484609904 >> v2:172.21.15.26:3300/0 conn(0x7fb3540add30 msgr2=0x7fb354156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:27.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb352a00640 1 --2- 172.21.15.2:0/484609904 >> v2:172.21.15.26:3300/0 conn(0x7fb3540add30 0x7fb354156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb352a00640 1 -- 172.21.15.2:0/484609904 >> v1:172.21.15.2:6789/0 conn(0x7fb3540ca050 legacy=0x7fb354156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb352000640 1 -- 172.21.15.2:0/484609904 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660275741 0 0) 0x7fb33c001110 con 0x7fb3540ca050 2024-08-17T02:46:27.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.835+0000 7fb352a00640 1 -- 172.21.15.2:0/484609904 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3540ca550 con 0x7fb3540ad960 2024-08-17T02:46:27.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.836+0000 7fb352a00640 1 --2- 172.21.15.2:0/484609904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540ad960 0x7fb35415b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb3540cb0d0 tx=0x7fb3440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202c2c5667757728 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.836+0000 7fb352000640 1 -- 172.21.15.2:0/484609904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34402ae40 con 0x7fb3540ad960 2024-08-17T02:46:27.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.836+0000 7fb352000640 1 -- 172.21.15.2:0/484609904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb344032440 con 0x7fb3540ad960 2024-08-17T02:46:27.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.836+0000 7fb352000640 1 -- 172.21.15.2:0/484609904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440327e0 con 0x7fb3540ad960 2024-08-17T02:46:27.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.837+0000 7fb359a00640 1 -- 172.21.15.2:0/484609904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540ad960 msgr2=0x7fb35415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.837+0000 7fb359a00640 1 --2- 172.21.15.2:0/484609904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540ad960 0x7fb35415b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb3540cb0d0 tx=0x7fb3440090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.837+0000 7fb359a00640 1 -- 172.21.15.2:0/484609904 shutdown_connections 2024-08-17T02:46:27.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.837+0000 7fb359a00640 1 --2- 172.21.15.2:0/484609904 >> v2:172.21.15.26:3300/0 conn(0x7fb3540add30 0x7fb354156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.837+0000 7fb359a00640 1 --2- 172.21.15.2:0/484609904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540ad960 0x7fb35415b0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.837+0000 7fb359a00640 1 -- 172.21.15.2:0/484609904 >> 172.21.15.2:0/484609904 conn(0x7fb354066e60 msgr2=0x7fb354067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:27.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.837+0000 7fb359a00640 1 -- 172.21.15.2:0/484609904 shutdown_connections 2024-08-17T02:46:27.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.837+0000 7fb359a00640 1 -- 172.21.15.2:0/484609904 wait complete. 2024-08-17T02:46:27.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.838+0000 7fb359a00640 1 Processor -- start 2024-08-17T02:46:27.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.839+0000 7fb359a00640 1 -- start start 2024-08-17T02:46:27.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.839+0000 7fb359a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540ad960 0x7fb354157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.839+0000 7fb359a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540add30 0x7fb3540aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.839+0000 7fb359a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3540ca050 0x7fb3541463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.839+0000 7fb359a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354159fa0 con 0x7fb3540add30 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.839+0000 7fb359a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540a9660 con 0x7fb3540ad960 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.839+0000 7fb359a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541468f0 con 0x7fb3540ca050 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540add30 0x7fb3540aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540add30 0x7fb3540aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38012/0 (socket says 172.21.15.2:38012) 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 -- 172.21.15.2:0/1731484105 learned_addr learned my addr 172.21.15.2:0/1731484105 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:27.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb353400640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3540ca050 0x7fb3541463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb352a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540ad960 0x7fb354157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 -- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3540ca050 msgr2=0x7fb3541463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3540ca050 0x7fb3541463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 -- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540ad960 msgr2=0x7fb354157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:27.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540ad960 0x7fb354157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:27.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 -- 172.21.15.2:0/1731484105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344009390 con 0x7fb3540add30 2024-08-17T02:46:27.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb352a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540ad960 0x7fb354157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:27.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.840+0000 7fb34be00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540add30 0x7fb3540aad20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c810 tx=0x7fb33c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.841+0000 7fb34a000640 1 -- 172.21.15.2:0/1731484105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c005870 con 0x7fb3540add30 2024-08-17T02:46:27.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.841+0000 7fb34a000640 1 -- 172.21.15.2:0/1731484105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c0059d0 con 0x7fb3540add30 2024-08-17T02:46:27.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.841+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3540ac1a0 con 0x7fb3540add30 2024-08-17T02:46:27.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.841+0000 7fb34a000640 1 -- 172.21.15.2:0/1731484105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c005dd0 con 0x7fb3540add30 2024-08-17T02:46:27.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.841+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3540a92a0 con 0x7fb3540add30 2024-08-17T02:46:27.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.842+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3540a9810 con 0x7fb3540add30 2024-08-17T02:46:27.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.843+0000 7fb34a000640 1 -- 172.21.15.2:0/1731484105 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb33c007300 con 0x7fb3540add30 2024-08-17T02:46:27.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.844+0000 7fb34a000640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb330065150 0x7fb330067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:27.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.844+0000 7fb34a000640 1 -- 172.21.15.2:0/1731484105 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb33c081c10 con 0x7fb3540add30 2024-08-17T02:46:27.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.844+0000 7fb352a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb330065150 0x7fb330067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:27.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.845+0000 7fb352a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb330065150 0x7fb330067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb344034000 tx=0x7fb344032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:27.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:27.848+0000 7fb34a000640 1 -- 172.21.15.2:0/1731484105 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3540a9810 con 0x7fb3540add30 2024-08-17T02:46:28.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.032+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb35415b5e0 con 0x7fb3540add30 2024-08-17T02:46:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.032+0000 7fb34a000640 1 -- 172.21.15.2:0/1731484105 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fb35415b5e0 con 0x7fb3540add30 2024-08-17T02:46:28.033 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:28.034 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb330065150 msgr2=0x7fb330067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb330065150 0x7fb330067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb344034000 tx=0x7fb344032000 comp rx=0 tx=0).stop 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540add30 msgr2=0x7fb3540aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540add30 0x7fb3540aad20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c810 tx=0x7fb33c007bc0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 shutdown_connections 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb330065150 0x7fb330067600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3540ca050 0x7fb3541463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3540add30 0x7fb3540aad20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.034+0000 7fb359a00640 1 --2- 172.21.15.2:0/1731484105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3540ad960 0x7fb354157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.035+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 >> 172.21.15.2:0/1731484105 conn(0x7fb354066e60 msgr2=0x7fb3541561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.035+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 shutdown_connections 2024-08-17T02:46:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.035+0000 7fb359a00640 1 -- 172.21.15.2:0/1731484105 wait complete. 2024-08-17T02:46:28.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:28.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.201+0000 7fcbc7e00640 1 Processor -- start 2024-08-17T02:46:28.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.201+0000 7fcbc7e00640 1 -- start start 2024-08-17T02:46:28.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.202+0000 7fcbc7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcbc00ad960 0x7fcbc015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.202+0000 7fcbc7e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.202+0000 7fcbc7e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc015b5e0 con 0x7fcbc00ca050 2024-08-17T02:46:28.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.202+0000 7fcbc7e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00cb160 con 0x7fcbc00ad960 2024-08-17T02:46:28.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.202+0000 7fcbc7e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00b0d10 con 0x7fcbc00add30 2024-08-17T02:46:28.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbc4a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcbc00ca050 0x7fcbc0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56610/0 (socket says 172.21.15.2:56610) 2024-08-17T02:46:28.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbc4a00640 1 -- 172.21.15.2:0/139164831 learned_addr learned my addr 172.21.15.2:0/139164831 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbc5400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcbc00ad960 0x7fcbc015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbc5e00640 1 --2- 172.21.15.2:0/139164831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbc5400640 1 -- 172.21.15.2:0/139164831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 msgr2=0x7fcbc0156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbc5400640 1 --2- 172.21.15.2:0/139164831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbc5400640 1 -- 172.21.15.2:0/139164831 >> v1:172.21.15.2:6789/0 conn(0x7fcbc00ca050 legacy=0x7fcbc0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbc5400640 1 -- 172.21.15.2:0/139164831 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00ca550 con 0x7fcbc00ad960 2024-08-17T02:46:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.203+0000 7fcbbfe00640 1 -- 172.21.15.2:0/139164831 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919755881 0 0) 0x7fcbac001110 con 0x7fcbc00ca050 2024-08-17T02:46:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.204+0000 7fcbc5400640 1 --2- 172.21.15.2:0/139164831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ad960 0x7fcbc015b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009850 tx=0x7fcbb40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69f5575b2cd9329 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.204+0000 7fcbbfe00640 1 -- 172.21.15.2:0/139164831 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb402ae10 con 0x7fcbc00ad960 2024-08-17T02:46:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbbfe00640 1 -- 172.21.15.2:0/139164831 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb4032440 con 0x7fcbc00ad960 2024-08-17T02:46:28.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbbfe00640 1 -- 172.21.15.2:0/139164831 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40327e0 con 0x7fcbc00ad960 2024-08-17T02:46:28.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbc7e00640 1 -- 172.21.15.2:0/139164831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ad960 msgr2=0x7fcbc015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/139164831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ad960 0x7fcbc015b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009850 tx=0x7fcbb40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbc7e00640 1 -- 172.21.15.2:0/139164831 shutdown_connections 2024-08-17T02:46:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/139164831 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/139164831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ad960 0x7fcbc015b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbc7e00640 1 -- 172.21.15.2:0/139164831 >> 172.21.15.2:0/139164831 conn(0x7fcbc0066e60 msgr2=0x7fcbc0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbc7e00640 1 -- 172.21.15.2:0/139164831 shutdown_connections 2024-08-17T02:46:28.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.205+0000 7fcbc7e00640 1 -- 172.21.15.2:0/139164831 wait complete. 2024-08-17T02:46:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.207+0000 7fcbc7e00640 1 Processor -- start 2024-08-17T02:46:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.207+0000 7fcbc7e00640 1 -- start start 2024-08-17T02:46:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc7e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc00ad960 0x7fcbc00ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc7e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ca050 0x7fcbc00a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc7e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0143950 con 0x7fcbc00ca050 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc7e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00a9c50 con 0x7fcbc00ad960 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc7e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc015cc90 con 0x7fcbc00add30 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ca050 0x7fcbc00a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ca050 0x7fcbc00a9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38024/0 (socket says 172.21.15.2:38024) 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5e00640 1 -- 172.21.15.2:0/928443973 learned_addr learned my addr 172.21.15.2:0/928443973 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5400640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc00ad960 0x7fcbc00ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc4a00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5e00640 1 -- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 msgr2=0x7fcbc0143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5e00640 1 -- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc00ad960 msgr2=0x7fcbc00ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc00ad960 0x7fcbc00ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5e00640 1 -- 172.21.15.2:0/928443973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4009390 con 0x7fcbc00ca050 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc5400640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc00ad960 0x7fcbc00ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.208+0000 7fcbc4a00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.209+0000 7fcbc5e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ca050 0x7fcbc00a9710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009e90 tx=0x7fcbb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.209+0000 7fcbbcc00640 1 -- 172.21.15.2:0/928443973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800ce10 con 0x7fcbc00ca050 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.209+0000 7fcbbcc00640 1 -- 172.21.15.2:0/928443973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb800f040 con 0x7fcbc00ca050 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.209+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc00aa720 con 0x7fcbc00ca050 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.209+0000 7fcbbcc00640 1 -- 172.21.15.2:0/928443973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80146d0 con 0x7fcbc00ca050 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.209+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc00aa160 con 0x7fcbc00ca050 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.210+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc015ca60 con 0x7fcbc00ca050 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.211+0000 7fcbbcc00640 1 -- 172.21.15.2:0/928443973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcbb8014a40 con 0x7fcbc00ca050 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.212+0000 7fcbbcc00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fcba0065150 0x7fcba0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:28.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.212+0000 7fcbbcc00640 1 -- 172.21.15.2:0/928443973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcbb80832c0 con 0x7fcbc00ca050 2024-08-17T02:46:28.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.212+0000 7fcbc5400640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fcba0065150 0x7fcba0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:28.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.212+0000 7fcbc5400640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fcba0065150 0x7fcba0067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4034000 tx=0x7fcbb4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:28.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.216+0000 7fcbbcc00640 1 -- 172.21.15.2:0/928443973 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcbc015ca60 con 0x7fcbc00ca050 2024-08-17T02:46:28.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.434+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbc015ca60 con 0x7fcbc00ca050 2024-08-17T02:46:28.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.434+0000 7fcbbcc00640 1 -- 172.21.15.2:0/928443973 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fcbc015ca60 con 0x7fcbc00ca050 2024-08-17T02:46:28.436 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:28.436 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:13.176093+0000","modified":"2024-08-17T02:46:16.759354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:28.436 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fcba0065150 msgr2=0x7fcba0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fcba0065150 0x7fcba0067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4034000 tx=0x7fcbb4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ca050 msgr2=0x7fcbc00a9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ca050 0x7fcbc00a9710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009e90 tx=0x7fcbb800b040 comp rx=0 tx=0).stop 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 shutdown_connections 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbc00ca050 0x7fcbc00a9710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fcba0065150 0x7fcba0067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fcbc00add30 0x7fcbc0143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 --2- 172.21.15.2:0/928443973 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc00ad960 0x7fcbc00ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.436+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 >> 172.21.15.2:0/928443973 conn(0x7fcbc0066e60 msgr2=0x7fcbc01544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:28.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.437+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 shutdown_connections 2024-08-17T02:46:28.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:28.437+0000 7fcbc7e00640 1 -- 172.21.15.2:0/928443973 wait complete. 2024-08-17T02:46:28.856 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:46:13.176093+0000', 'modified': '2024-08-17T02:46:16.759354+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.26:6835/4209722818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6833', 'nonce': 4209722818}, {'type': 'v1', 'addr': '172.21.15.26:6835', 'nonce': 4209722818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:46:28.856 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:46:28.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:46:29.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.012+0000 7fb2a6c00640 1 Processor -- start 2024-08-17T02:46:29.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.012+0000 7fb2a6c00640 1 -- start start 2024-08-17T02:46:29.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.013+0000 7fb2a6c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2a00ca050 0x7fb2a0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.013+0000 7fb2a6c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2a00add30 0x7fb2a015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.013+0000 7fb2a6c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a015b5e0 con 0x7fb2a00ad960 2024-08-17T02:46:29.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.013+0000 7fb2a6c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00cb160 con 0x7fb2a00add30 2024-08-17T02:46:29.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.013+0000 7fb2a6c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00b0d10 con 0x7fb2a00ca050 2024-08-17T02:46:29.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.013+0000 7fb29fe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb2a00ad960 0x7fb2a0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56622/0 (socket says 172.21.15.2:56622) 2024-08-17T02:46:29.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.013+0000 7fb29fe00640 1 -- 172.21.15.2:0/222034459 learned_addr learned my addr 172.21.15.2:0/222034459 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:29.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.014+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/222034459 >> v2:172.21.15.2:3300/0 conn(0x7fb2a00add30 0x7fb2a015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.014+0000 7fb29f400640 1 --2- 172.21.15.2:0/222034459 >> v2:172.21.15.26:3300/0 conn(0x7fb2a00ca050 0x7fb2a0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.014+0000 7fb29ea00640 1 -- 172.21.15.2:0/222034459 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984913937 0 0) 0x7fb290001110 con 0x7fb2a00ad960 2024-08-17T02:46:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.014+0000 7fb29ea00640 1 -- 172.21.15.2:0/222034459 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2840034e0 con 0x7fb2a00ad960 2024-08-17T02:46:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.014+0000 7fb2a4c00640 1 -- 172.21.15.2:0/222034459 >> v2:172.21.15.26:3300/0 conn(0x7fb2a00ca050 msgr2=0x7fb2a0156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.014+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/222034459 >> v2:172.21.15.26:3300/0 conn(0x7fb2a00ca050 0x7fb2a0156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.014+0000 7fb2a4c00640 1 -- 172.21.15.2:0/222034459 >> v1:172.21.15.2:6789/0 conn(0x7fb2a00ad960 legacy=0x7fb2a0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.014+0000 7fb2a4c00640 1 -- 172.21.15.2:0/222034459 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00ca550 con 0x7fb2a00add30 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.015+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/222034459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00add30 0x7fb2a015b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0063600 tx=0x7fb298009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6fbfb2fd6963e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.015+0000 7fb29ea00640 1 -- 172.21.15.2:0/222034459 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298007550 con 0x7fb2a00add30 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.015+0000 7fb29ea00640 1 -- 172.21.15.2:0/222034459 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29802d050 con 0x7fb2a00add30 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.015+0000 7fb29ea00640 1 -- 172.21.15.2:0/222034459 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298007920 con 0x7fb2a00add30 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.016+0000 7fb2a6c00640 1 -- 172.21.15.2:0/222034459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00add30 msgr2=0x7fb2a015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.016+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/222034459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00add30 0x7fb2a015b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0063600 tx=0x7fb298009780 comp rx=0 tx=0).stop 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.016+0000 7fb2a6c00640 1 -- 172.21.15.2:0/222034459 shutdown_connections 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.016+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/222034459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00add30 0x7fb2a015b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.016+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/222034459 >> v2:172.21.15.26:3300/0 conn(0x7fb2a00ca050 0x7fb2a0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.016+0000 7fb2a6c00640 1 -- 172.21.15.2:0/222034459 >> 172.21.15.2:0/222034459 conn(0x7fb2a0066e60 msgr2=0x7fb2a0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.016+0000 7fb2a6c00640 1 -- 172.21.15.2:0/222034459 shutdown_connections 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.016+0000 7fb2a6c00640 1 -- 172.21.15.2:0/222034459 wait complete. 2024-08-17T02:46:29.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.017+0000 7fb2a6c00640 1 Processor -- start 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.018+0000 7fb2a6c00640 1 -- start start 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.018+0000 7fb2a6c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2a00ad960 0x7fb2a00a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.018+0000 7fb2a6c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a00add30 0x7fb2a00ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.018+0000 7fb2a6c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00ca050 0x7fb2a00ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.018+0000 7fb2a6c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0154ba0 con 0x7fb2a00ca050 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.018+0000 7fb2a6c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0169840 con 0x7fb2a00add30 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.018+0000 7fb2a6c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a00a88e0 con 0x7fb2a00ad960 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00ca050 0x7fb2a00ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb29f400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a00add30 0x7fb2a00ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00ca050 0x7fb2a00ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38032/0 (socket says 172.21.15.2:38032) 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 -- 172.21.15.2:0/853545221 learned_addr learned my addr 172.21.15.2:0/853545221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb29fe00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2a00ad960 0x7fb2a00a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 -- 172.21.15.2:0/853545221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2a00ad960 msgr2=0x7fb2a00a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2a00ad960 0x7fb2a00a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 -- 172.21.15.2:0/853545221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a00add30 msgr2=0x7fb2a00ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a00add30 0x7fb2a00ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 -- 172.21.15.2:0/853545221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298009a20 con 0x7fb2a00ca050 2024-08-17T02:46:29.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.019+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00ca050 0x7fb2a00ac9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb298009e90 tx=0x7fb298037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.020+0000 7fb297400640 1 -- 172.21.15.2:0/853545221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298031890 con 0x7fb2a00ca050 2024-08-17T02:46:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.020+0000 7fb297400640 1 -- 172.21.15.2:0/853545221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb298040070 con 0x7fb2a00ca050 2024-08-17T02:46:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.020+0000 7fb2a6c00640 1 -- 172.21.15.2:0/853545221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a00a8bc0 con 0x7fb2a00ca050 2024-08-17T02:46:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.020+0000 7fb297400640 1 -- 172.21.15.2:0/853545221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298031c20 con 0x7fb2a00ca050 2024-08-17T02:46:29.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.020+0000 7fb2a6c00640 1 -- 172.21.15.2:0/853545221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a00a9180 con 0x7fb2a00ca050 2024-08-17T02:46:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.021+0000 7fb297400640 1 -- 172.21.15.2:0/853545221 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb298042030 con 0x7fb2a00ca050 2024-08-17T02:46:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.022+0000 7fb297400640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb280065150 0x7fb280067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.022+0000 7fb297400640 1 -- 172.21.15.2:0/853545221 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2980a3820 con 0x7fb2a00ca050 2024-08-17T02:46:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.023+0000 7fb29fe00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb280065150 0x7fb280067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.023+0000 7fb2a91e2740 1 Processor -- start 2024-08-17T02:46:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.023+0000 7fb29fe00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb280065150 0x7fb280067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb290001270 tx=0x7fb290007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.023+0000 7fb2a91e2740 1 -- start start 2024-08-17T02:46:29.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49e06e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49de20a0 0x55aa49e245d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e24b10 0x55aa49ddb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa49d9c380 con 0x55aa49de20a0 2024-08-17T02:46:29.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa49d459e0 con 0x55aa49e06a30 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa49d43170 con 0x55aa49e24b10 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb29f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49de20a0 0x55aa49e245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb29f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49de20a0 0x55aa49e245d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38046/0 (socket says 172.21.15.2:38046) 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb29f400640 1 -- 172.21.15.2:0/698333916 learned_addr learned my addr 172.21.15.2:0/698333916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb29fe00640 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49e06e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.024+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e24b10 0x55aa49ddb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb29f400640 1 -- 172.21.15.2:0/698333916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e24b10 msgr2=0x55aa49ddb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb29f400640 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e24b10 0x55aa49ddb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb29f400640 1 -- 172.21.15.2:0/698333916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 msgr2=0x55aa49e06e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb29f400640 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49e06e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb29f400640 1 -- 172.21.15.2:0/698333916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa49cf2820 con 0x55aa49de20a0 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb29f400640 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49de20a0 0x55aa49e245d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009cc0 tx=0x7fb28c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c28eef4161c8eb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb28be00640 1 -- 172.21.15.2:0/698333916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c011e60 con 0x55aa49de20a0 2024-08-17T02:46:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb28be00640 1 -- 172.21.15.2:0/698333916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c014440 con 0x55aa49de20a0 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.025+0000 7fb28be00640 1 -- 172.21.15.2:0/698333916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0147e0 con 0x55aa49de20a0 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 -- 172.21.15.2:0/698333916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49de20a0 msgr2=0x55aa49e245d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49de20a0 0x55aa49e245d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009cc0 tx=0x7fb28c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 -- 172.21.15.2:0/698333916 shutdown_connections 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e24b10 0x55aa49ddb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49de20a0 0x55aa49e245d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/698333916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49e06e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 -- 172.21.15.2:0/698333916 >> 172.21.15.2:0/698333916 conn(0x55aa49d7a030 msgr2=0x55aa49e28c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 -- 172.21.15.2:0/698333916 shutdown_connections 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 -- 172.21.15.2:0/698333916 wait complete. 2024-08-17T02:46:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.026+0000 7fb2a91e2740 1 -- start start 2024-08-17T02:46:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.027+0000 7fb2a91e2740 1 Processor -- start 2024-08-17T02:46:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 0x55aa49e0d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e06a30 0x55aa49e23b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e24b10 0x55aa49e24070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa49d3ef60 con 0x55aa49e06a30 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa49ce7690 con 0x55aa49e24b10 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa49ce7330 con 0x55aa49de20a0 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a91e2740 10 client.0 _ll_register_callbacks cb 0x55aa49ce12b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e06a30 0x55aa49e23b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e06a30 0x55aa49e23b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38050/0 (socket says 172.21.15.2:38050) 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29f400640 1 -- 172.21.15.2:0/1191221329 learned_addr learned my addr 172.21.15.2:0/1191221329 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29fe00640 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 0x55aa49e0d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e24b10 0x55aa49e24070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29f400640 1 -- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 msgr2=0x55aa49e0d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29f400640 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 0x55aa49e0d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29f400640 1 -- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e24b10 msgr2=0x55aa49e24070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29f400640 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e24b10 0x55aa49e24070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb29f400640 1 -- 172.21.15.2:0/1191221329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c009970 con 0x55aa49e06a30 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.028+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e24b10 0x55aa49e24070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb29f400640 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e06a30 0x55aa49e23b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb28c018000 tx=0x7fb28c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75fc7b424e43307 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb288c00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb288c00640 1 -- 172.21.15.2:0/1191221329 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0147c0 con 0x55aa49e06a30 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb288c00640 1 -- 172.21.15.2:0/1191221329 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb28c018030 con 0x55aa49e06a30 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1191221329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa49d72d20 con 0x55aa49e06a30 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb288c00640 1 -- 172.21.15.2:0/1191221329 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb28c014de0 con 0x55aa49e06a30 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb2a91e2740 10 client.4659 fetch_fsmap learned FSMap version 7 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1191221329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55aa49d08ab0 con 0x55aa49e06a30 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb288c00640 1 -- 172.21.15.2:0/1191221329 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aa49d72d20 con 0x55aa49e06a30 2024-08-17T02:46:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.029+0000 7fb288c00640 1 -- 172.21.15.2:0/1191221329 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb28c01d430 con 0x55aa49e06a30 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb2a91e2740 10 client.4659 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb2a91e2740 10 client.4659 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb2a91e2740 20 client.4659 populate_metadata read hostname 'smithi002' 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] conn(0x55aa49e388c0 0x55aa49e01790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb2a91e2740 4 client.4659 mds_command: new command op to 4296 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1191221329 --> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa49a463c0 con 0x55aa49e388c0 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb29fe00640 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] conn(0x55aa49e388c0 0x55aa49e01790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb29fe00640 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] conn(0x55aa49e388c0 0x55aa49e01790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fe929c029c50c89 server_cookie=38c871ebfc3d6fc3 in_seq=0 out_seq=0 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.030+0000 7fb288c00640 10 client.4659 ms_handle_connect on v2:172.21.15.26:6833/4209722818 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb288c00640 1 -- 172.21.15.2:0/1191221329 <== mds.0 v2:172.21.15.26:6833/4209722818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55aa49a463c0 con 0x55aa49e388c0 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb288c00640 10 client.4659 handle_command_reply: tid=0 2024-08-17T02:46:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 client.4659 shutdown 2024-08-17T02:46:29.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1191221329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e06a30 msgr2=0x55aa49e23b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e06a30 0x55aa49e23b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb28c018000 tx=0x7fb28c01c000 comp rx=0 tx=0).stop 2024-08-17T02:46:29.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1191221329 shutdown_connections 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] conn(0x55aa49e388c0 0x55aa49e01790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e24b10 0x55aa49e24070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e06a30 0x55aa49e23b30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1191221329 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 0x55aa49e0d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1191221329 >> 172.21.15.2:0/1191221329 conn(0x55aa49d7a030 msgr2=0x55aa49e22790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb288c00640 0 client.4659 ms_handle_reset on v2:172.21.15.26:6833/4209722818 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1191221329 shutdown_connections 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1191221329 wait complete. 2024-08-17T02:46:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.032+0000 7fb2a91e2740 20 client.4659 trim_cache size 0 max 16384 2024-08-17T02:46:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.048+0000 7fb2a91e2740 1 Processor -- start 2024-08-17T02:46:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.048+0000 7fb2a91e2740 1 -- start start 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49de20a0 0x55aa49e28c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e06a30 0x55aa49e01d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49e23ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa49ab9f20 con 0x55aa49e24b10 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa49ddbf60 con 0x55aa49de20a0 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa49e40000 con 0x55aa49e06a30 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49e23ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49e23ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38054/0 (socket says 172.21.15.2:38054) 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb2a4c00640 1 -- 172.21.15.2:0/1654766815 learned_addr learned my addr 172.21.15.2:0/1654766815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb29f400640 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e06a30 0x55aa49e01d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.049+0000 7fb29fe00640 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49de20a0 0x55aa49e28c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb2a4c00640 1 -- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e06a30 msgr2=0x55aa49e01d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e06a30 0x55aa49e01d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb2a4c00640 1 -- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49de20a0 msgr2=0x55aa49e28c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49de20a0 0x55aa49e28c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb2a4c00640 1 -- 172.21.15.2:0/1654766815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa49d0c490 con 0x55aa49e24b10 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb29fe00640 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49de20a0 0x55aa49e28c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49e23ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2980099f0 tx=0x7fb298078040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ff80d966cda342 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb294c00640 1 -- 172.21.15.2:0/1654766815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298078750 con 0x55aa49e24b10 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb294c00640 1 -- 172.21.15.2:0/1654766815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29808a070 con 0x55aa49e24b10 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb294c00640 1 -- 172.21.15.2:0/1654766815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29807c4a0 con 0x55aa49e24b10 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1654766815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 msgr2=0x55aa49e23ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.050+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49e23ab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2980099f0 tx=0x7fb298078040 comp rx=0 tx=0).stop 2024-08-17T02:46:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.051+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1654766815 shutdown_connections 2024-08-17T02:46:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.051+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49e23ab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.051+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49e06a30 0x55aa49e01d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.051+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1654766815 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49de20a0 0x55aa49e28c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.051+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1654766815 >> 172.21.15.2:0/1654766815 conn(0x55aa49d7a030 msgr2=0x55aa49dd6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.051+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1654766815 shutdown_connections 2024-08-17T02:46:29.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.051+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1654766815 wait complete. 2024-08-17T02:46:29.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.051+0000 7fb2a91e2740 1 -- start start 2024-08-17T02:46:29.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.052+0000 7fb2a91e2740 1 Processor -- start 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.052+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 0x55aa49e75960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.052+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49ddf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.052+0000 7fb2a91e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49ddfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.052+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa49e27fb0 con 0x55aa49e24b10 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa49e90740 con 0x55aa49e06a30 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a91e2740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa49e03040 con 0x55aa49de20a0 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a91e2740 10 client.0 _ll_register_callbacks cb 0x7fb290007ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49ddfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49ddfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38058/0 (socket says 172.21.15.2:38058) 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 -- 172.21.15.2:0/1396119120 learned_addr learned my addr 172.21.15.2:0/1396119120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb29fe00640 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 0x55aa49e75960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb29f400640 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49ddf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 -- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 msgr2=0x55aa49e75960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 0x55aa49e75960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 -- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 msgr2=0x55aa49ddf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49ddf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 -- 172.21.15.2:0/1396119120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a00a9180 con 0x55aa49e24b10 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb29f400640 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49ddf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb2a4c00640 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49ddfab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb298071ab0 tx=0x7fb29808a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ae0b3ef612df36 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb288c00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb288c00640 1 -- 172.21.15.2:0/1396119120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2980902c0 con 0x55aa49e24b10 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.053+0000 7fb288c00640 1 -- 172.21.15.2:0/1396119120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb298071cc0 con 0x55aa49e24b10 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1396119120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb28c014440 con 0x55aa49e24b10 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb288c00640 1 -- 172.21.15.2:0/1396119120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb298071e80 con 0x55aa49e24b10 2024-08-17T02:46:29.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 10 client.4665 fetch_fsmap learned FSMap version 7 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1396119120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55aa49d0c1e0 con 0x55aa49e24b10 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb288c00640 1 -- 172.21.15.2:0/1396119120 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c014440 con 0x55aa49e24b10 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb288c00640 1 -- 172.21.15.2:0/1396119120 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb298038040 con 0x55aa49e24b10 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 10 client.4665 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 10 client.4665 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 20 client.4665 populate_metadata read hostname 'smithi002' 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] conn(0x55aa49e00690 0x55aa49e00a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 4 client.4665 mds_command: new command op to 4296 tid=0[{"prefix": "status"}] 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1396119120 --> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55aa49a576c0 con 0x55aa49e00690 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.054+0000 7fb29fe00640 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] conn(0x55aa49e00690 0x55aa49e00a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.055+0000 7fb29fe00640 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] conn(0x55aa49e00690 0x55aa49e00a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=634c09a69cecabba server_cookie=c9c69e90f6916860 in_seq=0 out_seq=0 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.055+0000 7fb288c00640 10 client.4665 ms_handle_connect on v2:172.21.15.26:6833/4209722818 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.055+0000 7fb288c00640 1 -- 172.21.15.2:0/1396119120 <== mds.0 v2:172.21.15.26:6833/4209722818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55aa49a576c0 con 0x55aa49e00690 2024-08-17T02:46:29.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.055+0000 7fb288c00640 10 client.4665 handle_command_reply: tid=0 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.055+0000 7fb2a91e2740 1 client.4665 shutdown 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.055+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1396119120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 msgr2=0x55aa49ddfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.055+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49ddfab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb298071ab0 tx=0x7fb29808a000 comp rx=0 tx=0).stop 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1396119120 shutdown_connections 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:6833/4209722818,v1:172.21.15.26:6835/4209722818] conn(0x55aa49e00690 0x55aa49e00a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55aa49e24b10 0x55aa49ddfab0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55aa49e06a30 0x55aa49ddf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 1 --2- 172.21.15.2:0/1396119120 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55aa49de20a0 0x55aa49e75960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb288c00640 0 client.4665 ms_handle_reset on v2:172.21.15.26:6833/4209722818 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1396119120 >> 172.21.15.2:0/1396119120 conn(0x55aa49d7a030 msgr2=0x55aa49e01d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1396119120 shutdown_connections 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 1 -- 172.21.15.2:0/1396119120 wait complete. 2024-08-17T02:46:29.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a91e2740 20 client.4665 trim_cache size 0 max 16384 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "f19c300a-c18c-4d11-a652-563f33592040", 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4296, 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 15.306695327, 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 7, 2024-08-17T02:46:29.062 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 21, 2024-08-17T02:46:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:46:29.063 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 22.783380832999999 2024-08-17T02:46:29.063 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:46:29.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a6c00640 1 -- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb280065150 msgr2=0x7fb280067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb280065150 0x7fb280067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb290001270 tx=0x7fb290007b60 comp rx=0 tx=0).stop 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a6c00640 1 -- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00ca050 msgr2=0x7fb2a00ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.056+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00ca050 0x7fb2a00ac9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb298009e90 tx=0x7fb298037000 comp rx=0 tx=0).stop 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.057+0000 7fb2a6c00640 1 -- 172.21.15.2:0/853545221 shutdown_connections 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.057+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a00ca050 0x7fb2a00ac9d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.057+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2a00add30 0x7fb2a00ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.057+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb280065150 0x7fb280067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.057+0000 7fb2a6c00640 1 --2- 172.21.15.2:0/853545221 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb2a00ad960 0x7fb2a00a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.057+0000 7fb2a6c00640 1 -- 172.21.15.2:0/853545221 >> 172.21.15.2:0/853545221 conn(0x7fb2a0066e60 msgr2=0x7fb2a0152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.057+0000 7fb2a6c00640 1 -- 172.21.15.2:0/853545221 shutdown_connections 2024-08-17T02:46:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.057+0000 7fb2a6c00640 1 -- 172.21.15.2:0/853545221 wait complete. 2024-08-17T02:46:29.073 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:46:29.097 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:46:29.097 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:46:29.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:29.097 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:46:29.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:29.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-17T02:46:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-08-17T02:46:29.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:46:29.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:29.236 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:46:29.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:29.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-17T02:46:29.369 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-08-17T02:46:29.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:46:29.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:29.372 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-08-17T02:46:29.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:29.413 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-08-17T02:46:29.517 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2024-08-17T02:46:29.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:46:29.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:29.521 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-08-17T02:46:29.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:29.558 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-08-17T02:46:29.658 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2024-08-17T02:46:29.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:46:29.661 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:46:29.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:29.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.814+0000 7f7101800640 1 Processor -- start 2024-08-17T02:46:29.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.814+0000 7f7101800640 1 -- start start 2024-08-17T02:46:29.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f7101800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70fc0afca0 0x7f70fc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f7101800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70fc1590b0 0x7f70fc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f7101800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc15a4e0 con 0x7f70fc0acf10 2024-08-17T02:46:29.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f7101800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0b0980 con 0x7f70fc1590b0 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f7101800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0c92b0 con 0x7f70fc0afca0 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70fb400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70fc1590b0 0x7f70fc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70fb400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f70fc1590b0 0x7f70fc159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38070/0 (socket says 172.21.15.2:38070) 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70fb400640 1 -- 172.21.15.2:0/3204552759 learned_addr learned my addr 172.21.15.2:0/3204552759 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70faa00640 1 --2- 172.21.15.2:0/3204552759 >> v2:172.21.15.26:3300/0 conn(0x7f70fc0afca0 0x7f70fc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70fb400640 1 -- 172.21.15.2:0/3204552759 >> v2:172.21.15.26:3300/0 conn(0x7f70fc0afca0 msgr2=0x7f70fc0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70fb400640 1 --2- 172.21.15.2:0/3204552759 >> v2:172.21.15.26:3300/0 conn(0x7f70fc0afca0 0x7f70fc0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70fb400640 1 -- 172.21.15.2:0/3204552759 >> v1:172.21.15.26:6789/0 conn(0x7f70fc0acf10 legacy=0x7f70fc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70fb400640 1 -- 172.21.15.2:0/3204552759 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0ad480 con 0x7f70fc1590b0 2024-08-17T02:46:29.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.816+0000 7f70faa00640 1 --2- 172.21.15.2:0/3204552759 >> v2:172.21.15.26:3300/0 conn(0x7f70fc0afca0 0x7f70fc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.817+0000 7f70fb400640 1 --2- 172.21.15.2:0/3204552759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc1590b0 0x7f70fc159fa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70fc067e40 tx=0x7f70f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae2efd6665681ec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f70fa000640 1 -- 172.21.15.2:0/3204552759 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f402e050 con 0x7f70fc1590b0 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f70fa000640 1 -- 172.21.15.2:0/3204552759 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f4007400 con 0x7f70fc1590b0 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f70fa000640 1 -- 172.21.15.2:0/3204552759 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40077e0 con 0x7f70fc1590b0 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f7101800640 1 -- 172.21.15.2:0/3204552759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc1590b0 msgr2=0x7f70fc159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f7101800640 1 --2- 172.21.15.2:0/3204552759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc1590b0 0x7f70fc159fa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70fc067e40 tx=0x7f70f4009840 comp rx=0 tx=0).stop 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f7101800640 1 -- 172.21.15.2:0/3204552759 shutdown_connections 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f7101800640 1 --2- 172.21.15.2:0/3204552759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc1590b0 0x7f70fc159fa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f7101800640 1 --2- 172.21.15.2:0/3204552759 >> v2:172.21.15.26:3300/0 conn(0x7f70fc0afca0 0x7f70fc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f7101800640 1 -- 172.21.15.2:0/3204552759 >> 172.21.15.2:0/3204552759 conn(0x7f70fc066e60 msgr2=0x7f70fc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f7101800640 1 -- 172.21.15.2:0/3204552759 shutdown_connections 2024-08-17T02:46:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.818+0000 7f7101800640 1 -- 172.21.15.2:0/3204552759 wait complete. 2024-08-17T02:46:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.820+0000 7f7101800640 1 Processor -- start 2024-08-17T02:46:29.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.820+0000 7f7101800640 1 -- start start 2024-08-17T02:46:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f7101800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc0acf10 0x7f70fc0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f7101800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc0afca0 0x7f70fc166f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f7101800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70fc1590b0 0x7f70fc1674d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f7101800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc140e70 con 0x7f70fc0acf10 2024-08-17T02:46:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f7101800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc168160 con 0x7f70fc0afca0 2024-08-17T02:46:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f7101800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc167ac0 con 0x7f70fc1590b0 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f70faa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc0acf10 0x7f70fc0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f70faa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc0acf10 0x7f70fc0c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38086/0 (socket says 172.21.15.2:38086) 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f70faa00640 1 -- 172.21.15.2:0/3481281098 learned_addr learned my addr 172.21.15.2:0/3481281098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f70f2000640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc0afca0 0x7f70fc166f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f70fb400640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70fc1590b0 0x7f70fc1674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f70faa00640 1 -- 172.21.15.2:0/3481281098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70fc1590b0 msgr2=0x7f70fc1674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.821+0000 7f70faa00640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70fc1590b0 0x7f70fc1674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f70faa00640 1 -- 172.21.15.2:0/3481281098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc0afca0 msgr2=0x7f70fc166f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f70faa00640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc0afca0 0x7f70fc166f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f70faa00640 1 -- 172.21.15.2:0/3481281098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4009ae0 con 0x7f70fc0acf10 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f70faa00640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc0acf10 0x7f70fc0c5140 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00d890 tx=0x7f70ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f70f2a00640 1 -- 172.21.15.2:0/3481281098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00de80 con 0x7f70fc0acf10 2024-08-17T02:46:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f70f2a00640 1 -- 172.21.15.2:0/3481281098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec00b8d0 con 0x7f70fc0acf10 2024-08-17T02:46:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f70f2a00640 1 -- 172.21.15.2:0/3481281098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00bc90 con 0x7f70fc0acf10 2024-08-17T02:46:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc167da0 con 0x7f70fc0acf10 2024-08-17T02:46:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.822+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc168710 con 0x7f70fc0acf10 2024-08-17T02:46:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.823+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc0c6f90 con 0x7f70fc0acf10 2024-08-17T02:46:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.824+0000 7f70f2a00640 1 -- 172.21.15.2:0/3481281098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f70ec01e460 con 0x7f70fc0acf10 2024-08-17T02:46:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.825+0000 7f70f2a00640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f70d8065150 0x7f70d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.825+0000 7f70f2a00640 1 -- 172.21.15.2:0/3481281098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70ec082bd0 con 0x7f70fc0acf10 2024-08-17T02:46:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.825+0000 7f70f2000640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f70d8065150 0x7f70d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:29.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.826+0000 7f70f2000640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f70d8065150 0x7f70d8067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f70e4003720 tx=0x7f70e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:29.829+0000 7f70f2a00640 1 -- 172.21.15.2:0/3481281098 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f70ec050bf0 con 0x7f70fc0acf10 2024-08-17T02:46:30.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.053+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f70fc063fb0 con 0x7f70fc0acf10 2024-08-17T02:46:30.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.053+0000 7f70f2a00640 1 -- 172.21.15.2:0/3481281098 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f70ec054210 con 0x7f70fc0acf10 2024-08-17T02:46:30.054 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:30.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f70d8065150 msgr2=0x7f70d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:30.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f70d8065150 0x7f70d8067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f70e4003720 tx=0x7f70e4009040 comp rx=0 tx=0).stop 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc0acf10 msgr2=0x7f70fc0c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc0acf10 0x7f70fc0c5140 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00d890 tx=0x7f70ec008040 comp rx=0 tx=0).stop 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 shutdown_connections 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f70d8065150 0x7f70d8067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f70fc1590b0 0x7f70fc1674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70fc0afca0 0x7f70fc166f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 --2- 172.21.15.2:0/3481281098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc0acf10 0x7f70fc0c5140 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 >> 172.21.15.2:0/3481281098 conn(0x7f70fc066e60 msgr2=0x7f70fc0c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 shutdown_connections 2024-08-17T02:46:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:30.055+0000 7f7101800640 1 -- 172.21.15.2:0/3481281098 wait complete. 2024-08-17T02:46:30.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:46:30.071 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:30.071 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-08-17T02:46:30.071 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:46:30.071 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:30.071 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:46:30.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:46:30.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:30.072 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:46:30.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:30.072 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-08-17T02:46:30.107 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:30.107 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:30.107 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42632sec preferred_lft 42632sec 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:30.109 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-08-17T02:46:30.109 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:46:30.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:30.110 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:30.110 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:30.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:46:30.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-08-17T02:46:30.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-08-17T02:46:30.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:46:30.110 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:30.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:30.476 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:30.533 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-08-17T02:46:30.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:30.536 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-08-17T02:46:30.588 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-08-17T02:46:30.588 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:30.588 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:46:30.588 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:46:30.588 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:30.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:30.589 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:30.589 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:30.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:46:30.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:46:30.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:46:30.589 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:31.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:31.104 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:46:31.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:31.140 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-08-17T02:46:31.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:31.216 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:31.216 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:31.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:46:31.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:46:31.216 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:31.343 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:46:31.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:31.344 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:31.344 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:31.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:46:31.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:46:31.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:46:31.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:46:31.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:46:31.344 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:31.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:31.527 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:31.527 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:31.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-08-17T02:46:31.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:46:31.528 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:31.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:31.644 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:31.679 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:46:31.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:31.679 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:31.754 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:46:31.754 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:31.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:31.887 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:31.888 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:32.490 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:32.490 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:32.490 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.26:3300,172.21.15.26:3301" 2024-08-17T02:46:32.490 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@f19c300a-c18c-4d11-a652-563f33592040.cephfs=/ 2024-08-17T02:46:32.490 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.2:3300/172.21.15.26:3300/172.21.15.26:3301" will pass to kernel 2024-08-17T02:46:32.491 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:46:32.491 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:32.491 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:32.492 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:32.492 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:32.497 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:32.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:32.498 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:46:32.556 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:46:32.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.706+0000 7fd5e7200640 1 Processor -- start 2024-08-17T02:46:32.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.707+0000 7fd5e7200640 1 -- start start 2024-08-17T02:46:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5e7200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5e815b1f0 0x7fd5e80b1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5e7200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5e80ca3d0 0x7fd5e80ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5e7200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e80cad70 con 0x7fd5e80afe50 2024-08-17T02:46:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5e7200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e815b640 con 0x7fd5e815b1f0 2024-08-17T02:46:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5e7200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e80b0de0 con 0x7fd5e80ca3d0 2024-08-17T02:46:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5dfe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5e815b1f0 0x7fd5e80b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5e5e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd5e80afe50 0x7fd5e80b1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56636/0 (socket says 172.21.15.2:56636) 2024-08-17T02:46:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5e5e00640 1 -- 172.21.15.2:0/2214324852 learned_addr learned my addr 172.21.15.2:0/2214324852 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.708+0000 7fd5e6800640 1 --2- 172.21.15.2:0/2214324852 >> v2:172.21.15.26:3300/0 conn(0x7fd5e80ca3d0 0x7fd5e80ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.709+0000 7fd5dfe00640 1 -- 172.21.15.2:0/2214324852 >> v2:172.21.15.26:3300/0 conn(0x7fd5e80ca3d0 msgr2=0x7fd5e80ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.709+0000 7fd5dfe00640 1 --2- 172.21.15.2:0/2214324852 >> v2:172.21.15.26:3300/0 conn(0x7fd5e80ca3d0 0x7fd5e80ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.709+0000 7fd5dfe00640 1 -- 172.21.15.2:0/2214324852 >> v1:172.21.15.2:6789/0 conn(0x7fd5e80afe50 legacy=0x7fd5e80b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.709+0000 7fd5dfe00640 1 -- 172.21.15.2:0/2214324852 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e80b22c0 con 0x7fd5e815b1f0 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.709+0000 7fd5e5400640 1 -- 172.21.15.2:0/2214324852 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864970715 0 0) 0x7fd5d8001110 con 0x7fd5e80afe50 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.710+0000 7fd5dfe00640 1 --2- 172.21.15.2:0/2214324852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e80b1270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80635e0 tx=0x7fd5d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4248cd586a5604f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.710+0000 7fd5e5400640 1 -- 172.21.15.2:0/2214324852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d002ad20 con 0x7fd5e815b1f0 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.710+0000 7fd5e5400640 1 -- 172.21.15.2:0/2214324852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d002ae80 con 0x7fd5e815b1f0 2024-08-17T02:46:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.710+0000 7fd5e5400640 1 -- 172.21.15.2:0/2214324852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0032670 con 0x7fd5e815b1f0 2024-08-17T02:46:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.710+0000 7fd5e7200640 1 -- 172.21.15.2:0/2214324852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 msgr2=0x7fd5e80b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.710+0000 7fd5e7200640 1 --2- 172.21.15.2:0/2214324852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e80b1270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80635e0 tx=0x7fd5d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.711+0000 7fd5e7200640 1 -- 172.21.15.2:0/2214324852 shutdown_connections 2024-08-17T02:46:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.711+0000 7fd5e7200640 1 --2- 172.21.15.2:0/2214324852 >> v2:172.21.15.26:3300/0 conn(0x7fd5e80ca3d0 0x7fd5e80ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.711+0000 7fd5e7200640 1 --2- 172.21.15.2:0/2214324852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e80b1270 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.711+0000 7fd5e7200640 1 -- 172.21.15.2:0/2214324852 >> 172.21.15.2:0/2214324852 conn(0x7fd5e8066e60 msgr2=0x7fd5e8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.711+0000 7fd5e7200640 1 -- 172.21.15.2:0/2214324852 shutdown_connections 2024-08-17T02:46:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.711+0000 7fd5e7200640 1 -- 172.21.15.2:0/2214324852 wait complete. 2024-08-17T02:46:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.712+0000 7fd5e7200640 1 Processor -- start 2024-08-17T02:46:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.713+0000 7fd5e7200640 1 -- start start 2024-08-17T02:46:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.713+0000 7fd5e7200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5e80afe50 0x7fd5e814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e7200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5e80ca3d0 0x7fd5e81685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e7200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e8167e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e7200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80ae3e0 con 0x7fd5e815b1f0 2024-08-17T02:46:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e7200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80addd0 con 0x7fd5e80ca3d0 2024-08-17T02:46:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e7200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8168380 con 0x7fd5e80afe50 2024-08-17T02:46:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e8167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e8167e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38104/0 (socket says 172.21.15.2:38104) 2024-08-17T02:46:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e6800640 1 -- 172.21.15.2:0/4189079196 learned_addr learned my addr 172.21.15.2:0/4189079196 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e5e00640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5e80afe50 0x7fd5e814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5dfe00640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5e80ca3d0 0x7fd5e81685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e6800640 1 -- 172.21.15.2:0/4189079196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5e80afe50 msgr2=0x7fd5e814e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e6800640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5e80afe50 0x7fd5e814e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e6800640 1 -- 172.21.15.2:0/4189079196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5e80ca3d0 msgr2=0x7fd5e81685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e6800640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5e80ca3d0 0x7fd5e81685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.714+0000 7fd5e6800640 1 -- 172.21.15.2:0/4189079196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0009390 con 0x7fd5e815b1f0 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.715+0000 7fd5e6800640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e8167e40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009e90 tx=0x7fd5e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.715+0000 7fd5dd600640 1 -- 172.21.15.2:0/4189079196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000ce10 con 0x7fd5e815b1f0 2024-08-17T02:46:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.715+0000 7fd5dd600640 1 -- 172.21.15.2:0/4189079196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e000f040 con 0x7fd5e815b1f0 2024-08-17T02:46:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.715+0000 7fd5dd600640 1 -- 172.21.15.2:0/4189079196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00146d0 con 0x7fd5e815b1f0 2024-08-17T02:46:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.715+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e80c9d60 con 0x7fd5e815b1f0 2024-08-17T02:46:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.715+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e80ca040 con 0x7fd5e815b1f0 2024-08-17T02:46:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.716+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e80adc30 con 0x7fd5e815b1f0 2024-08-17T02:46:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.717+0000 7fd5dd600640 1 -- 172.21.15.2:0/4189079196 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd5e0014a80 con 0x7fd5e815b1f0 2024-08-17T02:46:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.718+0000 7fd5dd600640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd5c4065150 0x7fd5c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.718+0000 7fd5dd600640 1 -- 172.21.15.2:0/4189079196 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5e0083130 con 0x7fd5e815b1f0 2024-08-17T02:46:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.718+0000 7fd5e5e00640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd5c4065150 0x7fd5c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.719+0000 7fd5e5e00640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd5c4065150 0x7fd5c4067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8007fd0 tx=0x7fd5d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.722+0000 7fd5dd600640 1 -- 172.21.15.2:0/4189079196 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd5e80adc30 con 0x7fd5e815b1f0 2024-08-17T02:46:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.947+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd5e80adc30 con 0x7fd5e815b1f0 2024-08-17T02:46:32.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.948+0000 7fd5dd600640 1 -- 172.21.15.2:0/4189079196 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd5e80adc30 con 0x7fd5e815b1f0 2024-08-17T02:46:32.949 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.949+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd5c4065150 msgr2=0x7fd5c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.949+0000 7fd5e7200640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd5c4065150 0x7fd5c4067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8007fd0 tx=0x7fd5d8009040 comp rx=0 tx=0).stop 2024-08-17T02:46:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.949+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 msgr2=0x7fd5e8167e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.949+0000 7fd5e7200640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e8167e40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009e90 tx=0x7fd5e000b040 comp rx=0 tx=0).stop 2024-08-17T02:46:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.950+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 shutdown_connections 2024-08-17T02:46:32.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.950+0000 7fd5e7200640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5e815b1f0 0x7fd5e8167e40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.950+0000 7fd5e7200640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5e80ca3d0 0x7fd5e81685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.950+0000 7fd5e7200640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd5c4065150 0x7fd5c4067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.950+0000 7fd5e7200640 1 --2- 172.21.15.2:0/4189079196 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd5e80afe50 0x7fd5e814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.950+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 >> 172.21.15.2:0/4189079196 conn(0x7fd5e8066e60 msgr2=0x7fd5e8156510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:32.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.950+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 shutdown_connections 2024-08-17T02:46:32.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:32.950+0000 7fd5e7200640 1 -- 172.21.15.2:0/4189079196 wait complete. 2024-08-17T02:46:32.967 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:46:32.968 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:32.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-08-17T02:46:32.968 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:46:32.968 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:46:32.968 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:46:32.968 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:46:32.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:32.969 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:46:32.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:32.969 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-08-17T02:46:33.007 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:33.007 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:33.007 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:33.007 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.008 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:33.008 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.008 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:33.008 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:33.008 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-08-17T02:46:33.008 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:33.008 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:33.009 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-08-17T02:46:33.009 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:33.009 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:33.009 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-08-17T02:46:33.009 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:46:33.010 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42629sec preferred_lft 42629sec 2024-08-17T02:46:33.010 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-08-17T02:46:33.010 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.010 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:33.010 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:33.010 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-08-17T02:46:33.010 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:33.010 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 3a:17:d0:22:86:ac brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:33.011 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:46:33.011 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.011 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::449a:a9ff:feb8:db3/64 scope link 2024-08-17T02:46:33.011 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.011 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:46:33.011 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 3a:17:d0:22:86:ac brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:46:33.012 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::3817:d0ff:fe22:86ac/64 scope link 2024-08-17T02:46:33.012 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.012 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:33.101 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-08-17T02:46:33.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.104 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-08-17T02:46:33.141 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-08-17T02:46:33.141 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:33.141 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:46:33.142 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:46:33.142 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:33.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.142 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:33.143 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:33.143 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:46:33.143 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:46:33.143 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:46:33.143 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:33.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.288 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:46:33.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:46:33.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.325 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-08-17T02:46:33.400 INFO:teuthology.orchestra.run.smithi002.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:46:33.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.401 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:33.401 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:33.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:46:33.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:46:33.401 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:33.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 3e:66:4c:5d:79:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:46:33.583 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.584 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::3c66:4cff:fe5d:7958/64 scope link 2024-08-17T02:46:33.584 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:46:33.641 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:33.641 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:33.641 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:33.641 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.641 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:33.642 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.642 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:33.642 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 3e:66:4c:5d:79:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:46:33.642 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:46:33.642 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.642 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::3c66:4cff:fe5d:7958/64 scope link 2024-08-17T02:46:33.642 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:33.644 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:46:33.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.644 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:33.644 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:33.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:46:33.645 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:46:33.645 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:46:33.645 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:46:33.645 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:46:33.645 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:33.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:33.813 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:46:33.813 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:46:33.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.1 up 2024-08-17T02:46:33.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:46:33.814 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:46:33.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:33.932 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:46:33.968 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:46:33.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:33.968 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:46:34.042 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:46:34.043 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:34.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:34.165 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:34.165 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:34.193 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:34.193 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:34.193 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.26:3300,172.21.15.26:3301" 2024-08-17T02:46:34.193 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 2@f19c300a-c18c-4d11-a652-563f33592040.cephfs=/ 2024-08-17T02:46:34.193 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.2:3300/172.21.15.26:3300/172.21.15.26:3301" will pass to kernel 2024-08-17T02:46:34.194 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:46:34.194 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:34.194 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:34.194 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:34.195 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:34.198 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:34.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:34.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:46:34.254 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:46:34.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:34.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.404+0000 7fa417a00640 1 Processor -- start 2024-08-17T02:46:34.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.404+0000 7fa417a00640 1 -- start start 2024-08-17T02:46:34.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.405+0000 7fa417a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa410158e10 0x7fa410068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.405+0000 7fa417a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410068dd0 0x7fa4100cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.405+0000 7fa417a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4100c40a0 con 0x7fa4101591e0 2024-08-17T02:46:34.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.405+0000 7fa417a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100694e0 con 0x7fa410158e10 2024-08-17T02:46:34.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.405+0000 7fa417a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa410069240 con 0x7fa410068dd0 2024-08-17T02:46:34.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa415000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa410158e10 0x7fa410068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa415a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410068dd0 0x7fa4100cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa415000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa410158e10 0x7fa410068180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:50138/0 (socket says 172.21.15.2:50138) 2024-08-17T02:46:34.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa40fe00640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa4101591e0 0x7fa4100686c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:48074/0 (socket says 172.21.15.2:48074) 2024-08-17T02:46:34.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa415000640 1 -- 172.21.15.2:0/704865223 learned_addr learned my addr 172.21.15.2:0/704865223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:34.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa415000640 1 -- 172.21.15.2:0/704865223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410068dd0 msgr2=0x7fa4100cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:34.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa415000640 1 --2- 172.21.15.2:0/704865223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410068dd0 0x7fa4100cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa415000640 1 -- 172.21.15.2:0/704865223 >> v1:172.21.15.26:6789/0 conn(0x7fa4101591e0 legacy=0x7fa4100686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa40f400640 1 -- 172.21.15.2:0/704865223 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907057058 0 0) 0x7fa4100c40a0 con 0x7fa4101591e0 2024-08-17T02:46:34.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.406+0000 7fa415000640 1 -- 172.21.15.2:0/704865223 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4100c3a50 con 0x7fa410158e10 2024-08-17T02:46:34.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.407+0000 7fa415000640 1 --2- 172.21.15.2:0/704865223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa410158e10 0x7fa410068180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa404009910 tx=0x7fa4040091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c642835d5899d29 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa40f400640 1 -- 172.21.15.2:0/704865223 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40402ae40 con 0x7fa410158e10 2024-08-17T02:46:34.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa40f400640 1 -- 172.21.15.2:0/704865223 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa404032440 con 0x7fa410158e10 2024-08-17T02:46:34.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa40f400640 1 -- 172.21.15.2:0/704865223 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040327e0 con 0x7fa410158e10 2024-08-17T02:46:34.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa417a00640 1 -- 172.21.15.2:0/704865223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa410158e10 msgr2=0x7fa410068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa417a00640 1 --2- 172.21.15.2:0/704865223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa410158e10 0x7fa410068180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa404009910 tx=0x7fa4040091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa417a00640 1 -- 172.21.15.2:0/704865223 shutdown_connections 2024-08-17T02:46:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa417a00640 1 --2- 172.21.15.2:0/704865223 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410068dd0 0x7fa4100cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa417a00640 1 --2- 172.21.15.2:0/704865223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa410158e10 0x7fa410068180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa417a00640 1 -- 172.21.15.2:0/704865223 >> 172.21.15.2:0/704865223 conn(0x7fa4100ce590 msgr2=0x7fa4100ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa417a00640 1 -- 172.21.15.2:0/704865223 shutdown_connections 2024-08-17T02:46:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.408+0000 7fa417a00640 1 -- 172.21.15.2:0/704865223 wait complete. 2024-08-17T02:46:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.410+0000 7fa417a00640 1 Processor -- start 2024-08-17T02:46:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.410+0000 7fa417a00640 1 -- start start 2024-08-17T02:46:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa417a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410068dd0 0x7fa410154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa417a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410158e10 0x7fa4100b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa417a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4101591e0 0x7fa4100c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa417a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100b1f60 con 0x7fa410068dd0 2024-08-17T02:46:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa417a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100c61f0 con 0x7fa4101591e0 2024-08-17T02:46:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa417a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa410154bb0 con 0x7fa410158e10 2024-08-17T02:46:34.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410068dd0 0x7fa410154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410068dd0 0x7fa410154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35012/0 (socket says 172.21.15.2:35012) 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415000640 1 -- 172.21.15.2:0/2996506369 learned_addr learned my addr 172.21.15.2:0/2996506369 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415a00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4101591e0 0x7fa4100c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa40fe00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410158e10 0x7fa4100b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415000640 1 -- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410158e10 msgr2=0x7fa4100b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415000640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410158e10 0x7fa4100b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415000640 1 -- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4101591e0 msgr2=0x7fa4100c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415000640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4101591e0 0x7fa4100c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa415000640 1 -- 172.21.15.2:0/2996506369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009450 con 0x7fa410068dd0 2024-08-17T02:46:34.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.411+0000 7fa40fe00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410158e10 0x7fa4100b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:34.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.412+0000 7fa415000640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410068dd0 0x7fa410154670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa404009970 tx=0x7fa404032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.412+0000 7fa403e00640 1 -- 172.21.15.2:0/2996506369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404000c40 con 0x7fa410068dd0 2024-08-17T02:46:34.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.412+0000 7fa403e00640 1 -- 172.21.15.2:0/2996506369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa404031a60 con 0x7fa410068dd0 2024-08-17T02:46:34.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.412+0000 7fa403e00640 1 -- 172.21.15.2:0/2996506369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404031e20 con 0x7fa410068dd0 2024-08-17T02:46:34.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.412+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4100b21f0 con 0x7fa410068dd0 2024-08-17T02:46:34.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.412+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4100b2a30 con 0x7fa410068dd0 2024-08-17T02:46:34.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.413+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4100cd870 con 0x7fa410068dd0 2024-08-17T02:46:34.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.414+0000 7fa403e00640 1 -- 172.21.15.2:0/2996506369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa404039050 con 0x7fa410068dd0 2024-08-17T02:46:34.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.415+0000 7fa403e00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa3f0065150 0x7fa3f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:34.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.415+0000 7fa403e00640 1 -- 172.21.15.2:0/2996506369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa40402ae40 con 0x7fa410068dd0 2024-08-17T02:46:34.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.415+0000 7fa40fe00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa3f0065150 0x7fa3f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:34.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.416+0000 7fa40fe00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa3f0065150 0x7fa3f0067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4100aefd0 tx=0x7fa3fc007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:34.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.419+0000 7fa403e00640 1 -- 172.21.15.2:0/2996506369 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4100cd870 con 0x7fa410068dd0 2024-08-17T02:46:34.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.645+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa410068b80 con 0x7fa410068dd0 2024-08-17T02:46:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.646+0000 7fa403e00640 1 -- 172.21.15.2:0/2996506369 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa410068b80 con 0x7fa410068dd0 2024-08-17T02:46:34.647 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa3f0065150 msgr2=0x7fa3f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa3f0065150 0x7fa3f0067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4100aefd0 tx=0x7fa3fc007c00 comp rx=0 tx=0).stop 2024-08-17T02:46:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410068dd0 msgr2=0x7fa410154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410068dd0 0x7fa410154670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa404009970 tx=0x7fa404032000 comp rx=0 tx=0).stop 2024-08-17T02:46:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 shutdown_connections 2024-08-17T02:46:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4101591e0 0x7fa4100c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa3f0065150 0x7fa3f0067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa410158e10 0x7fa4100b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 --2- 172.21.15.2:0/2996506369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa410068dd0 0x7fa410154670 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 >> 172.21.15.2:0/2996506369 conn(0x7fa4100ce590 msgr2=0x7fa4100c28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 shutdown_connections 2024-08-17T02:46:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:34.648+0000 7fa417a00640 1 -- 172.21.15.2:0/2996506369 wait complete. 2024-08-17T02:46:34.663 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:46:34.664 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:34.664 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-08-17T02:46:34.664 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:46:34.664 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:34.664 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:46:34.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:46:34.664 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:34.664 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:46:34.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:34.664 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-08-17T02:46:34.705 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:34.705 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:34.705 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:34.705 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:34.705 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:34.705 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:34.705 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:34.705 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42624sec preferred_lft 42624sec 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link noprefixroute 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:34.706 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:34.707 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:34.707 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-08-17T02:46:34.707 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:46:34.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:34.707 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:34.707 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:34.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:46:34.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2024-08-17T02:46:34.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2024-08-17T02:46:34.708 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:46:34.708 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:35.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:35.079 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:35.135 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-08-17T02:46:35.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:35.138 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-08-17T02:46:35.201 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-08-17T02:46:35.201 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:35.201 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:46:35.201 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:46:35.201 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:35.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:35.202 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:35.202 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:35.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:46:35.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:46:35.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:46:35.202 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:35.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:35.711 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-08-17T02:46:35.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:35.747 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2024-08-17T02:46:35.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:35.823 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:35.823 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:35.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:46:35.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:46:35.823 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:35.950 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:46:35.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:35.950 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:35.950 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:35.950 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:46:35.950 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:46:35.950 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:46:35.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:46:35.951 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:46:35.951 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:36.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:36.139 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:36.140 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:36.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2024-08-17T02:46:36.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:46:36.140 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:36.255 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:36.255 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:36.290 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:46:36.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:36.291 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:36.366 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:46:36.366 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:36.366 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:36.500 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:36.501 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:37.122 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:37.122 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:37.122 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.26:3300,172.21.15.26:3301" 2024-08-17T02:46:37.122 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 1@f19c300a-c18c-4d11-a652-563f33592040.cephfs=/ 2024-08-17T02:46:37.122 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.2:3300/172.21.15.26:3300/172.21.15.26:3301" will pass to kernel 2024-08-17T02:46:37.124 INFO:teuthology.orchestra.run.smithi026.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:46:37.124 INFO:teuthology.orchestra.run.smithi026.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:37.124 INFO:teuthology.orchestra.run.smithi026.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:37.124 INFO:teuthology.orchestra.run.smithi026.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:37.124 INFO:teuthology.orchestra.run.smithi026.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:37.127 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:37.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:46:37.183 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:46:37.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:46:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.346+0000 7f1b66400640 1 Processor -- start 2024-08-17T02:46:37.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.346+0000 7f1b66400640 1 -- start start 2024-08-17T02:46:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.347+0000 7f1b66400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1b60158b90 0x7f1b600b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.347+0000 7f1b66400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b600af130 0x7f1b600ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.347+0000 7f1b66400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600afd20 con 0x7f1b600b2370 2024-08-17T02:46:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.347+0000 7f1b66400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b600affe0 con 0x7f1b600af130 2024-08-17T02:46:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.347+0000 7f1b66400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b600b02c0 con 0x7f1b60158b90 2024-08-17T02:46:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.347+0000 7f1b5fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b600af130 0x7f1b600ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.348+0000 7f1b5fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b600af130 0x7f1b600ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35024/0 (socket says 172.21.15.2:35024) 2024-08-17T02:46:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.348+0000 7f1b5fe00640 1 -- 172.21.15.2:0/1363421188 learned_addr learned my addr 172.21.15.2:0/1363421188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:37.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.348+0000 7f1b5f400640 1 --2- 172.21.15.2:0/1363421188 >> v2:172.21.15.26:3300/0 conn(0x7f1b60158b90 0x7f1b600b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.348+0000 7f1b5fe00640 1 -- 172.21.15.2:0/1363421188 >> v2:172.21.15.26:3300/0 conn(0x7f1b60158b90 msgr2=0x7f1b600b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:37.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.348+0000 7f1b5fe00640 1 --2- 172.21.15.2:0/1363421188 >> v2:172.21.15.26:3300/0 conn(0x7f1b60158b90 0x7f1b600b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.348+0000 7f1b5fe00640 1 -- 172.21.15.2:0/1363421188 >> v1:172.21.15.26:6789/0 conn(0x7f1b600b2370 legacy=0x7f1b600aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.348+0000 7f1b5fe00640 1 -- 172.21.15.2:0/1363421188 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600ca3c0 con 0x7f1b600af130 2024-08-17T02:46:37.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.349+0000 7f1b5fe00640 1 --2- 172.21.15.2:0/1363421188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600af130 0x7f1b600ca8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b600cd650 tx=0x7f1b58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230edc483d052c12 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:37.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.349+0000 7f1b5e000640 1 -- 172.21.15.2:0/1363421188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5802e050 con 0x7f1b600af130 2024-08-17T02:46:37.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.349+0000 7f1b5e000640 1 -- 172.21.15.2:0/1363421188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58007400 con 0x7f1b600af130 2024-08-17T02:46:37.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.349+0000 7f1b5e000640 1 -- 172.21.15.2:0/1363421188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580077e0 con 0x7f1b600af130 2024-08-17T02:46:37.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.350+0000 7f1b66400640 1 -- 172.21.15.2:0/1363421188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600af130 msgr2=0x7f1b600ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.350+0000 7f1b66400640 1 --2- 172.21.15.2:0/1363421188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600af130 0x7f1b600ca8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b600cd650 tx=0x7f1b58009840 comp rx=0 tx=0).stop 2024-08-17T02:46:37.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.350+0000 7f1b66400640 1 -- 172.21.15.2:0/1363421188 shutdown_connections 2024-08-17T02:46:37.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.350+0000 7f1b66400640 1 --2- 172.21.15.2:0/1363421188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600af130 0x7f1b600ca8e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.350+0000 7f1b66400640 1 --2- 172.21.15.2:0/1363421188 >> v2:172.21.15.26:3300/0 conn(0x7f1b60158b90 0x7f1b600b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.350+0000 7f1b66400640 1 -- 172.21.15.2:0/1363421188 >> 172.21.15.2:0/1363421188 conn(0x7f1b6006e590 msgr2=0x7f1b6006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:37.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.350+0000 7f1b66400640 1 -- 172.21.15.2:0/1363421188 shutdown_connections 2024-08-17T02:46:37.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.350+0000 7f1b66400640 1 -- 172.21.15.2:0/1363421188 wait complete. 2024-08-17T02:46:37.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.351+0000 7f1b66400640 1 Processor -- start 2024-08-17T02:46:37.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.352+0000 7f1b66400640 1 -- start start 2024-08-17T02:46:37.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b66400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600af130 0x7f1b60168df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b66400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600b2370 0x7f1b6014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b66400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b60158b90 0x7f1b600c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b66400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60159650 con 0x7f1b600b2370 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b66400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c8140 con 0x7f1b600af130 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b66400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c8420 con 0x7f1b60158b90 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600b2370 0x7f1b6014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5f400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600af130 0x7f1b60168df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600b2370 0x7f1b6014af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35040/0 (socket says 172.21.15.2:35040) 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5ea00640 1 -- 172.21.15.2:0/3296525540 learned_addr learned my addr 172.21.15.2:0/3296525540 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5fe00640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b60158b90 0x7f1b600c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5ea00640 1 -- 172.21.15.2:0/3296525540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b60158b90 msgr2=0x7f1b600c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5ea00640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b60158b90 0x7f1b600c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5ea00640 1 -- 172.21.15.2:0/3296525540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600af130 msgr2=0x7f1b60168df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5ea00640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600af130 0x7f1b60168df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.353+0000 7f1b5ea00640 1 -- 172.21.15.2:0/3296525540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b58009ae0 con 0x7f1b600b2370 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.354+0000 7f1b5ea00640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600b2370 0x7f1b6014af10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00c590 tx=0x7f1b4c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.354+0000 7f1b56a00640 1 -- 172.21.15.2:0/3296525540 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c011590 con 0x7f1b600b2370 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.354+0000 7f1b56a00640 1 -- 172.21.15.2:0/3296525540 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c011710 con 0x7f1b600b2370 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.354+0000 7f1b56a00640 1 -- 172.21.15.2:0/3296525540 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c011ad0 con 0x7f1b600b2370 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.354+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b60159000 con 0x7f1b600b2370 2024-08-17T02:46:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.354+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6014b450 con 0x7f1b600b2370 2024-08-17T02:46:37.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.355+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60063fb0 con 0x7f1b600b2370 2024-08-17T02:46:37.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.356+0000 7f1b56a00640 1 -- 172.21.15.2:0/3296525540 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1b4c01c460 con 0x7f1b600b2370 2024-08-17T02:46:37.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.357+0000 7f1b56a00640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1b40065150 0x7f1b40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:37.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.357+0000 7f1b56a00640 1 -- 172.21.15.2:0/3296525540 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b4c0820b0 con 0x7f1b600b2370 2024-08-17T02:46:37.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.357+0000 7f1b5f400640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1b40065150 0x7f1b40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.358+0000 7f1b5f400640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1b40065150 0x7f1b40067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009d20 tx=0x7f1b500090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.361+0000 7f1b56a00640 1 -- 172.21.15.2:0/3296525540 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1b4c050180 con 0x7f1b600b2370 2024-08-17T02:46:37.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.581+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b600b2cd0 con 0x7f1b600b2370 2024-08-17T02:46:37.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.581+0000 7f1b56a00640 1 -- 172.21.15.2:0/3296525540 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1b4c0537a0 con 0x7f1b600b2370 2024-08-17T02:46:37.583 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:46:37.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1b40065150 msgr2=0x7f1b40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1b40065150 0x7f1b40067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009d20 tx=0x7f1b500090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600b2370 msgr2=0x7f1b6014af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:37.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600b2370 0x7f1b6014af10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00c590 tx=0x7f1b4c007e80 comp rx=0 tx=0).stop 2024-08-17T02:46:37.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 shutdown_connections 2024-08-17T02:46:37.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1b40065150 0x7f1b40067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1b60158b90 0x7f1b600c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b600b2370 0x7f1b6014af10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 --2- 172.21.15.2:0/3296525540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1b600af130 0x7f1b60168df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:37.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 >> 172.21.15.2:0/3296525540 conn(0x7f1b6006e590 msgr2=0x7f1b600cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:37.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 shutdown_connections 2024-08-17T02:46:37.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:37.583+0000 7f1b66400640 1 -- 172.21.15.2:0/3296525540 wait complete. 2024-08-17T02:46:37.599 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:46:37.600 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:46:37.600 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-08-17T02:46:37.600 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:46:37.600 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:46:37.600 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:46:37.600 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:46:37.600 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:46:37.600 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:46:37.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.601 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-08-17T02:46:37.639 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:37.639 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:37.639 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-08-17T02:46:37.640 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42621sec preferred_lft 42621sec 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link noprefixroute 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether b6:51:e4:10:94:09 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::684f:21ff:fe25:720/64 scope link 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.641 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:46:37.642 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether b6:51:e4:10:94:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:46:37.642 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::b451:e4ff:fe10:9409/64 scope link tentative 2024-08-17T02:46:37.642 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:37.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.642 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:46:37.734 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-08-17T02:46:37.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.738 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-08-17T02:46:37.776 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-08-17T02:46:37.776 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:46:37.776 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:46:37.776 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:46:37.776 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:46:37.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.776 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:37.777 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:37.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:46:37.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:46:37.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:46:37.777 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:37.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.923 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-08-17T02:46:37.958 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:46:37.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:37.959 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2024-08-17T02:46:38.034 INFO:teuthology.orchestra.run.smithi026.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:46:38.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.035 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:38.035 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:38.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:46:38.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:46:38.035 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:38.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.163 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:46:38.218 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 8a:66:84:f9:32:4f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::8866:84ff:fef9:324f/64 scope link 2024-08-17T02:46:38.219 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.221 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 8a:66:84:f9:32:4f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:46:38.277 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:46:38.278 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.278 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::8866:84ff:fef9:324f/64 scope link 2024-08-17T02:46:38.278 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:46:38.280 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:46:38.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.280 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:38.280 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:38.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:46:38.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:46:38.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:46:38.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:46:38.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:46:38.280 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:38.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.448 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:46:38.448 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:46:38.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.1 up 2024-08-17T02:46:38.448 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:46:38.448 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:46:38.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:38.564 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:46:38.598 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:46:38.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:46:38.599 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:46:38.675 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:46:38.675 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:46:38.675 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:38.795 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:38.796 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:38.822 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:46:38.822 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:46:38.823 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.26:3300,172.21.15.26:3301" 2024-08-17T02:46:38.823 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 3@f19c300a-c18c-4d11-a652-563f33592040.cephfs=/ 2024-08-17T02:46:38.823 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.2:3300/172.21.15.26:3300/172.21.15.26:3301" will pass to kernel 2024-08-17T02:46:38.823 INFO:teuthology.orchestra.run.smithi026.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:46:38.823 INFO:teuthology.orchestra.run.smithi026.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:46:38.824 INFO:teuthology.orchestra.run.smithi026.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:46:38.824 INFO:teuthology.orchestra.run.smithi026.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:46:38.824 INFO:teuthology.orchestra.run.smithi026.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:46:38.827 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:46:38.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:38.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:46:38.884 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:46:38.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:39.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:39.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:46:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.070+0000 7f7927e00640 1 Processor -- start 2024-08-17T02:46:39.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.070+0000 7f7927e00640 1 -- start start 2024-08-17T02:46:39.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f7927e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f792815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f7927e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7928159030 0x7f79280ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f7927e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792815b6b0 con 0x7f7928159420 2024-08-17T02:46:39.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f7927e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79280b0540 con 0x7f7928159030 2024-08-17T02:46:39.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f7927e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792815aac0 con 0x7f7928158c60 2024-08-17T02:46:39.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f791fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7928159030 0x7f79280ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f791fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7928159030 0x7f79280ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35054/0 (socket says 172.21.15.2:35054) 2024-08-17T02:46:39.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f791fe00640 1 -- 172.21.15.2:0/3104533512 learned_addr learned my addr 172.21.15.2:0/3104533512 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f7926a00640 1 --2- 172.21.15.2:0/3104533512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f792815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.073+0000 7f791fe00640 1 -- 172.21.15.2:0/3104533512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 msgr2=0x7f792815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.074+0000 7f791fe00640 1 --2- 172.21.15.2:0/3104533512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f792815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.074+0000 7f791fe00640 1 -- 172.21.15.2:0/3104533512 >> v1:172.21.15.26:6789/0 conn(0x7f7928159420 legacy=0x7f79280b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.074+0000 7f791fe00640 1 -- 172.21.15.2:0/3104533512 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792815ad80 con 0x7f7928159030 2024-08-17T02:46:39.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.074+0000 7f7926a00640 1 --2- 172.21.15.2:0/3104533512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f792815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.075+0000 7f791fe00640 1 --2- 172.21.15.2:0/3104533512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159030 0x7f79280ca8b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7910009910 tx=0x7f79100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18aa6ca25704748 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.076+0000 7f7926000640 1 -- 172.21.15.2:0/3104533512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791002add0 con 0x7f7928159030 2024-08-17T02:46:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.076+0000 7f7926000640 1 -- 172.21.15.2:0/3104533512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910032440 con 0x7f7928159030 2024-08-17T02:46:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.076+0000 7f7926000640 1 -- 172.21.15.2:0/3104533512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910032820 con 0x7f7928159030 2024-08-17T02:46:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.077+0000 7f7927e00640 1 -- 172.21.15.2:0/3104533512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159030 msgr2=0x7f79280ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.077+0000 7f7927e00640 1 --2- 172.21.15.2:0/3104533512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159030 0x7f79280ca8b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7910009910 tx=0x7f79100091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.077+0000 7f7927e00640 1 -- 172.21.15.2:0/3104533512 shutdown_connections 2024-08-17T02:46:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.077+0000 7f7927e00640 1 --2- 172.21.15.2:0/3104533512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159030 0x7f79280ca8b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.077+0000 7f7927e00640 1 --2- 172.21.15.2:0/3104533512 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f792815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.077+0000 7f7927e00640 1 -- 172.21.15.2:0/3104533512 >> 172.21.15.2:0/3104533512 conn(0x7f792806e590 msgr2=0x7f792806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.077+0000 7f7927e00640 1 -- 172.21.15.2:0/3104533512 shutdown_connections 2024-08-17T02:46:39.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.077+0000 7f7927e00640 1 -- 172.21.15.2:0/3104533512 wait complete. 2024-08-17T02:46:39.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.078+0000 7f7927e00640 1 Processor -- start 2024-08-17T02:46:39.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.079+0000 7f7927e00640 1 -- start start 2024-08-17T02:46:39.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.079+0000 7f7927e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f79280ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.079+0000 7f7927e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7928159030 0x7f7928146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.079+0000 7f7927e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159420 0x7f792815bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f7927e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792815e4d0 con 0x7f7928159420 2024-08-17T02:46:39.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f7927e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c5dd0 con 0x7f7928159030 2024-08-17T02:46:39.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f7927e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792815de80 con 0x7f7928158c60 2024-08-17T02:46:39.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f7927400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159420 0x7f792815bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f791fe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7928159030 0x7f7928146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f791fe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7928159030 0x7f7928146e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:50170/0 (socket says 172.21.15.2:50170) 2024-08-17T02:46:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f7926a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f79280ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f791fe00640 1 -- 172.21.15.2:0/2863072645 learned_addr learned my addr 172.21.15.2:0/2863072645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f7927400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159420 0x7f792815bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35064/0 (socket says 172.21.15.2:35064) 2024-08-17T02:46:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f791fe00640 1 -- 172.21.15.2:0/2863072645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 msgr2=0x7f79280ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f791fe00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f79280ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f791fe00640 1 -- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159420 msgr2=0x7f792815bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f791fe00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159420 0x7f792815bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f791fe00640 1 -- 172.21.15.2:0/2863072645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7910009450 con 0x7f7928159030 2024-08-17T02:46:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.080+0000 7f7927400640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159420 0x7f792815bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.081+0000 7f791fe00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7928159030 0x7f7928146e70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7910035040 tx=0x7f7910032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.081+0000 7f791e000640 1 -- 172.21.15.2:0/2863072645 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910000c90 con 0x7f7928159030 2024-08-17T02:46:39.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.081+0000 7f791e000640 1 -- 172.21.15.2:0/2863072645 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910031a40 con 0x7f7928159030 2024-08-17T02:46:39.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.081+0000 7f791e000640 1 -- 172.21.15.2:0/2863072645 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910031e00 con 0x7f7928159030 2024-08-17T02:46:39.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.081+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792815e160 con 0x7f7928159030 2024-08-17T02:46:39.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.081+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79281473b0 con 0x7f7928159030 2024-08-17T02:46:39.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.082+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792815dcd0 con 0x7f7928159030 2024-08-17T02:46:39.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.083+0000 7f791e000640 1 -- 172.21.15.2:0/2863072645 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7910039040 con 0x7f7928159030 2024-08-17T02:46:39.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.084+0000 7f791e000640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7904065250 0x7f7904067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.084+0000 7f791e000640 1 -- 172.21.15.2:0/2863072645 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79100a23c0 con 0x7f7928159030 2024-08-17T02:46:39.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.084+0000 7f7926a00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7904065250 0x7f7904067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.084+0000 7f7926a00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7904065250 0x7f7904067700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7918006e70 tx=0x7f7918008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.088+0000 7f791e000640 1 -- 172.21.15.2:0/2863072645 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f79100705d0 con 0x7f7928159030 2024-08-17T02:46:39.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.273+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7928070720 con 0x7f7928159030 2024-08-17T02:46:39.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.274+0000 7f791e000640 1 -- 172.21.15.2:0/2863072645 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f7910079020 con 0x7f7928159030 2024-08-17T02:46:39.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7904065250 msgr2=0x7f7904067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7904065250 0x7f7904067700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7918006e70 tx=0x7f7918008040 comp rx=0 tx=0).stop 2024-08-17T02:46:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7928159030 msgr2=0x7f7928146e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7928159030 0x7f7928146e70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7910035040 tx=0x7f7910032000 comp rx=0 tx=0).stop 2024-08-17T02:46:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 shutdown_connections 2024-08-17T02:46:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7928159420 0x7f792815bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7928159030 0x7f7928146e70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7904065250 0x7f7904067700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 --2- 172.21.15.2:0/2863072645 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7928158c60 0x7f79280ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 >> 172.21.15.2:0/2863072645 conn(0x7f792806e590 msgr2=0x7f79280b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 shutdown_connections 2024-08-17T02:46:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.276+0000 7f7927e00640 1 -- 172.21.15.2:0/2863072645 wait complete. 2024-08-17T02:46:39.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:10.965028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:12.163837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:39.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:39.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.446+0000 7f5fc3200640 1 Processor -- start 2024-08-17T02:46:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.446+0000 7f5fc3200640 1 -- start start 2024-08-17T02:46:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fc3200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5fc415c4b0 0x7f5fc406af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fc3200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc406ab00 con 0x7f5fc415c0e0 2024-08-17T02:46:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fc3200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc4069ef0 con 0x7f5fc406b4d0 2024-08-17T02:46:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fc3200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc406a1d0 con 0x7f5fc415c4b0 2024-08-17T02:46:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fc1e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5fc415c0e0 0x7f5fc415d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38484/0 (socket says 172.21.15.2:38484) 2024-08-17T02:46:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fb9400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5fc415c4b0 0x7f5fc406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fc1e00640 1 -- 172.21.15.2:0/3388091199 learned_addr learned my addr 172.21.15.2:0/3388091199 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fb9400640 1 -- 172.21.15.2:0/3388091199 >> v1:172.21.15.26:6789/0 conn(0x7f5fc406b4d0 legacy=0x7f5fc40c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fb9400640 1 -- 172.21.15.2:0/3388091199 >> v1:172.21.15.2:6789/0 conn(0x7f5fc415c0e0 legacy=0x7f5fc415d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.448+0000 7f5fb9400640 1 -- 172.21.15.2:0/3388091199 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc406a4b0 con 0x7f5fc415c4b0 2024-08-17T02:46:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.449+0000 7f5fb9400640 1 --2- 172.21.15.2:0/3388091199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc415c4b0 0x7f5fc406af90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5fac009850 tx=0x7f5fac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742c78e9d6bc710d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc1400640 1 -- 172.21.15.2:0/3388091199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac02ad00 con 0x7f5fc415c4b0 2024-08-17T02:46:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc1400640 1 -- 172.21.15.2:0/3388091199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac02ae60 con 0x7f5fc415c4b0 2024-08-17T02:46:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc1400640 1 -- 172.21.15.2:0/3388091199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac032670 con 0x7f5fc415c4b0 2024-08-17T02:46:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc3200640 1 -- 172.21.15.2:0/3388091199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc415c4b0 msgr2=0x7f5fc406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc3200640 1 --2- 172.21.15.2:0/3388091199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc415c4b0 0x7f5fc406af90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5fac009850 tx=0x7f5fac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc3200640 1 -- 172.21.15.2:0/3388091199 shutdown_connections 2024-08-17T02:46:39.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc3200640 1 --2- 172.21.15.2:0/3388091199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc415c4b0 0x7f5fc406af90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc3200640 1 -- 172.21.15.2:0/3388091199 >> 172.21.15.2:0/3388091199 conn(0x7f5fc40678e0 msgr2=0x7f5fc40b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:39.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc3200640 1 -- 172.21.15.2:0/3388091199 shutdown_connections 2024-08-17T02:46:39.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.450+0000 7f5fc3200640 1 -- 172.21.15.2:0/3388091199 wait complete. 2024-08-17T02:46:39.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.452+0000 7f5fc3200640 1 Processor -- start 2024-08-17T02:46:39.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.452+0000 7f5fc3200640 1 -- start start 2024-08-17T02:46:39.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc3200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc406b4d0 0x7f5fc41588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc3200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fc415c0e0 0x7f5fc415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc3200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc415c4b0 0x7f5fc416d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc3200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4159a90 con 0x7f5fc406b4d0 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc3200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4158e80 con 0x7f5fc415c4b0 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc3200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4159160 con 0x7f5fc415c0e0 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc406b4d0 0x7f5fc41588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc406b4d0 0x7f5fc41588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35078/0 (socket says 172.21.15.2:35078) 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc1e00640 1 -- 172.21.15.2:0/1149635612 learned_addr learned my addr 172.21.15.2:0/1149635612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc2800640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc415c4b0 0x7f5fc416d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fb9400640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fc415c0e0 0x7f5fc415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc1e00640 1 -- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fc415c0e0 msgr2=0x7f5fc415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc1e00640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fc415c0e0 0x7f5fc415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc1e00640 1 -- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc415c4b0 msgr2=0x7f5fc416d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.453+0000 7f5fc1e00640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc415c4b0 0x7f5fc416d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.454+0000 7f5fc1e00640 1 -- 172.21.15.2:0/1149635612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac009390 con 0x7f5fc406b4d0 2024-08-17T02:46:39.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.454+0000 7f5fb9400640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fc415c0e0 0x7f5fc415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:39.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.454+0000 7f5fc1e00640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc406b4d0 0x7f5fc41588a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400c590 tx=0x7f5fb4007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.454+0000 7f5fba000640 1 -- 172.21.15.2:0/1149635612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4005aa0 con 0x7f5fc406b4d0 2024-08-17T02:46:39.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.454+0000 7f5fba000640 1 -- 172.21.15.2:0/1149635612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4005c20 con 0x7f5fc406b4d0 2024-08-17T02:46:39.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.454+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc4159440 con 0x7f5fc406b4d0 2024-08-17T02:46:39.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.454+0000 7f5fba000640 1 -- 172.21.15.2:0/1149635612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb40070f0 con 0x7f5fc406b4d0 2024-08-17T02:46:39.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.454+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc415b860 con 0x7f5fc406b4d0 2024-08-17T02:46:39.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.455+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc4144340 con 0x7f5fc406b4d0 2024-08-17T02:46:39.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.456+0000 7f5fba000640 1 -- 172.21.15.2:0/1149635612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5fb4007540 con 0x7f5fc406b4d0 2024-08-17T02:46:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.457+0000 7f5fba000640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5fa0065180 0x7f5fa0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.457+0000 7f5fba000640 1 -- 172.21.15.2:0/1149635612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fb40816e0 con 0x7f5fc406b4d0 2024-08-17T02:46:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.457+0000 7f5fb9400640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5fa0065180 0x7f5fa0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.458+0000 7f5fb9400640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5fa0065180 0x7f5fa0067630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fac034000 tx=0x7f5fac032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.461+0000 7f5fba000640 1 -- 172.21.15.2:0/1149635612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5fc4144340 con 0x7f5fc406b4d0 2024-08-17T02:46:39.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.644+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fc4144340 con 0x7f5fc406b4d0 2024-08-17T02:46:39.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.645+0000 7f5fba000640 1 -- 172.21.15.2:0/1149635612 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fc4144340 con 0x7f5fc406b4d0 2024-08-17T02:46:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5fa0065180 msgr2=0x7f5fa0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5fa0065180 0x7f5fa0067630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fac034000 tx=0x7f5fac032000 comp rx=0 tx=0).stop 2024-08-17T02:46:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc406b4d0 msgr2=0x7f5fc41588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc406b4d0 0x7f5fc41588a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400c590 tx=0x7f5fb4007ee0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 shutdown_connections 2024-08-17T02:46:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fc415c4b0 0x7f5fc416d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5fa0065180 0x7f5fa0067630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5fc415c0e0 0x7f5fc415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 --2- 172.21.15.2:0/1149635612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fc406b4d0 0x7f5fc41588a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 >> 172.21.15.2:0/1149635612 conn(0x7f5fc40678e0 msgr2=0x7f5fc40afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 shutdown_connections 2024-08-17T02:46:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.647+0000 7f5fc3200640 1 -- 172.21.15.2:0/1149635612 wait complete. 2024-08-17T02:46:39.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.816+0000 7f53cac00640 1 Processor -- start 2024-08-17T02:46:39.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.816+0000 7f53cac00640 1 -- start start 2024-08-17T02:46:39.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.817+0000 7f53cac00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53c40ad960 0x7f53c415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.817+0000 7f53cac00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40ca050 0x7f53c4156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.817+0000 7f53cac00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c415b5e0 con 0x7f53c40add30 2024-08-17T02:46:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.817+0000 7f53cac00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c40cb160 con 0x7f53c40ad960 2024-08-17T02:46:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.817+0000 7f53cac00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40b0d10 con 0x7f53c40ca050 2024-08-17T02:46:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53c40ad960 0x7f53c415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f53c40ad960 0x7f53c415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35088/0 (socket says 172.21.15.2:35088) 2024-08-17T02:46:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3e00640 1 -- 172.21.15.2:0/2431385731 learned_addr learned my addr 172.21.15.2:0/2431385731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3400640 1 --2- 172.21.15.2:0/2431385731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40ca050 0x7f53c4156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3e00640 1 -- 172.21.15.2:0/2431385731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40ca050 msgr2=0x7f53c4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3e00640 1 --2- 172.21.15.2:0/2431385731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40ca050 0x7f53c4156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3e00640 1 -- 172.21.15.2:0/2431385731 >> v1:172.21.15.26:6789/0 conn(0x7f53c40add30 legacy=0x7f53c4156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3e00640 1 -- 172.21.15.2:0/2431385731 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40ca550 con 0x7f53c40ad960 2024-08-17T02:46:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.818+0000 7f53c3400640 1 --2- 172.21.15.2:0/2431385731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40ca050 0x7f53c4156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.819+0000 7f53c3e00640 1 --2- 172.21.15.2:0/2431385731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ad960 0x7f53c415b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009910 tx=0x7f53b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3697fd4d8f0558 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.819+0000 7f53c2a00640 1 -- 172.21.15.2:0/2431385731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4032440 con 0x7f53c40ad960 2024-08-17T02:46:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.819+0000 7f53c2a00640 1 -- 172.21.15.2:0/2431385731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40325a0 con 0x7f53c40ad960 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.819+0000 7f53c2a00640 1 -- 172.21.15.2:0/2431385731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4032980 con 0x7f53c40ad960 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.820+0000 7f53cac00640 1 -- 172.21.15.2:0/2431385731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ad960 msgr2=0x7f53c415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.820+0000 7f53cac00640 1 --2- 172.21.15.2:0/2431385731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ad960 0x7f53c415b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009910 tx=0x7f53b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.820+0000 7f53cac00640 1 -- 172.21.15.2:0/2431385731 shutdown_connections 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.820+0000 7f53cac00640 1 --2- 172.21.15.2:0/2431385731 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40ca050 0x7f53c4156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.820+0000 7f53cac00640 1 --2- 172.21.15.2:0/2431385731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ad960 0x7f53c415b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.820+0000 7f53cac00640 1 -- 172.21.15.2:0/2431385731 >> 172.21.15.2:0/2431385731 conn(0x7f53c4066e60 msgr2=0x7f53c4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.820+0000 7f53cac00640 1 -- 172.21.15.2:0/2431385731 shutdown_connections 2024-08-17T02:46:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.820+0000 7f53cac00640 1 -- 172.21.15.2:0/2431385731 wait complete. 2024-08-17T02:46:39.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.822+0000 7f53cac00640 1 Processor -- start 2024-08-17T02:46:39.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.822+0000 7f53cac00640 1 -- start start 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53cac00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53c40ad960 0x7f53c4144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53cac00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40add30 0x7f53c4169420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53cac00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ca050 0x7f53c415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53cac00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c416a400 con 0x7f53c40ca050 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53cac00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40abe50 con 0x7f53c40ad960 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53cac00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c41448d0 con 0x7f53c40add30 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ca050 0x7f53c415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ca050 0x7f53c415a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35094/0 (socket says 172.21.15.2:35094) 2024-08-17T02:46:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c8c00640 1 -- 172.21.15.2:0/684148693 learned_addr learned my addr 172.21.15.2:0/684148693 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c3e00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53c40ad960 0x7f53c4144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c3400640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40add30 0x7f53c4169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c8c00640 1 -- 172.21.15.2:0/684148693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40add30 msgr2=0x7f53c4169420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c8c00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40add30 0x7f53c4169420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c8c00640 1 -- 172.21.15.2:0/684148693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53c40ad960 msgr2=0x7f53c4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c8c00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53c40ad960 0x7f53c4144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.823+0000 7f53c8c00640 1 -- 172.21.15.2:0/684148693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009450 con 0x7f53c40ca050 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.824+0000 7f53c8c00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ca050 0x7f53c415a620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c890 tx=0x7f53bc001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.824+0000 7f53bb400640 1 -- 172.21.15.2:0/684148693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00ce80 con 0x7f53c40ca050 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.824+0000 7f53bb400640 1 -- 172.21.15.2:0/684148693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00a850 con 0x7f53c40ca050 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.824+0000 7f53bb400640 1 -- 172.21.15.2:0/684148693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00abf0 con 0x7f53c40ca050 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.824+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c4169e40 con 0x7f53c40ca050 2024-08-17T02:46:39.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.824+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c40abae0 con 0x7f53c40ca050 2024-08-17T02:46:39.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.825+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c40abfe0 con 0x7f53c40ca050 2024-08-17T02:46:39.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.826+0000 7f53bb400640 1 -- 172.21.15.2:0/684148693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f53bc012420 con 0x7f53c40ca050 2024-08-17T02:46:39.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.827+0000 7f53bb400640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f53a4065150 0x7f53a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:39.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.827+0000 7f53bb400640 1 -- 172.21.15.2:0/684148693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53bc0825f0 con 0x7f53c40ca050 2024-08-17T02:46:39.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.827+0000 7f53c3e00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f53a4065150 0x7f53a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:39.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.828+0000 7f53c3e00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f53a4065150 0x7f53a4067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53b4034000 tx=0x7f53b4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:39.831+0000 7f53bb400640 1 -- 172.21.15.2:0/684148693 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f53bc050610 con 0x7f53c40ca050 2024-08-17T02:46:40.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.011+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53c415b5e0 con 0x7f53c40ca050 2024-08-17T02:46:40.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.012+0000 7f53bb400640 1 -- 172.21.15.2:0/684148693 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53c415b5e0 con 0x7f53c40ca050 2024-08-17T02:46:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:46:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f53a4065150 msgr2=0x7f53a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f53a4065150 0x7f53a4067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53b4034000 tx=0x7f53b4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ca050 msgr2=0x7f53c415a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ca050 0x7f53c415a620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c890 tx=0x7f53bc001690 comp rx=0 tx=0).stop 2024-08-17T02:46:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 shutdown_connections 2024-08-17T02:46:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53c40ca050 0x7f53c415a620 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f53a4065150 0x7f53a4067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53c40add30 0x7f53c4169420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 --2- 172.21.15.2:0/684148693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53c40ad960 0x7f53c4144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 >> 172.21.15.2:0/684148693 conn(0x7f53c4066e60 msgr2=0x7f53c41510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.014+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 shutdown_connections 2024-08-17T02:46:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.015+0000 7f53cac00640 1 -- 172.21.15.2:0/684148693 wait complete. 2024-08-17T02:46:40.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.184+0000 7f2b31e00640 1 Processor -- start 2024-08-17T02:46:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.184+0000 7f2b31e00640 1 -- start start 2024-08-17T02:46:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.185+0000 7f2b31e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b2c0acf10 0x7f2b2c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.185+0000 7f2b31e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c0c92b0 con 0x7f2b2c0afca0 2024-08-17T02:46:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.185+0000 7f2b31e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c0ad480 con 0x7f2b2c1590b0 2024-08-17T02:46:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.185+0000 7f2b31e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c0b0980 con 0x7f2b2c0acf10 2024-08-17T02:46:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.186+0000 7f2b2aa00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2b2c0afca0 0x7f2b2c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38486/0 (socket says 172.21.15.2:38486) 2024-08-17T02:46:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.186+0000 7f2b2aa00640 1 -- 172.21.15.2:0/4086020854 learned_addr learned my addr 172.21.15.2:0/4086020854 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.186+0000 7f2b2b400640 1 --2- 172.21.15.2:0/4086020854 >> v2:172.21.15.2:3300/0 conn(0x7f2b2c0acf10 0x7f2b2c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.186+0000 7f2b2a000640 1 -- 172.21.15.2:0/4086020854 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111818266 0 0) 0x7f2b2c0c92b0 con 0x7f2b2c0afca0 2024-08-17T02:46:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.186+0000 7f2b2b400640 1 -- 172.21.15.2:0/4086020854 >> v1:172.21.15.26:6789/0 conn(0x7f2b2c1590b0 legacy=0x7f2b2c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.186+0000 7f2b2b400640 1 -- 172.21.15.2:0/4086020854 >> v1:172.21.15.2:6789/0 conn(0x7f2b2c0afca0 legacy=0x7f2b2c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.186+0000 7f2b2b400640 1 -- 172.21.15.2:0/4086020854 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c0ad760 con 0x7f2b2c0acf10 2024-08-17T02:46:40.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.187+0000 7f2b2b400640 1 --2- 172.21.15.2:0/4086020854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0acf10 0x7f2b2c0b0070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009e60 tx=0x7f2b24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b202baf0dad503 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b2a000640 1 -- 172.21.15.2:0/4086020854 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24007550 con 0x7f2b2c0acf10 2024-08-17T02:46:40.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b2a000640 1 -- 172.21.15.2:0/4086020854 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2402d050 con 0x7f2b2c0acf10 2024-08-17T02:46:40.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b2a000640 1 -- 172.21.15.2:0/4086020854 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24007900 con 0x7f2b2c0acf10 2024-08-17T02:46:40.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b31e00640 1 -- 172.21.15.2:0/4086020854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0acf10 msgr2=0x7f2b2c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b31e00640 1 --2- 172.21.15.2:0/4086020854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0acf10 0x7f2b2c0b0070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009e60 tx=0x7f2b24009780 comp rx=0 tx=0).stop 2024-08-17T02:46:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b31e00640 1 -- 172.21.15.2:0/4086020854 shutdown_connections 2024-08-17T02:46:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b31e00640 1 --2- 172.21.15.2:0/4086020854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0acf10 0x7f2b2c0b0070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b31e00640 1 -- 172.21.15.2:0/4086020854 >> 172.21.15.2:0/4086020854 conn(0x7f2b2c066e60 msgr2=0x7f2b2c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b31e00640 1 -- 172.21.15.2:0/4086020854 shutdown_connections 2024-08-17T02:46:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.188+0000 7f2b31e00640 1 -- 172.21.15.2:0/4086020854 wait complete. 2024-08-17T02:46:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.190+0000 7f2b31e00640 1 Processor -- start 2024-08-17T02:46:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.190+0000 7f2b31e00640 1 -- start start 2024-08-17T02:46:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b31e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2c0acf10 0x7f2b2c155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b31e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0afca0 0x7f2b2c1395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b31e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2c1590b0 0x7f2b2c139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b31e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c152190 con 0x7f2b2c0afca0 2024-08-17T02:46:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b31e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c152470 con 0x7f2b2c0acf10 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b31e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c152750 con 0x7f2b2c1590b0 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b23e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0afca0 0x7f2b2c1395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b23e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0afca0 0x7f2b2c1395b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35114/0 (socket says 172.21.15.2:35114) 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b23e00640 1 -- 172.21.15.2:0/3945898657 learned_addr learned my addr 172.21.15.2:0/3945898657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b2aa00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2c0acf10 0x7f2b2c155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b2b400640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2c1590b0 0x7f2b2c139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b23e00640 1 -- 172.21.15.2:0/3945898657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2c1590b0 msgr2=0x7f2b2c139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b23e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2c1590b0 0x7f2b2c139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b23e00640 1 -- 172.21.15.2:0/3945898657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2c0acf10 msgr2=0x7f2b2c155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b23e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2c0acf10 0x7f2b2c155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b23e00640 1 -- 172.21.15.2:0/3945898657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24009a20 con 0x7f2b2c0afca0 2024-08-17T02:46:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.191+0000 7f2b2b400640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2c1590b0 0x7f2b2c139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.192+0000 7f2b23e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0afca0 0x7f2b2c1395b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400c490 tx=0x7f2b14007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.192+0000 7f2b22000640 1 -- 172.21.15.2:0/3945898657 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14011590 con 0x7f2b2c0afca0 2024-08-17T02:46:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.192+0000 7f2b22000640 1 -- 172.21.15.2:0/3945898657 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b14011710 con 0x7f2b2c0afca0 2024-08-17T02:46:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.192+0000 7f2b22000640 1 -- 172.21.15.2:0/3945898657 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14011ad0 con 0x7f2b2c0afca0 2024-08-17T02:46:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.192+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c152a30 con 0x7f2b2c0afca0 2024-08-17T02:46:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.192+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c155750 con 0x7f2b2c0afca0 2024-08-17T02:46:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.193+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c155970 con 0x7f2b2c0afca0 2024-08-17T02:46:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.194+0000 7f2b22000640 1 -- 172.21.15.2:0/3945898657 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b1401b3b0 con 0x7f2b2c0afca0 2024-08-17T02:46:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.195+0000 7f2b22000640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b08065150 0x7f2b08067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.195+0000 7f2b22000640 1 -- 172.21.15.2:0/3945898657 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b14081890 con 0x7f2b2c0afca0 2024-08-17T02:46:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.195+0000 7f2b2aa00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b08065150 0x7f2b08067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.196+0000 7f2b2aa00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b08065150 0x7f2b08067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0011e0 tx=0x7f2b1c007c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.198+0000 7f2b22000640 1 -- 172.21.15.2:0/3945898657 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2b1404f960 con 0x7f2b2c0afca0 2024-08-17T02:46:40.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.380+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b2c063fb0 con 0x7f2b2c0afca0 2024-08-17T02:46:40.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.381+0000 7f2b22000640 1 -- 172.21.15.2:0/3945898657 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b14017020 con 0x7f2b2c0afca0 2024-08-17T02:46:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:46:40.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b08065150 msgr2=0x7f2b08067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b08065150 0x7f2b08067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0011e0 tx=0x7f2b1c007c80 comp rx=0 tx=0).stop 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0afca0 msgr2=0x7f2b2c1395b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0afca0 0x7f2b2c1395b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400c490 tx=0x7f2b14007ec0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 shutdown_connections 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b08065150 0x7f2b08067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2b2c1590b0 0x7f2b2c139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c0afca0 0x7f2b2c1395b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 --2- 172.21.15.2:0/3945898657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2b2c0acf10 0x7f2b2c155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 >> 172.21.15.2:0/3945898657 conn(0x7f2b2c066e60 msgr2=0x7f2b2c069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 shutdown_connections 2024-08-17T02:46:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.383+0000 7f2b31e00640 1 -- 172.21.15.2:0/3945898657 wait complete. 2024-08-17T02:46:40.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.570+0000 7fd852200640 1 Processor -- start 2024-08-17T02:46:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.570+0000 7fd852200640 1 -- start start 2024-08-17T02:46:40.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.571+0000 7fd852200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd84c0b1920 0x7fd84c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.571+0000 7fd852200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c15b6b0 con 0x7fd84c158c60 2024-08-17T02:46:40.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.571+0000 7fd852200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c15aac0 con 0x7fd84c15a490 2024-08-17T02:46:40.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.571+0000 7fd852200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0b0540 con 0x7fd84c0b1920 2024-08-17T02:46:40.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.571+0000 7fd850e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd84c158c60 0x7fd84c159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38494/0 (socket says 172.21.15.2:38494) 2024-08-17T02:46:40.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.572+0000 7fd850e00640 1 -- 172.21.15.2:0/3124858742 learned_addr learned my addr 172.21.15.2:0/3124858742 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:40.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.572+0000 7fd851800640 1 --2- 172.21.15.2:0/3124858742 >> v2:172.21.15.26:3300/0 conn(0x7fd84c0b1920 0x7fd84c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.572+0000 7fd84b400640 1 -- 172.21.15.2:0/3124858742 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173940841 0 0) 0x7fd84c15b6b0 con 0x7fd84c158c60 2024-08-17T02:46:40.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.572+0000 7fd84b400640 1 -- 172.21.15.2:0/3124858742 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8340034e0 con 0x7fd84c158c60 2024-08-17T02:46:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.572+0000 7fd84b400640 1 -- 172.21.15.2:0/3124858742 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597452103 0 0) 0x7fd8340034e0 con 0x7fd84c158c60 2024-08-17T02:46:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.572+0000 7fd851800640 1 -- 172.21.15.2:0/3124858742 >> v1:172.21.15.26:6789/0 conn(0x7fd84c15a490 legacy=0x7fd84c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.572+0000 7fd851800640 1 -- 172.21.15.2:0/3124858742 >> v1:172.21.15.2:6789/0 conn(0x7fd84c158c60 legacy=0x7fd84c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.572+0000 7fd851800640 1 -- 172.21.15.2:0/3124858742 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c15ad80 con 0x7fd84c0b1920 2024-08-17T02:46:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.573+0000 7fd851800640 1 --2- 172.21.15.2:0/3124858742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c0b1920 0x7fd84c0b1d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd844009e60 tx=0x7fd844009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b826d24298d398ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd84b400640 1 -- 172.21.15.2:0/3124858742 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840001470 con 0x7fd84c0b1920 2024-08-17T02:46:40.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd84b400640 1 -- 172.21.15.2:0/3124858742 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84402d050 con 0x7fd84c0b1920 2024-08-17T02:46:40.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd84b400640 1 -- 172.21.15.2:0/3124858742 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844031630 con 0x7fd84c0b1920 2024-08-17T02:46:40.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd852200640 1 -- 172.21.15.2:0/3124858742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c0b1920 msgr2=0x7fd84c0b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd852200640 1 --2- 172.21.15.2:0/3124858742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c0b1920 0x7fd84c0b1d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd844009e60 tx=0x7fd844009780 comp rx=0 tx=0).stop 2024-08-17T02:46:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd852200640 1 -- 172.21.15.2:0/3124858742 shutdown_connections 2024-08-17T02:46:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd852200640 1 --2- 172.21.15.2:0/3124858742 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c0b1920 0x7fd84c0b1d40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd852200640 1 -- 172.21.15.2:0/3124858742 >> 172.21.15.2:0/3124858742 conn(0x7fd84c06e590 msgr2=0x7fd84c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.574+0000 7fd852200640 1 -- 172.21.15.2:0/3124858742 shutdown_connections 2024-08-17T02:46:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.575+0000 7fd852200640 1 -- 172.21.15.2:0/3124858742 wait complete. 2024-08-17T02:46:40.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.576+0000 7fd852200640 1 Processor -- start 2024-08-17T02:46:40.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.576+0000 7fd852200640 1 -- start start 2024-08-17T02:46:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd852200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd84c0b1920 0x7fd84c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd852200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd84c158c60 0x7fd84c0af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd852200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c15a490 0x7fd84c0a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd852200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1688f0 con 0x7fd84c0b1920 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd852200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0c8be0 con 0x7fd84c15a490 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd852200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0c8ec0 con 0x7fd84c158c60 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd850e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd84c0b1920 0x7fd84c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd850e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd84c0b1920 0x7fd84c157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35124/0 (socket says 172.21.15.2:35124) 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.577+0000 7fd850e00640 1 -- 172.21.15.2:0/587635179 learned_addr learned my addr 172.21.15.2:0/587635179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd851800640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c15a490 0x7fd84c0a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd850e00640 1 -- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd84c158c60 msgr2=0x7fd84c0af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd84be00640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd84c158c60 0x7fd84c0af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd850e00640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd84c158c60 0x7fd84c0af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd850e00640 1 -- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c15a490 msgr2=0x7fd84c0a6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd850e00640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c15a490 0x7fd84c0a6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd850e00640 1 -- 172.21.15.2:0/587635179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844009a20 con 0x7fd84c0b1920 2024-08-17T02:46:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd851800640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c15a490 0x7fd84c0a6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd84be00640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd84c158c60 0x7fd84c0af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd850e00640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd84c0b1920 0x7fd84c157a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd84000cb90 tx=0x7fd840001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd83fe00640 1 -- 172.21.15.2:0/587635179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840007360 con 0x7fd84c0b1920 2024-08-17T02:46:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c0c91a0 con 0x7fd84c0b1920 2024-08-17T02:46:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd83fe00640 1 -- 172.21.15.2:0/587635179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400074e0 con 0x7fd84c0b1920 2024-08-17T02:46:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd83fe00640 1 -- 172.21.15.2:0/587635179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400049f0 con 0x7fd84c0b1920 2024-08-17T02:46:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.578+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c157f60 con 0x7fd84c0b1920 2024-08-17T02:46:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.579+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c0c96a0 con 0x7fd84c0b1920 2024-08-17T02:46:40.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.580+0000 7fd83fe00640 1 -- 172.21.15.2:0/587635179 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd84000a640 con 0x7fd84c0b1920 2024-08-17T02:46:40.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.581+0000 7fd83fe00640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd82c065150 0x7fd82c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.581+0000 7fd83fe00640 1 -- 172.21.15.2:0/587635179 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd840081a10 con 0x7fd84c0b1920 2024-08-17T02:46:40.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.581+0000 7fd84be00640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd82c065150 0x7fd82c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.582+0000 7fd84be00640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd82c065150 0x7fd82c067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0cd360 tx=0x7fd838009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.585+0000 7fd83fe00640 1 -- 172.21.15.2:0/587635179 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd84004fa30 con 0x7fd84c0b1920 2024-08-17T02:46:40.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.766+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd84c0c3500 con 0x7fd84c0b1920 2024-08-17T02:46:40.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.767+0000 7fd83fe00640 1 -- 172.21.15.2:0/587635179 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fd840018020 con 0x7fd84c0b1920 2024-08-17T02:46:40.767 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd82c065150 msgr2=0x7fd82c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd82c065150 0x7fd82c067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0cd360 tx=0x7fd838009040 comp rx=0 tx=0).stop 2024-08-17T02:46:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd84c0b1920 msgr2=0x7fd84c157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd84c0b1920 0x7fd84c157a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd84000cb90 tx=0x7fd840001b80 comp rx=0 tx=0).stop 2024-08-17T02:46:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 shutdown_connections 2024-08-17T02:46:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd84c15a490 0x7fd84c0a6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd82c065150 0x7fd82c067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd84c158c60 0x7fd84c0af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 --2- 172.21.15.2:0/587635179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd84c0b1920 0x7fd84c157a20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.769+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 >> 172.21.15.2:0/587635179 conn(0x7fd84c06e590 msgr2=0x7fd84c0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.770+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 shutdown_connections 2024-08-17T02:46:40.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.770+0000 7fd852200640 1 -- 172.21.15.2:0/587635179 wait complete. 2024-08-17T02:46:40.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:10.965028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:12.163837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:40.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.940+0000 7f8d85600640 1 Processor -- start 2024-08-17T02:46:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.940+0000 7f8d85600640 1 -- start start 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d85600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8d80158b60 0x7f8d800aa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d85600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158f30 0x7f8d800ac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d85600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d800a8dd0 con 0x7f8d80067aa0 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d85600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d800aa270 con 0x7f8d80158b60 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d85600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800abbc0 con 0x7f8d80158f30 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d7ea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8d80158b60 0x7f8d800aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d7ea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8d80158b60 0x7f8d800aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35126/0 (socket says 172.21.15.2:35126) 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d7f400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8d80067aa0 0x7f8d800ac960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38498/0 (socket says 172.21.15.2:38498) 2024-08-17T02:46:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.941+0000 7f8d7ea00640 1 -- 172.21.15.2:0/3002402113 learned_addr learned my addr 172.21.15.2:0/3002402113 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.942+0000 7f8d7e000640 1 --2- 172.21.15.2:0/3002402113 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158f30 0x7f8d800ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.942+0000 7f8d7ea00640 1 -- 172.21.15.2:0/3002402113 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158f30 msgr2=0x7f8d800ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.942+0000 7f8d7ea00640 1 --2- 172.21.15.2:0/3002402113 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158f30 0x7f8d800ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.942+0000 7f8d7ea00640 1 -- 172.21.15.2:0/3002402113 >> v1:172.21.15.2:6789/0 conn(0x7f8d80067aa0 legacy=0x7f8d800ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.942+0000 7f8d7ea00640 1 -- 172.21.15.2:0/3002402113 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800abe60 con 0x7f8d80158b60 2024-08-17T02:46:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.943+0000 7f8d7ea00640 1 --2- 172.21.15.2:0/3002402113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80158b60 0x7f8d800aa640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009910 tx=0x7f8d700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bab3926fdbece7d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.943+0000 7f8d7d600640 1 -- 172.21.15.2:0/3002402113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7002ae40 con 0x7f8d80158b60 2024-08-17T02:46:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.943+0000 7f8d7d600640 1 -- 172.21.15.2:0/3002402113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70032440 con 0x7f8d80158b60 2024-08-17T02:46:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.943+0000 7f8d7d600640 1 -- 172.21.15.2:0/3002402113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70032820 con 0x7f8d80158b60 2024-08-17T02:46:40.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.944+0000 7f8d85600640 1 -- 172.21.15.2:0/3002402113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80158b60 msgr2=0x7f8d800aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.944+0000 7f8d85600640 1 --2- 172.21.15.2:0/3002402113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80158b60 0x7f8d800aa640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009910 tx=0x7f8d700091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.944+0000 7f8d85600640 1 -- 172.21.15.2:0/3002402113 shutdown_connections 2024-08-17T02:46:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.944+0000 7f8d85600640 1 --2- 172.21.15.2:0/3002402113 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158f30 0x7f8d800ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.944+0000 7f8d85600640 1 --2- 172.21.15.2:0/3002402113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80158b60 0x7f8d800aa640 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.944+0000 7f8d85600640 1 -- 172.21.15.2:0/3002402113 >> 172.21.15.2:0/3002402113 conn(0x7f8d800cc390 msgr2=0x7f8d80066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.944+0000 7f8d85600640 1 -- 172.21.15.2:0/3002402113 shutdown_connections 2024-08-17T02:46:40.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.944+0000 7f8d85600640 1 -- 172.21.15.2:0/3002402113 wait complete. 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.945+0000 7f8d85600640 1 Processor -- start 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.945+0000 7f8d85600640 1 -- start start 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d85600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80067aa0 0x7f8d8013d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d85600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158b60 0x7f8d80157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d85600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d80158f30 0x7f8d80152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d85600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d801577b0 con 0x7f8d80067aa0 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d85600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8014cd80 con 0x7f8d80158f30 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d85600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8014d060 con 0x7f8d80158b60 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d7ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80067aa0 0x7f8d8013d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d7ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80067aa0 0x7f8d8013d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35132/0 (socket says 172.21.15.2:35132) 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d7ea00640 1 -- 172.21.15.2:0/4096477492 learned_addr learned my addr 172.21.15.2:0/4096477492 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.946+0000 7f8d7e000640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158b60 0x7f8d80157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d7f400640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d80158f30 0x7f8d80152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d7ea00640 1 -- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158b60 msgr2=0x7f8d80157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d7ea00640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158b60 0x7f8d80157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d7ea00640 1 -- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d80158f30 msgr2=0x7f8d80152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d7ea00640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d80158f30 0x7f8d80152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d7ea00640 1 -- 172.21.15.2:0/4096477492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70009450 con 0x7f8d80067aa0 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d7f400640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d80158f30 0x7f8d80152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:40.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d7ea00640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80067aa0 0x7f8d8013d2c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8d70035040 tx=0x7f8d70032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d76000640 1 -- 172.21.15.2:0/4096477492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70000d10 con 0x7f8d80067aa0 2024-08-17T02:46:40.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d76000640 1 -- 172.21.15.2:0/4096477492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70031de0 con 0x7f8d80067aa0 2024-08-17T02:46:40.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d76000640 1 -- 172.21.15.2:0/4096477492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7003d6b0 con 0x7f8d80067aa0 2024-08-17T02:46:40.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.947+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d80157160 con 0x7f8d80067aa0 2024-08-17T02:46:40.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.948+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8013d800 con 0x7f8d80067aa0 2024-08-17T02:46:40.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.949+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d80156fc0 con 0x7f8d80067aa0 2024-08-17T02:46:40.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.949+0000 7f8d76000640 1 -- 172.21.15.2:0/4096477492 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8d70039040 con 0x7f8d80067aa0 2024-08-17T02:46:40.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.950+0000 7f8d76000640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8d60065150 0x7f8d60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.950+0000 7f8d76000640 1 -- 172.21.15.2:0/4096477492 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d7002ae40 con 0x7f8d80067aa0 2024-08-17T02:46:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.950+0000 7f8d7e000640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8d60065150 0x7f8d60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:40.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.951+0000 7f8d7e000640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8d60065150 0x7f8d60067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d8015d420 tx=0x7f8d6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:40.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:40.954+0000 7f8d76000640 1 -- 172.21.15.2:0/4096477492 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8d80156fc0 con 0x7f8d80067aa0 2024-08-17T02:46:41.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.139+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d80156fc0 con 0x7f8d80067aa0 2024-08-17T02:46:41.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.139+0000 7f8d76000640 1 -- 172.21.15.2:0/4096477492 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d80156fc0 con 0x7f8d80067aa0 2024-08-17T02:46:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:41.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8d60065150 msgr2=0x7f8d60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8d60065150 0x7f8d60067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d8015d420 tx=0x7f8d6c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:41.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80067aa0 msgr2=0x7f8d8013d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80067aa0 0x7f8d8013d2c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8d70035040 tx=0x7f8d70032000 comp rx=0 tx=0).stop 2024-08-17T02:46:41.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 shutdown_connections 2024-08-17T02:46:41.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d80158f30 0x7f8d80152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8d60065150 0x7f8d60067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8d80158b60 0x7f8d80157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 --2- 172.21.15.2:0/4096477492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d80067aa0 0x7f8d8013d2c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 >> 172.21.15.2:0/4096477492 conn(0x7f8d800cc390 msgr2=0x7f8d8006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:41.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 shutdown_connections 2024-08-17T02:46:41.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.141+0000 7f8d85600640 1 -- 172.21.15.2:0/4096477492 wait complete. 2024-08-17T02:46:41.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:41.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.310+0000 7f4e0be00640 1 Processor -- start 2024-08-17T02:46:41.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.311+0000 7f4e0be00640 1 -- start start 2024-08-17T02:46:41.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.312+0000 7f4e0be00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4e0c0ae7d0 0x7f4e0c0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.312+0000 7f4e0be00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0b08d0 con 0x7f4e0c156900 2024-08-17T02:46:41.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.312+0000 7f4e0be00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0b0b10 con 0x7f4e0c156cd0 2024-08-17T02:46:41.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.312+0000 7f4e0be00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c0b0df0 con 0x7f4e0c0ae7d0 2024-08-17T02:46:41.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.312+0000 7f4e0aa00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4e0c156900 0x7f4e0c0b01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38506/0 (socket says 172.21.15.2:38506) 2024-08-17T02:46:41.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.312+0000 7f4e0aa00640 1 -- 172.21.15.2:0/751260629 learned_addr learned my addr 172.21.15.2:0/751260629 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:41.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.312+0000 7f4e03e00640 1 --2- 172.21.15.2:0/751260629 >> v2:172.21.15.26:3300/0 conn(0x7f4e0c0ae7d0 0x7f4e0c0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.312+0000 7f4e0a000640 1 -- 172.21.15.2:0/751260629 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638542879 0 0) 0x7f4dfc001110 con 0x7f4e0c156900 2024-08-17T02:46:41.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.313+0000 7f4e0a000640 1 -- 172.21.15.2:0/751260629 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df00034e0 con 0x7f4e0c156900 2024-08-17T02:46:41.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.313+0000 7f4e0a000640 1 -- 172.21.15.2:0/751260629 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724961645 0 0) 0x7f4e0c0b0b10 con 0x7f4e0c156cd0 2024-08-17T02:46:41.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.313+0000 7f4e0a000640 1 -- 172.21.15.2:0/751260629 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dfc001110 con 0x7f4e0c156cd0 2024-08-17T02:46:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.313+0000 7f4e03e00640 1 -- 172.21.15.2:0/751260629 >> v1:172.21.15.26:6789/0 conn(0x7f4e0c156cd0 legacy=0x7f4e0c0aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.313+0000 7f4e03e00640 1 -- 172.21.15.2:0/751260629 >> v1:172.21.15.2:6789/0 conn(0x7f4e0c156900 legacy=0x7f4e0c0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.313+0000 7f4e03e00640 1 -- 172.21.15.2:0/751260629 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0b10d0 con 0x7f4e0c0ae7d0 2024-08-17T02:46:41.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.314+0000 7f4e03e00640 1 --2- 172.21.15.2:0/751260629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 0x7f4e0c0ada70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009850 tx=0x7f4df40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1855e0467a97427e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.314+0000 7f4e0a000640 1 -- 172.21.15.2:0/751260629 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df402ae20 con 0x7f4e0c0ae7d0 2024-08-17T02:46:41.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.314+0000 7f4e0a000640 1 -- 172.21.15.2:0/751260629 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df4032440 con 0x7f4e0c0ae7d0 2024-08-17T02:46:41.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.314+0000 7f4e0a000640 1 -- 172.21.15.2:0/751260629 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40327c0 con 0x7f4e0c0ae7d0 2024-08-17T02:46:41.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.315+0000 7f4e0be00640 1 -- 172.21.15.2:0/751260629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 msgr2=0x7f4e0c0ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.315+0000 7f4e0be00640 1 --2- 172.21.15.2:0/751260629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 0x7f4e0c0ada70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009850 tx=0x7f4df40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.315+0000 7f4e0be00640 1 -- 172.21.15.2:0/751260629 shutdown_connections 2024-08-17T02:46:41.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.315+0000 7f4e0be00640 1 --2- 172.21.15.2:0/751260629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 0x7f4e0c0ada70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.315+0000 7f4e0be00640 1 -- 172.21.15.2:0/751260629 >> 172.21.15.2:0/751260629 conn(0x7f4e0c067930 msgr2=0x7f4e0c0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:41.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.315+0000 7f4e0be00640 1 -- 172.21.15.2:0/751260629 shutdown_connections 2024-08-17T02:46:41.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.315+0000 7f4e0be00640 1 -- 172.21.15.2:0/751260629 wait complete. 2024-08-17T02:46:41.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.316+0000 7f4e0be00640 1 Processor -- start 2024-08-17T02:46:41.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.316+0000 7f4e0be00640 1 -- start start 2024-08-17T02:46:41.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.317+0000 7f4e0be00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 0x7f4e0c1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.317+0000 7f4e0be00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e0c156900 0x7f4e0c166a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.317+0000 7f4e0be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e0c156cd0 0x7f4e0c14d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.317+0000 7f4e0be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c14f9d0 con 0x7f4e0c156cd0 2024-08-17T02:46:41.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.317+0000 7f4e0be00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c16b630 con 0x7f4e0c0ae7d0 2024-08-17T02:46:41.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.317+0000 7f4e0be00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c14a860 con 0x7f4e0c156900 2024-08-17T02:46:41.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.317+0000 7f4e0b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e0c156cd0 0x7f4e0c14d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.317+0000 7f4e0b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e0c156cd0 0x7f4e0c14d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35138/0 (socket says 172.21.15.2:35138) 2024-08-17T02:46:41.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e0b400640 1 -- 172.21.15.2:0/3876463834 learned_addr learned my addr 172.21.15.2:0/3876463834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:41.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e0aa00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 0x7f4e0c1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e03e00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e0c156900 0x7f4e0c166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e0b400640 1 -- 172.21.15.2:0/3876463834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e0c156900 msgr2=0x7f4e0c166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e0b400640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e0c156900 0x7f4e0c166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e0b400640 1 -- 172.21.15.2:0/3876463834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 msgr2=0x7f4e0c1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e0b400640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 0x7f4e0c1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e0b400640 1 -- 172.21.15.2:0/3876463834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4009390 con 0x7f4e0c156cd0 2024-08-17T02:46:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.318+0000 7f4e0b400640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e0c156cd0 0x7f4e0c14d100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c840 tx=0x7f4e04002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.319+0000 7f4e02000640 1 -- 172.21.15.2:0/3876463834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400a640 con 0x7f4e0c156cd0 2024-08-17T02:46:41.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.319+0000 7f4e02000640 1 -- 172.21.15.2:0/3876463834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400a7a0 con 0x7f4e0c156cd0 2024-08-17T02:46:41.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.319+0000 7f4e02000640 1 -- 172.21.15.2:0/3876463834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400aba0 con 0x7f4e0c156cd0 2024-08-17T02:46:41.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.319+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c155200 con 0x7f4e0c156cd0 2024-08-17T02:46:41.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.319+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c166fc0 con 0x7f4e0c156cd0 2024-08-17T02:46:41.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.320+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c070720 con 0x7f4e0c156cd0 2024-08-17T02:46:41.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.320+0000 7f4e02000640 1 -- 172.21.15.2:0/3876463834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4e04012420 con 0x7f4e0c156cd0 2024-08-17T02:46:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.322+0000 7f4e02000640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4de8065150 0x7f4de8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.322+0000 7f4e02000640 1 -- 172.21.15.2:0/3876463834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e04082090 con 0x7f4e0c156cd0 2024-08-17T02:46:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.322+0000 7f4e0aa00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4de8065150 0x7f4de8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.323+0000 7f4e0aa00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4de8065150 0x7f4de8067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0010e0 tx=0x7f4dfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.326+0000 7f4e02000640 1 -- 172.21.15.2:0/3876463834 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4e04050160 con 0x7f4e0c156cd0 2024-08-17T02:46:41.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.507+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e0c1571c0 con 0x7f4e0c156cd0 2024-08-17T02:46:41.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.507+0000 7f4e02000640 1 -- 172.21.15.2:0/3876463834 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e04053780 con 0x7f4e0c156cd0 2024-08-17T02:46:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.509+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4de8065150 msgr2=0x7f4de8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.509+0000 7f4e0be00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4de8065150 0x7f4de8067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0010e0 tx=0x7f4dfc009040 comp rx=0 tx=0).stop 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.509+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e0c156cd0 msgr2=0x7f4e0c14d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.509+0000 7f4e0be00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e0c156cd0 0x7f4e0c14d100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c840 tx=0x7f4e04002650 comp rx=0 tx=0).stop 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.510+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 shutdown_connections 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.510+0000 7f4e0be00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e0c156cd0 0x7f4e0c14d100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.510+0000 7f4e0be00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4de8065150 0x7f4de8067600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.510+0000 7f4e0be00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4e0c156900 0x7f4e0c166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.510+0000 7f4e0be00640 1 --2- 172.21.15.2:0/3876463834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4e0c0ae7d0 0x7f4e0c1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.510+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 >> 172.21.15.2:0/3876463834 conn(0x7f4e0c067930 msgr2=0x7f4e0c0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.510+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 shutdown_connections 2024-08-17T02:46:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.510+0000 7f4e0be00640 1 -- 172.21.15.2:0/3876463834 wait complete. 2024-08-17T02:46:41.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:41.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.679+0000 7fb1a2800640 1 Processor -- start 2024-08-17T02:46:41.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.679+0000 7fb1a2800640 1 -- start start 2024-08-17T02:46:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.680+0000 7fb1a2800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0afca0 0x7fb19c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.680+0000 7fb1a2800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c0c92b0 con 0x7fb19c1590b0 2024-08-17T02:46:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.680+0000 7fb1a2800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c0ad480 con 0x7fb19c0acf10 2024-08-17T02:46:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.680+0000 7fb1a2800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0b0980 con 0x7fb19c0afca0 2024-08-17T02:46:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb19c1590b0 0x7fb19c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38510/0 (socket says 172.21.15.2:38510) 2024-08-17T02:46:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19be00640 1 -- 172.21.15.2:0/2099044927 learned_addr learned my addr 172.21.15.2:0/2099044927 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19b400640 1 --2- 172.21.15.2:0/2099044927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0afca0 0x7fb19c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19a000640 1 -- 172.21.15.2:0/2099044927 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865663570 0 0) 0x7fb19c0c92b0 con 0x7fb19c1590b0 2024-08-17T02:46:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19a000640 1 -- 172.21.15.2:0/2099044927 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1800034e0 con 0x7fb19c1590b0 2024-08-17T02:46:41.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19b400640 1 -- 172.21.15.2:0/2099044927 >> v1:172.21.15.26:6789/0 conn(0x7fb19c0acf10 legacy=0x7fb19c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19a000640 1 -- 172.21.15.2:0/2099044927 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257327542 0 0) 0x7fb19c0ad480 con 0x7fb19c0acf10 2024-08-17T02:46:41.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19b400640 1 -- 172.21.15.2:0/2099044927 >> v1:172.21.15.2:6789/0 conn(0x7fb19c1590b0 legacy=0x7fb19c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.681+0000 7fb19b400640 1 -- 172.21.15.2:0/2099044927 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0ad760 con 0x7fb19c0afca0 2024-08-17T02:46:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.682+0000 7fb19b400640 1 --2- 172.21.15.2:0/2099044927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0afca0 0x7fb19c0b0070 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009880 tx=0x7fb18c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc32bc34dd3897f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb19a000640 1 -- 172.21.15.2:0/2099044927 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c02ae10 con 0x7fb19c0afca0 2024-08-17T02:46:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb19a000640 1 -- 172.21.15.2:0/2099044927 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c032440 con 0x7fb19c0afca0 2024-08-17T02:46:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb19a000640 1 -- 172.21.15.2:0/2099044927 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0327c0 con 0x7fb19c0afca0 2024-08-17T02:46:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb1a2800640 1 -- 172.21.15.2:0/2099044927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0afca0 msgr2=0x7fb19c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb1a2800640 1 --2- 172.21.15.2:0/2099044927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0afca0 0x7fb19c0b0070 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009880 tx=0x7fb18c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb1a2800640 1 -- 172.21.15.2:0/2099044927 shutdown_connections 2024-08-17T02:46:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb1a2800640 1 --2- 172.21.15.2:0/2099044927 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0afca0 0x7fb19c0b0070 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb1a2800640 1 -- 172.21.15.2:0/2099044927 >> 172.21.15.2:0/2099044927 conn(0x7fb19c066e60 msgr2=0x7fb19c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb1a2800640 1 -- 172.21.15.2:0/2099044927 shutdown_connections 2024-08-17T02:46:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.683+0000 7fb1a2800640 1 -- 172.21.15.2:0/2099044927 wait complete. 2024-08-17T02:46:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.685+0000 7fb1a2800640 1 Processor -- start 2024-08-17T02:46:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.685+0000 7fb1a2800640 1 -- start start 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb1a2800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0acf10 0x7fb19c0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb1a2800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb19c0afca0 0x7fb19c0c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb1a2800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb19c1590b0 0x7fb19c142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb1a2800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0c7e50 con 0x7fb19c0afca0 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb1a2800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0c5990 con 0x7fb19c1590b0 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb1a2800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0c2440 con 0x7fb19c0acf10 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb19c0afca0 0x7fb19c0c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb19c0afca0 0x7fb19c0c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35150/0 (socket says 172.21.15.2:35150) 2024-08-17T02:46:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19aa00640 1 -- 172.21.15.2:0/1694816622 learned_addr learned my addr 172.21.15.2:0/1694816622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19b400640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0acf10 0x7fb19c0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19aa00640 1 -- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0acf10 msgr2=0x7fb19c0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19be00640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb19c1590b0 0x7fb19c142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19aa00640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0acf10 0x7fb19c0c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19aa00640 1 -- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb19c1590b0 msgr2=0x7fb19c142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19aa00640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb19c1590b0 0x7fb19c142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19aa00640 1 -- 172.21.15.2:0/1694816622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c009390 con 0x7fb19c0afca0 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19b400640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0acf10 0x7fb19c0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.686+0000 7fb19be00640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb19c1590b0 0x7fb19c142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.687+0000 7fb19aa00640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb19c0afca0 0x7fb19c0c5450 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb18800c5b0 tx=0x7fb188007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.687+0000 7fb192a00640 1 -- 172.21.15.2:0/1694816622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188012630 con 0x7fb19c0afca0 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.687+0000 7fb192a00640 1 -- 172.21.15.2:0/1694816622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1880127b0 con 0x7fb19c0afca0 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.687+0000 7fb192a00640 1 -- 172.21.15.2:0/1694816622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188012b70 con 0x7fb19c0afca0 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.687+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c0c2ce0 con 0x7fb19c0afca0 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.687+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c0c2690 con 0x7fb19c0afca0 2024-08-17T02:46:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.688+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c0c2e70 con 0x7fb19c0afca0 2024-08-17T02:46:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.689+0000 7fb192a00640 1 -- 172.21.15.2:0/1694816622 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb18801b400 con 0x7fb19c0afca0 2024-08-17T02:46:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.690+0000 7fb192a00640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb17c065150 0x7fb17c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.690+0000 7fb192a00640 1 -- 172.21.15.2:0/1694816622 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb188081ff0 con 0x7fb19c0afca0 2024-08-17T02:46:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.690+0000 7fb19b400640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb17c065150 0x7fb17c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.691+0000 7fb19b400640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb17c065150 0x7fb17c067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb18c034000 tx=0x7fb18c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.694+0000 7fb192a00640 1 -- 172.21.15.2:0/1694816622 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb188050010 con 0x7fb19c0afca0 2024-08-17T02:46:41.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.874+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb19c063fb0 con 0x7fb19c0afca0 2024-08-17T02:46:41.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.875+0000 7fb192a00640 1 -- 172.21.15.2:0/1694816622 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb188053630 con 0x7fb19c0afca0 2024-08-17T02:46:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb17c065150 msgr2=0x7fb17c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb17c065150 0x7fb17c067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb18c034000 tx=0x7fb18c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb19c0afca0 msgr2=0x7fb19c0c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb19c0afca0 0x7fb19c0c5450 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb18800c5b0 tx=0x7fb188007d60 comp rx=0 tx=0).stop 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 shutdown_connections 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb19c1590b0 0x7fb19c142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb19c0afca0 0x7fb19c0c5450 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb17c065150 0x7fb17c067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 --2- 172.21.15.2:0/1694816622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb19c0acf10 0x7fb19c0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 >> 172.21.15.2:0/1694816622 conn(0x7fb19c066e60 msgr2=0x7fb19c14c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 shutdown_connections 2024-08-17T02:46:41.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:41.877+0000 7fb1a2800640 1 -- 172.21.15.2:0/1694816622 wait complete. 2024-08-17T02:46:41.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:42.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.043+0000 7fc1b2600640 1 Processor -- start 2024-08-17T02:46:42.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.043+0000 7fc1b2600640 1 -- start start 2024-08-17T02:46:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1b2600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 0x7fc1ac0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1b2600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1ac0acf10 0x7fc1ac159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1b2600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac15a4e0 con 0x7fc1ac1589a0 2024-08-17T02:46:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1b2600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0b0980 con 0x7fc1ac0acf10 2024-08-17T02:46:42.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1b2600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0c92b0 con 0x7fc1ac0afca0 2024-08-17T02:46:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1a3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1ac0acf10 0x7fc1ac159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1a3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1ac0acf10 0x7fc1ac159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35164/0 (socket says 172.21.15.2:35164) 2024-08-17T02:46:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1a3e00640 1 -- 172.21.15.2:0/1319923873 learned_addr learned my addr 172.21.15.2:0/1319923873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1ab400640 1 --2- 172.21.15.2:0/1319923873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 0x7fc1ac0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1a3e00640 1 -- 172.21.15.2:0/1319923873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 msgr2=0x7fc1ac0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1a3e00640 1 --2- 172.21.15.2:0/1319923873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 0x7fc1ac0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1a3e00640 1 -- 172.21.15.2:0/1319923873 >> v1:172.21.15.26:6789/0 conn(0x7fc1ac1589a0 legacy=0x7fc1ac06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:42.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.045+0000 7fc1a3e00640 1 -- 172.21.15.2:0/1319923873 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0ad480 con 0x7fc1ac0acf10 2024-08-17T02:46:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.046+0000 7fc1a3e00640 1 --2- 172.21.15.2:0/1319923873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac159fa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc194009940 tx=0x7fc1940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a793346fc464efcf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1aaa00640 1 -- 172.21.15.2:0/1319923873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19402ade0 con 0x7fc1ac0acf10 2024-08-17T02:46:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1aaa00640 1 -- 172.21.15.2:0/1319923873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194032440 con 0x7fc1ac0acf10 2024-08-17T02:46:42.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1aaa00640 1 -- 172.21.15.2:0/1319923873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1940327e0 con 0x7fc1ac0acf10 2024-08-17T02:46:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1b2600640 1 -- 172.21.15.2:0/1319923873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 msgr2=0x7fc1ac159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1319923873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac159fa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc194009940 tx=0x7fc1940091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1b2600640 1 -- 172.21.15.2:0/1319923873 shutdown_connections 2024-08-17T02:46:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1319923873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac159fa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1319923873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 0x7fc1ac0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1b2600640 1 -- 172.21.15.2:0/1319923873 >> 172.21.15.2:0/1319923873 conn(0x7fc1ac066e60 msgr2=0x7fc1ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1b2600640 1 -- 172.21.15.2:0/1319923873 shutdown_connections 2024-08-17T02:46:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.047+0000 7fc1b2600640 1 -- 172.21.15.2:0/1319923873 wait complete. 2024-08-17T02:46:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.049+0000 7fc1b2600640 1 Processor -- start 2024-08-17T02:46:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.049+0000 7fc1b2600640 1 -- start start 2024-08-17T02:46:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1b2600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1b2600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 0x7fc1ac156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1b2600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ac1589a0 0x7fc1ac153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1b2600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac157f60 con 0x7fc1ac0acf10 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1b2600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac157350 con 0x7fc1ac1589a0 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1b2600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac157630 con 0x7fc1ac0afca0 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1ab400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1ab400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35178/0 (socket says 172.21.15.2:35178) 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1ab400640 1 -- 172.21.15.2:0/1607917025 learned_addr learned my addr 172.21.15.2:0/1607917025 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1a3e00640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 0x7fc1ac156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.050+0000 7fc1abe00640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ac1589a0 0x7fc1ac153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1ab400640 1 -- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 msgr2=0x7fc1ac156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1ab400640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 0x7fc1ac156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1ab400640 1 -- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ac1589a0 msgr2=0x7fc1ac153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1ab400640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ac1589a0 0x7fc1ac153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1ab400640 1 -- 172.21.15.2:0/1607917025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194009450 con 0x7fc1ac0acf10 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1abe00640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ac1589a0 0x7fc1ac153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1ab400640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac143310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00d890 tx=0x7fc19c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1a2a00640 1 -- 172.21.15.2:0/1607917025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00de20 con 0x7fc1ac0acf10 2024-08-17T02:46:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1a2a00640 1 -- 172.21.15.2:0/1607917025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00b8d0 con 0x7fc1ac0acf10 2024-08-17T02:46:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac157910 con 0x7fc1ac0acf10 2024-08-17T02:46:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1a2a00640 1 -- 172.21.15.2:0/1607917025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00bc70 con 0x7fc1ac0acf10 2024-08-17T02:46:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.051+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac143850 con 0x7fc1ac0acf10 2024-08-17T02:46:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.052+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac063fb0 con 0x7fc1ac0acf10 2024-08-17T02:46:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.053+0000 7fc1a2a00640 1 -- 172.21.15.2:0/1607917025 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc19c014640 con 0x7fc1ac0acf10 2024-08-17T02:46:42.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.054+0000 7fc1a2a00640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc188065150 0x7fc188067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.054+0000 7fc1a2a00640 1 -- 172.21.15.2:0/1607917025 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc19c082a90 con 0x7fc1ac0acf10 2024-08-17T02:46:42.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.054+0000 7fc1a3e00640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc188065150 0x7fc188067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.055+0000 7fc1a3e00640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc188065150 0x7fc188067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc194034000 tx=0x7fc194032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.058+0000 7fc1a2a00640 1 -- 172.21.15.2:0/1607917025 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc19c050b70 con 0x7fc1ac0acf10 2024-08-17T02:46:42.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.248+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1ac067b70 con 0x7fc1ac0acf10 2024-08-17T02:46:42.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.249+0000 7fc1a2a00640 1 -- 172.21.15.2:0/1607917025 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fc19c054190 con 0x7fc1ac0acf10 2024-08-17T02:46:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.251+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc188065150 msgr2=0x7fc188067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.251+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc188065150 0x7fc188067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc194034000 tx=0x7fc194032000 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.251+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 msgr2=0x7fc1ac143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.251+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac143310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00d890 tx=0x7fc19c008040 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.252+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 shutdown_connections 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.252+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc1ac1589a0 0x7fc1ac153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.252+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc188065150 0x7fc188067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.252+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc1ac0afca0 0x7fc1ac156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.252+0000 7fc1b2600640 1 --2- 172.21.15.2:0/1607917025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1ac0acf10 0x7fc1ac143310 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.252+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 >> 172.21.15.2:0/1607917025 conn(0x7fc1ac066e60 msgr2=0x7fc1ac1512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.252+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 shutdown_connections 2024-08-17T02:46:42.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.252+0000 7fc1b2600640 1 -- 172.21.15.2:0/1607917025 wait complete. 2024-08-17T02:46:42.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:10.965028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:12.163837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:42.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.425+0000 7f230d800640 1 Processor -- start 2024-08-17T02:46:42.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.425+0000 7f230d800640 1 -- start start 2024-08-17T02:46:42.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f230d800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2308156bd0 0x7f23080b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f230d800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f23080adf90 0x7f23080b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f230d800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23080ac040 con 0x7f2308156fa0 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f230d800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2308067810 con 0x7f23080adf90 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f230d800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23080ab150 con 0x7f2308156bd0 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f2307400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2308156fa0 0x7f23080ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38526/0 (socket says 172.21.15.2:38526) 2024-08-17T02:46:42.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f2307400640 1 -- 172.21.15.2:0/2220877102 learned_addr learned my addr 172.21.15.2:0/2220877102 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f2306000640 1 --2- 172.21.15.2:0/2220877102 >> v2:172.21.15.26:3300/0 conn(0x7f23080adf90 0x7f23080b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.426+0000 7f2306a00640 1 --2- 172.21.15.2:0/2220877102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2308156bd0 0x7f23080b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.427+0000 7f2306000640 1 -- 172.21.15.2:0/2220877102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2308156bd0 msgr2=0x7f23080b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.427+0000 7f2306000640 1 --2- 172.21.15.2:0/2220877102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2308156bd0 0x7f23080b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.427+0000 7f2306000640 1 -- 172.21.15.2:0/2220877102 >> v1:172.21.15.2:6789/0 conn(0x7f2308156fa0 legacy=0x7f23080ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.427+0000 7f2305600640 1 -- 172.21.15.2:0/2220877102 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281392035 0 0) 0x7f23080ac040 con 0x7f2308156fa0 2024-08-17T02:46:42.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.427+0000 7f2306000640 1 -- 172.21.15.2:0/2220877102 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080ab430 con 0x7f23080adf90 2024-08-17T02:46:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.428+0000 7f2306000640 1 --2- 172.21.15.2:0/2220877102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23080adf90 0x7f23080b10b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009850 tx=0x7f22f40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59254c105ab5d04f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.428+0000 7f2305600640 1 -- 172.21.15.2:0/2220877102 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f402ad80 con 0x7f23080adf90 2024-08-17T02:46:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.428+0000 7f2305600640 1 -- 172.21.15.2:0/2220877102 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f4032440 con 0x7f23080adf90 2024-08-17T02:46:42.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.428+0000 7f2305600640 1 -- 172.21.15.2:0/2220877102 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f40327e0 con 0x7f23080adf90 2024-08-17T02:46:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.429+0000 7f230d800640 1 -- 172.21.15.2:0/2220877102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23080adf90 msgr2=0x7f23080b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.429+0000 7f230d800640 1 --2- 172.21.15.2:0/2220877102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23080adf90 0x7f23080b10b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009850 tx=0x7f22f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.429+0000 7f230d800640 1 -- 172.21.15.2:0/2220877102 shutdown_connections 2024-08-17T02:46:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.429+0000 7f230d800640 1 --2- 172.21.15.2:0/2220877102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f23080adf90 0x7f23080b10b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.429+0000 7f230d800640 1 --2- 172.21.15.2:0/2220877102 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2308156bd0 0x7f23080b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.429+0000 7f230d800640 1 -- 172.21.15.2:0/2220877102 >> 172.21.15.2:0/2220877102 conn(0x7f23080cc390 msgr2=0x7f2308066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.429+0000 7f230d800640 1 -- 172.21.15.2:0/2220877102 shutdown_connections 2024-08-17T02:46:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.429+0000 7f230d800640 1 -- 172.21.15.2:0/2220877102 wait complete. 2024-08-17T02:46:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.431+0000 7f230d800640 1 Processor -- start 2024-08-17T02:46:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.431+0000 7f230d800640 1 -- start start 2024-08-17T02:46:42.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.431+0000 7f230d800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23080adf90 0x7f2308143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f230d800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2308156bd0 0x7f23081593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f230d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2308156fa0 0x7f2308159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f230d800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308150060 con 0x7f2308156fa0 2024-08-17T02:46:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f230d800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2308159f20 con 0x7f2308156bd0 2024-08-17T02:46:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f230d800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230815a200 con 0x7f23080adf90 2024-08-17T02:46:42.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2307400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2308156fa0 0x7f2308159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2307400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2308156fa0 0x7f2308159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35190/0 (socket says 172.21.15.2:35190) 2024-08-17T02:46:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2307400640 1 -- 172.21.15.2:0/586211074 learned_addr learned my addr 172.21.15.2:0/586211074 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2306000640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2308156bd0 0x7f23081593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2306a00640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23080adf90 0x7f2308143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2307400640 1 -- 172.21.15.2:0/586211074 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23080adf90 msgr2=0x7f2308143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2307400640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23080adf90 0x7f2308143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2307400640 1 -- 172.21.15.2:0/586211074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2308156bd0 msgr2=0x7f23081593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2307400640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2308156bd0 0x7f23081593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.432+0000 7f2307400640 1 -- 172.21.15.2:0/586211074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4009390 con 0x7f2308156fa0 2024-08-17T02:46:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.433+0000 7f2307400640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2308156fa0 0x7f2308159910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f230000cc10 tx=0x7f2300001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.433+0000 7f22fe000640 1 -- 172.21.15.2:0/586211074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000ce30 con 0x7f2308156fa0 2024-08-17T02:46:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.433+0000 7f22fe000640 1 -- 172.21.15.2:0/586211074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230000a7f0 con 0x7f2308156fa0 2024-08-17T02:46:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.433+0000 7f22fe000640 1 -- 172.21.15.2:0/586211074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000abf0 con 0x7f2308156fa0 2024-08-17T02:46:42.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.433+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230814fa10 con 0x7f2308156fa0 2024-08-17T02:46:42.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.433+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23080aa7f0 con 0x7f2308156fa0 2024-08-17T02:46:42.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.434+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2308063fb0 con 0x7f2308156fa0 2024-08-17T02:46:42.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.435+0000 7f22fe000640 1 -- 172.21.15.2:0/586211074 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f230000ad50 con 0x7f2308156fa0 2024-08-17T02:46:42.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.436+0000 7f22fe000640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f22e8065150 0x7f22e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.436+0000 7f22fe000640 1 -- 172.21.15.2:0/586211074 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2300082580 con 0x7f2308156fa0 2024-08-17T02:46:42.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.437+0000 7f2306a00640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f22e8065150 0x7f22e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.437+0000 7f2306a00640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f22e8065150 0x7f22e8067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f230816c530 tx=0x7f22f80090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.440+0000 7f22fe000640 1 -- 172.21.15.2:0/586211074 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2300050700 con 0x7f2308156fa0 2024-08-17T02:46:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.622+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23080cb0c0 con 0x7f2308156fa0 2024-08-17T02:46:42.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.622+0000 7f22fe000640 1 -- 172.21.15.2:0/586211074 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2300053d20 con 0x7f2308156fa0 2024-08-17T02:46:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f22e8065150 msgr2=0x7f22e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f22e8065150 0x7f22e8067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f230816c530 tx=0x7f22f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2308156fa0 msgr2=0x7f2308159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2308156fa0 0x7f2308159910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f230000cc10 tx=0x7f2300001970 comp rx=0 tx=0).stop 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 shutdown_connections 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2308156fa0 0x7f2308159910 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2308156bd0 0x7f23081593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f22e8065150 0x7f22e8067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 --2- 172.21.15.2:0/586211074 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f23080adf90 0x7f2308143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 >> 172.21.15.2:0/586211074 conn(0x7f23080cc390 msgr2=0x7f23080c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 shutdown_connections 2024-08-17T02:46:42.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.625+0000 7f230d800640 1 -- 172.21.15.2:0/586211074 wait complete. 2024-08-17T02:46:42.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.798+0000 7f5f12c00640 1 Processor -- start 2024-08-17T02:46:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.798+0000 7f5f12c00640 1 -- start start 2024-08-17T02:46:42.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.799+0000 7f5f12c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f0c0ae7d0 0x7f5f0c0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.799+0000 7f5f12c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156cd0 0x7f5f0c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.799+0000 7f5f12c00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c0b08d0 con 0x7f5f0c156900 2024-08-17T02:46:42.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.799+0000 7f5f12c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b0b10 con 0x7f5f0c0ae7d0 2024-08-17T02:46:42.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.799+0000 7f5f12c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b0df0 con 0x7f5f0c156cd0 2024-08-17T02:46:42.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.799+0000 7f5f10e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f0c0ae7d0 0x7f5f0c0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.799+0000 7f5f10e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f0c0ae7d0 0x7f5f0c0ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35202/0 (socket says 172.21.15.2:35202) 2024-08-17T02:46:42.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.799+0000 7f5f10e00640 1 -- 172.21.15.2:0/399209087 learned_addr learned my addr 172.21.15.2:0/399209087 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:42.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.800+0000 7f5f12200640 1 --2- 172.21.15.2:0/399209087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156cd0 0x7f5f0c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.800+0000 7f5f10e00640 1 -- 172.21.15.2:0/399209087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156cd0 msgr2=0x7f5f0c0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:42.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.800+0000 7f5f10e00640 1 --2- 172.21.15.2:0/399209087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156cd0 0x7f5f0c0adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.800+0000 7f5f10e00640 1 -- 172.21.15.2:0/399209087 >> v1:172.21.15.26:6789/0 conn(0x7f5f0c156900 legacy=0x7f5f0c0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:42.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.800+0000 7f5f10e00640 1 -- 172.21.15.2:0/399209087 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0b10d0 con 0x7f5f0c0ae7d0 2024-08-17T02:46:42.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.801+0000 7f5f10e00640 1 --2- 172.21.15.2:0/399209087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c0ae7d0 0x7f5f0c0ada70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009910 tx=0x7f5ef80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35551b87f7b14751 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.801+0000 7f5f0be00640 1 -- 172.21.15.2:0/399209087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef802ae40 con 0x7f5f0c0ae7d0 2024-08-17T02:46:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.801+0000 7f5f0be00640 1 -- 172.21.15.2:0/399209087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8032440 con 0x7f5f0c0ae7d0 2024-08-17T02:46:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.801+0000 7f5f0be00640 1 -- 172.21.15.2:0/399209087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8032820 con 0x7f5f0c0ae7d0 2024-08-17T02:46:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.802+0000 7f5f12c00640 1 -- 172.21.15.2:0/399209087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c0ae7d0 msgr2=0x7f5f0c0ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.802+0000 7f5f12c00640 1 --2- 172.21.15.2:0/399209087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c0ae7d0 0x7f5f0c0ada70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009910 tx=0x7f5ef80091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.802+0000 7f5f12c00640 1 -- 172.21.15.2:0/399209087 shutdown_connections 2024-08-17T02:46:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.802+0000 7f5f12c00640 1 --2- 172.21.15.2:0/399209087 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156cd0 0x7f5f0c0adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.802+0000 7f5f12c00640 1 --2- 172.21.15.2:0/399209087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c0ae7d0 0x7f5f0c0ada70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.802+0000 7f5f12c00640 1 -- 172.21.15.2:0/399209087 >> 172.21.15.2:0/399209087 conn(0x7f5f0c067930 msgr2=0x7f5f0c0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.802+0000 7f5f12c00640 1 -- 172.21.15.2:0/399209087 shutdown_connections 2024-08-17T02:46:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.802+0000 7f5f12c00640 1 -- 172.21.15.2:0/399209087 wait complete. 2024-08-17T02:46:42.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.803+0000 7f5f12c00640 1 Processor -- start 2024-08-17T02:46:42.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.804+0000 7f5f12c00640 1 -- start start 2024-08-17T02:46:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.804+0000 7f5f12c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0c0ae7d0 0x7f5f0c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.804+0000 7f5f12c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156900 0x7f5f0c153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c156cd0 0x7f5f0c0a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c14e8f0 con 0x7f5f0c156cd0 2024-08-17T02:46:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c154b70 con 0x7f5f0c0ae7d0 2024-08-17T02:46:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c153f60 con 0x7f5f0c156900 2024-08-17T02:46:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c156cd0 0x7f5f0c0a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c156cd0 0x7f5f0c0a8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35208/0 (socket says 172.21.15.2:35208) 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12200640 1 -- 172.21.15.2:0/632668893 learned_addr learned my addr 172.21.15.2:0/632668893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f11800640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0c0ae7d0 0x7f5f0c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f10e00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156900 0x7f5f0c153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12200640 1 -- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156900 msgr2=0x7f5f0c153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12200640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156900 0x7f5f0c153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12200640 1 -- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0c0ae7d0 msgr2=0x7f5f0c14e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12200640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0c0ae7d0 0x7f5f0c14e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f12200640 1 -- 172.21.15.2:0/632668893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8009450 con 0x7f5f0c156cd0 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f10e00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156900 0x7f5f0c153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:42.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.805+0000 7f5f11800640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0c0ae7d0 0x7f5f0c14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:42.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.806+0000 7f5f12200640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c156cd0 0x7f5f0c0a8e00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5f04007f20 tx=0x7f5f04009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.806+0000 7f5f08c00640 1 -- 172.21.15.2:0/632668893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400ee30 con 0x7f5f0c156cd0 2024-08-17T02:46:42.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.806+0000 7f5f08c00640 1 -- 172.21.15.2:0/632668893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04014420 con 0x7f5f0c156cd0 2024-08-17T02:46:42.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.806+0000 7f5f08c00640 1 -- 172.21.15.2:0/632668893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f040147e0 con 0x7f5f0c156cd0 2024-08-17T02:46:42.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.806+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c154240 con 0x7f5f0c156cd0 2024-08-17T02:46:42.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.806+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c154800 con 0x7f5f0c156cd0 2024-08-17T02:46:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.807+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c070720 con 0x7f5f0c156cd0 2024-08-17T02:46:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.808+0000 7f5f08c00640 1 -- 172.21.15.2:0/632668893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5f04014b50 con 0x7f5f0c156cd0 2024-08-17T02:46:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.809+0000 7f5f08c00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5eec065150 0x7f5eec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.809+0000 7f5f08c00640 1 -- 172.21.15.2:0/632668893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f04082c50 con 0x7f5f0c156cd0 2024-08-17T02:46:42.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.809+0000 7f5f11800640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5eec065150 0x7f5eec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:42.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.810+0000 7f5f11800640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5eec065150 0x7f5eec067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f000017a0 tx=0x7f5f00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:42.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.813+0000 7f5f08c00640 1 -- 172.21.15.2:0/632668893 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5f04050c70 con 0x7f5f0c156cd0 2024-08-17T02:46:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.997+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f0c0a9e80 con 0x7f5f0c156cd0 2024-08-17T02:46:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:42.998+0000 7f5f08c00640 1 -- 172.21.15.2:0/632668893 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f04054290 con 0x7f5f0c156cd0 2024-08-17T02:46:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:46:43.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5eec065150 msgr2=0x7f5eec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5eec065150 0x7f5eec067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f000017a0 tx=0x7f5f00009040 comp rx=0 tx=0).stop 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c156cd0 msgr2=0x7f5f0c0a8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c156cd0 0x7f5f0c0a8e00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5f04007f20 tx=0x7f5f04009860 comp rx=0 tx=0).stop 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 shutdown_connections 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0c156cd0 0x7f5f0c0a8e00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5eec065150 0x7f5eec067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5f0c156900 0x7f5f0c153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 --2- 172.21.15.2:0/632668893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f0c0ae7d0 0x7f5f0c14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 >> 172.21.15.2:0/632668893 conn(0x7f5f0c067930 msgr2=0x7f5f0c0cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 shutdown_connections 2024-08-17T02:46:43.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.000+0000 7f5f12c00640 1 -- 172.21.15.2:0/632668893 wait complete. 2024-08-17T02:46:43.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.175+0000 7f75fca00640 1 Processor -- start 2024-08-17T02:46:43.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.175+0000 7f75fca00640 1 -- start start 2024-08-17T02:46:43.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.176+0000 7f75fca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75f80aea20 0x7f75f80aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.176+0000 7f75fca00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75f80ca8e0 0x7f75f80cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.176+0000 7f75fca00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f80af3a0 con 0x7f75f8158b90 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.176+0000 7f75fca00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80afd20 con 0x7f75f80aea20 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.176+0000 7f75fca00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80affe0 con 0x7f75f80ca8e0 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.176+0000 7f75f5400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75f80aea20 0x7f75f80aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f5400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75f80aea20 0x7f75f80aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33342/0 (socket says 172.21.15.2:33342) 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f5e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f75f8158b90 0x7f75f80b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42964/0 (socket says 172.21.15.2:42964) 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f5400640 1 -- 172.21.15.2:0/3238853495 learned_addr learned my addr 172.21.15.2:0/3238853495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f6800640 1 --2- 172.21.15.2:0/3238853495 >> v2:172.21.15.26:3300/0 conn(0x7f75f80ca8e0 0x7f75f80cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f5400640 1 -- 172.21.15.2:0/3238853495 >> v2:172.21.15.26:3300/0 conn(0x7f75f80ca8e0 msgr2=0x7f75f80cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f5400640 1 --2- 172.21.15.2:0/3238853495 >> v2:172.21.15.26:3300/0 conn(0x7f75f80ca8e0 0x7f75f80cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f5400640 1 -- 172.21.15.2:0/3238853495 >> v1:172.21.15.2:6789/0 conn(0x7f75f8158b90 legacy=0x7f75f80b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f5400640 1 -- 172.21.15.2:0/3238853495 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80b02c0 con 0x7f75f80aea20 2024-08-17T02:46:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f4a00640 1 -- 172.21.15.2:0/3238853495 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297800778 0 0) 0x7f75f80af3a0 con 0x7f75f8158b90 2024-08-17T02:46:43.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.177+0000 7f75f6800640 1 --2- 172.21.15.2:0/3238853495 >> v2:172.21.15.26:3300/0 conn(0x7f75f80ca8e0 0x7f75f80cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.178+0000 7f75f5400640 1 --2- 172.21.15.2:0/3238853495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f80aea20 0x7f75f80aee60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f75f8066fc0 tx=0x7f75e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a80bb5249121ca8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75f4a00640 1 -- 172.21.15.2:0/3238853495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e402ae80 con 0x7f75f80aea20 2024-08-17T02:46:43.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75f4a00640 1 -- 172.21.15.2:0/3238853495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4032440 con 0x7f75f80aea20 2024-08-17T02:46:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75f4a00640 1 -- 172.21.15.2:0/3238853495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40327c0 con 0x7f75f80aea20 2024-08-17T02:46:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75fca00640 1 -- 172.21.15.2:0/3238853495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f80aea20 msgr2=0x7f75f80aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75fca00640 1 --2- 172.21.15.2:0/3238853495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f80aea20 0x7f75f80aee60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f75f8066fc0 tx=0x7f75e40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75fca00640 1 -- 172.21.15.2:0/3238853495 shutdown_connections 2024-08-17T02:46:43.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75fca00640 1 --2- 172.21.15.2:0/3238853495 >> v2:172.21.15.26:3300/0 conn(0x7f75f80ca8e0 0x7f75f80cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75fca00640 1 --2- 172.21.15.2:0/3238853495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f80aea20 0x7f75f80aee60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75fca00640 1 -- 172.21.15.2:0/3238853495 >> 172.21.15.2:0/3238853495 conn(0x7f75f806e590 msgr2=0x7f75f806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75fca00640 1 -- 172.21.15.2:0/3238853495 shutdown_connections 2024-08-17T02:46:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.179+0000 7f75fca00640 1 -- 172.21.15.2:0/3238853495 wait complete. 2024-08-17T02:46:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.181+0000 7f75fca00640 1 Processor -- start 2024-08-17T02:46:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.181+0000 7f75fca00640 1 -- start start 2024-08-17T02:46:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75fca00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75f80aea20 0x7f75f8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75fca00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75f80ca8e0 0x7f75f8168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75fca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f8158b90 0x7f75f8159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75fca00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80c8cc0 con 0x7f75f8158b90 2024-08-17T02:46:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75fca00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8159870 con 0x7f75f80ca8e0 2024-08-17T02:46:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75fca00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80c89e0 con 0x7f75f80aea20 2024-08-17T02:46:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f8158b90 0x7f75f8159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f8158b90 0x7f75f8159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33348/0 (socket says 172.21.15.2:33348) 2024-08-17T02:46:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f6800640 1 -- 172.21.15.2:0/2787228925 learned_addr learned my addr 172.21.15.2:0/2787228925 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f5400640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75f80ca8e0 0x7f75f8168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f5e00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75f80aea20 0x7f75f8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f6800640 1 -- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75f80aea20 msgr2=0x7f75f8156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f6800640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75f80aea20 0x7f75f8156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f6800640 1 -- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75f80ca8e0 msgr2=0x7f75f8168c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f6800640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75f80ca8e0 0x7f75f8168c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f6800640 1 -- 172.21.15.2:0/2787228925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4009450 con 0x7f75f8158b90 2024-08-17T02:46:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.182+0000 7f75f5e00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75f80aea20 0x7f75f8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.183+0000 7f75f6800640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f8158b90 0x7f75f8159d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f75f000d1b0 tx=0x7f75f0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.183+0000 7f75ed600640 1 -- 172.21.15.2:0/2787228925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0015440 con 0x7f75f8158b90 2024-08-17T02:46:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.183+0000 7f75ed600640 1 -- 172.21.15.2:0/2787228925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f000f040 con 0x7f75f8158b90 2024-08-17T02:46:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.183+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f8159220 con 0x7f75f8158b90 2024-08-17T02:46:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.183+0000 7f75ed600640 1 -- 172.21.15.2:0/2787228925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0015810 con 0x7f75f8158b90 2024-08-17T02:46:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.183+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f81566c0 con 0x7f75f8158b90 2024-08-17T02:46:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.184+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f8063fb0 con 0x7f75f8158b90 2024-08-17T02:46:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.186+0000 7f75ed600640 1 -- 172.21.15.2:0/2787228925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f75f001e3b0 con 0x7f75f8158b90 2024-08-17T02:46:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.187+0000 7f75ed600640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f75d8065150 0x7f75d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.187+0000 7f75ed600640 1 -- 172.21.15.2:0/2787228925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75f0082f10 con 0x7f75f8158b90 2024-08-17T02:46:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.187+0000 7f75f5e00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f75d8065150 0x7f75d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.188+0000 7f75f5e00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f75d8065150 0x7f75d8067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75e8007fd0 tx=0x7f75e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.191+0000 7f75ed600640 1 -- 172.21.15.2:0/2787228925 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f75f0050f30 con 0x7f75f8158b90 2024-08-17T02:46:43.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.373+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75f81599b0 con 0x7f75f8158b90 2024-08-17T02:46:43.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.373+0000 7f75ed600640 1 -- 172.21.15.2:0/2787228925 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75f0054550 con 0x7f75f8158b90 2024-08-17T02:46:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.375+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f75d8065150 msgr2=0x7f75d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.375+0000 7f75fca00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f75d8065150 0x7f75d8067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75e8007fd0 tx=0x7f75e8009040 comp rx=0 tx=0).stop 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.375+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f8158b90 msgr2=0x7f75f8159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.375+0000 7f75fca00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f8158b90 0x7f75f8159d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f75f000d1b0 tx=0x7f75f0009a50 comp rx=0 tx=0).stop 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.376+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 shutdown_connections 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.376+0000 7f75fca00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75f8158b90 0x7f75f8159d00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.376+0000 7f75fca00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75f80ca8e0 0x7f75f8168c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.376+0000 7f75fca00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f75d8065150 0x7f75d8067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.376+0000 7f75fca00640 1 --2- 172.21.15.2:0/2787228925 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f75f80aea20 0x7f75f8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.376+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 >> 172.21.15.2:0/2787228925 conn(0x7f75f806e590 msgr2=0x7f75f80d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.376+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 shutdown_connections 2024-08-17T02:46:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.376+0000 7f75fca00640 1 -- 172.21.15.2:0/2787228925 wait complete. 2024-08-17T02:46:43.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:43.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.543+0000 7f77b5200640 1 Processor -- start 2024-08-17T02:46:43.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.543+0000 7f77b5200640 1 -- start start 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.544+0000 7f77b5200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f77b0158b90 0x7f77b00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.544+0000 7f77b5200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77b00af130 0x7f77b00ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.544+0000 7f77b5200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00afd20 con 0x7f77b00b2370 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.544+0000 7f77b5200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00affe0 con 0x7f77b00af130 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.544+0000 7f77b5200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00b02c0 con 0x7f77b0158b90 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.544+0000 7f77ae800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77b00af130 0x7f77b00ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.544+0000 7f77ae800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77b00af130 0x7f77b00ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33350/0 (socket says 172.21.15.2:33350) 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.545+0000 7f77ae800640 1 -- 172.21.15.2:0/392212713 learned_addr learned my addr 172.21.15.2:0/392212713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.544+0000 7f77ade00640 1 --2- 172.21.15.2:0/392212713 >> v2:172.21.15.26:3300/0 conn(0x7f77b0158b90 0x7f77b00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.545+0000 7f77ae800640 1 -- 172.21.15.2:0/392212713 >> v2:172.21.15.26:3300/0 conn(0x7f77b0158b90 msgr2=0x7f77b00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.545+0000 7f77ae800640 1 --2- 172.21.15.2:0/392212713 >> v2:172.21.15.26:3300/0 conn(0x7f77b0158b90 0x7f77b00b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.545+0000 7f77ae800640 1 -- 172.21.15.2:0/392212713 >> v1:172.21.15.26:6789/0 conn(0x7f77b00b2370 legacy=0x7f77b00aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.545+0000 7f77ae800640 1 -- 172.21.15.2:0/392212713 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00ca3c0 con 0x7f77b00af130 2024-08-17T02:46:43.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.546+0000 7f77ae800640 1 --2- 172.21.15.2:0/392212713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b00af130 0x7f77b00ca8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77b00cd650 tx=0x7f77a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b6f8ea9e4550c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.546+0000 7f77aca00640 1 -- 172.21.15.2:0/392212713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a802e050 con 0x7f77b00af130 2024-08-17T02:46:43.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.546+0000 7f77aca00640 1 -- 172.21.15.2:0/392212713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a8007400 con 0x7f77b00af130 2024-08-17T02:46:43.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.546+0000 7f77aca00640 1 -- 172.21.15.2:0/392212713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80077e0 con 0x7f77b00af130 2024-08-17T02:46:43.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.547+0000 7f77b5200640 1 -- 172.21.15.2:0/392212713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b00af130 msgr2=0x7f77b00ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.547+0000 7f77b5200640 1 --2- 172.21.15.2:0/392212713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b00af130 0x7f77b00ca8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77b00cd650 tx=0x7f77a8009840 comp rx=0 tx=0).stop 2024-08-17T02:46:43.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.547+0000 7f77b5200640 1 -- 172.21.15.2:0/392212713 shutdown_connections 2024-08-17T02:46:43.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.547+0000 7f77b5200640 1 --2- 172.21.15.2:0/392212713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b00af130 0x7f77b00ca8e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.547+0000 7f77b5200640 1 --2- 172.21.15.2:0/392212713 >> v2:172.21.15.26:3300/0 conn(0x7f77b0158b90 0x7f77b00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.547+0000 7f77b5200640 1 -- 172.21.15.2:0/392212713 >> 172.21.15.2:0/392212713 conn(0x7f77b006e590 msgr2=0x7f77b006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:43.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.547+0000 7f77b5200640 1 -- 172.21.15.2:0/392212713 shutdown_connections 2024-08-17T02:46:43.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.547+0000 7f77b5200640 1 -- 172.21.15.2:0/392212713 wait complete. 2024-08-17T02:46:43.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.548+0000 7f77b5200640 1 Processor -- start 2024-08-17T02:46:43.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.549+0000 7f77b5200640 1 -- start start 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.549+0000 7f77b5200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77b00af130 0x7f77b0168df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.549+0000 7f77b5200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77b00b2370 0x7f77b014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.549+0000 7f77b5200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b0158b90 0x7f77b00c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77b5200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0159650 con 0x7f77b0158b90 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77b5200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00c8140 con 0x7f77b00b2370 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77b5200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00c8420 con 0x7f77b00af130 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ae800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b0158b90 0x7f77b00c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ae800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b0158b90 0x7f77b00c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33360/0 (socket says 172.21.15.2:33360) 2024-08-17T02:46:43.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ae800640 1 -- 172.21.15.2:0/184932375 learned_addr learned my addr 172.21.15.2:0/184932375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:43.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ade00640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77b00af130 0x7f77b0168df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ad400640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77b00b2370 0x7f77b014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ae800640 1 -- 172.21.15.2:0/184932375 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77b00af130 msgr2=0x7f77b0168df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ae800640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77b00af130 0x7f77b0168df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ae800640 1 -- 172.21.15.2:0/184932375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77b00b2370 msgr2=0x7f77b014af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ae800640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77b00b2370 0x7f77b014af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.550+0000 7f77ae800640 1 -- 172.21.15.2:0/184932375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8009ae0 con 0x7f77b0158b90 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.551+0000 7f77ae800640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b0158b90 0x7f77b00c7700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f77a802ad60 tx=0x7f77a8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.551+0000 7f77a5600640 1 -- 172.21.15.2:0/184932375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8007170 con 0x7f77b0158b90 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.551+0000 7f77a5600640 1 -- 172.21.15.2:0/184932375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a8033e40 con 0x7f77b0158b90 2024-08-17T02:46:43.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.551+0000 7f77a5600640 1 -- 172.21.15.2:0/184932375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a803c640 con 0x7f77b0158b90 2024-08-17T02:46:43.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.551+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b0159000 con 0x7f77b0158b90 2024-08-17T02:46:43.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.551+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b014b450 con 0x7f77b0158b90 2024-08-17T02:46:43.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.552+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b0063fb0 con 0x7f77b0158b90 2024-08-17T02:46:43.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.553+0000 7f77a5600640 1 -- 172.21.15.2:0/184932375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f77a8039050 con 0x7f77b0158b90 2024-08-17T02:46:43.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.554+0000 7f77a5600640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7790065150 0x7f7790067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.554+0000 7f77a5600640 1 -- 172.21.15.2:0/184932375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77a80a2ad0 con 0x7f77b0158b90 2024-08-17T02:46:43.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.554+0000 7f77ade00640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7790065150 0x7f7790067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.555+0000 7f77ade00640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7790065150 0x7f7790067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009d20 tx=0x7f77a00090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.562+0000 7f77a5600640 1 -- 172.21.15.2:0/184932375 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f77a8070ba0 con 0x7f77b0158b90 2024-08-17T02:46:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.746+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77b0159790 con 0x7f77b0158b90 2024-08-17T02:46:43.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.746+0000 7f77a5600640 1 -- 172.21.15.2:0/184932375 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f77a80741c0 con 0x7f77b0158b90 2024-08-17T02:46:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.748+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7790065150 msgr2=0x7f7790067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.748+0000 7f77b5200640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7790065150 0x7f7790067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009d20 tx=0x7f77a00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.748+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b0158b90 msgr2=0x7f77b00c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.748+0000 7f77b5200640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b0158b90 0x7f77b00c7700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f77a802ad60 tx=0x7f77a8037000 comp rx=0 tx=0).stop 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.749+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 shutdown_connections 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.749+0000 7f77b5200640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77b0158b90 0x7f77b00c7700 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.749+0000 7f77b5200640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77b00b2370 0x7f77b014af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.749+0000 7f77b5200640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7790065150 0x7f7790067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.749+0000 7f77b5200640 1 --2- 172.21.15.2:0/184932375 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77b00af130 0x7f77b0168df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.749+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 >> 172.21.15.2:0/184932375 conn(0x7f77b006e590 msgr2=0x7f77b00cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.749+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 shutdown_connections 2024-08-17T02:46:43.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.749+0000 7f77b5200640 1 -- 172.21.15.2:0/184932375 wait complete. 2024-08-17T02:46:43.764 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:10.965028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:12.163837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:43.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.918+0000 7fbbef000640 1 Processor -- start 2024-08-17T02:46:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.919+0000 7fbbef000640 1 -- start start 2024-08-17T02:46:43.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbef000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbbe806dcd0 0x7fbbe80ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbef000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbbe80ae6c0 0x7fbbe80aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbef000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe8159640 con 0x7fbbe806d900 2024-08-17T02:46:43.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbef000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe8156e50 con 0x7fbbe806dcd0 2024-08-17T02:46:43.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbef000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe81565b0 con 0x7fbbe80ae6c0 2024-08-17T02:46:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbed200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbbe806dcd0 0x7fbbe80ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbed200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbbe806dcd0 0x7fbbe80ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33366/0 (socket says 172.21.15.2:33366) 2024-08-17T02:46:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbed200640 1 -- 172.21.15.2:0/2844945438 learned_addr learned my addr 172.21.15.2:0/2844945438 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbee600640 1 --2- 172.21.15.2:0/2844945438 >> v2:172.21.15.26:3300/0 conn(0x7fbbe80ae6c0 0x7fbbe80aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbed200640 1 -- 172.21.15.2:0/2844945438 >> v2:172.21.15.26:3300/0 conn(0x7fbbe80ae6c0 msgr2=0x7fbbe80aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbed200640 1 --2- 172.21.15.2:0/2844945438 >> v2:172.21.15.26:3300/0 conn(0x7fbbe80ae6c0 0x7fbbe80aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbed200640 1 -- 172.21.15.2:0/2844945438 >> v1:172.21.15.26:6789/0 conn(0x7fbbe806d900 legacy=0x7fbbe8155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.920+0000 7fbbed200640 1 -- 172.21.15.2:0/2844945438 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe8156890 con 0x7fbbe806dcd0 2024-08-17T02:46:43.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.921+0000 7fbbed200640 1 --2- 172.21.15.2:0/2844945438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806dcd0 0x7fbbe80ade50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806eaf0 tx=0x7fbbd40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b778a926c772a3a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbe7e00640 1 -- 172.21.15.2:0/2844945438 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd402ade0 con 0x7fbbe806dcd0 2024-08-17T02:46:43.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbe7e00640 1 -- 172.21.15.2:0/2844945438 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4032440 con 0x7fbbe806dcd0 2024-08-17T02:46:43.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbe7e00640 1 -- 172.21.15.2:0/2844945438 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4032820 con 0x7fbbe806dcd0 2024-08-17T02:46:43.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbef000640 1 -- 172.21.15.2:0/2844945438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806dcd0 msgr2=0x7fbbe80ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbef000640 1 --2- 172.21.15.2:0/2844945438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806dcd0 0x7fbbe80ade50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806eaf0 tx=0x7fbbd40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbef000640 1 -- 172.21.15.2:0/2844945438 shutdown_connections 2024-08-17T02:46:43.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbef000640 1 --2- 172.21.15.2:0/2844945438 >> v2:172.21.15.26:3300/0 conn(0x7fbbe80ae6c0 0x7fbbe80aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbef000640 1 --2- 172.21.15.2:0/2844945438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806dcd0 0x7fbbe80ade50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbef000640 1 -- 172.21.15.2:0/2844945438 >> 172.21.15.2:0/2844945438 conn(0x7fbbe80cb770 msgr2=0x7fbbe80cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:43.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbef000640 1 -- 172.21.15.2:0/2844945438 shutdown_connections 2024-08-17T02:46:43.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.922+0000 7fbbef000640 1 -- 172.21.15.2:0/2844945438 wait complete. 2024-08-17T02:46:43.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.924+0000 7fbbef000640 1 Processor -- start 2024-08-17T02:46:43.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.924+0000 7fbbef000640 1 -- start start 2024-08-17T02:46:43.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbef000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806d900 0x7fbbe80ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbef000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbbe806dcd0 0x7fbbe8157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbef000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe80ae6c0 0x7fbbe80c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbef000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe814de20 con 0x7fbbe806d900 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbef000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe814d210 con 0x7fbbe80ae6c0 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbef000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe814d4f0 con 0x7fbbe806dcd0 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbedc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806d900 0x7fbbe80ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbedc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806d900 0x7fbbe80ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33372/0 (socket says 172.21.15.2:33372) 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbedc00640 1 -- 172.21.15.2:0/2186230002 learned_addr learned my addr 172.21.15.2:0/2186230002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbee600640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe80ae6c0 0x7fbbe80c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbed200640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbbe806dcd0 0x7fbbe8157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbedc00640 1 -- 172.21.15.2:0/2186230002 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbbe806dcd0 msgr2=0x7fbbe8157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbedc00640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbbe806dcd0 0x7fbbe8157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbedc00640 1 -- 172.21.15.2:0/2186230002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe80ae6c0 msgr2=0x7fbbe80c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:43.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbedc00640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe80ae6c0 0x7fbbe80c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:43.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.925+0000 7fbbedc00640 1 -- 172.21.15.2:0/2186230002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4009450 con 0x7fbbe806d900 2024-08-17T02:46:43.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.926+0000 7fbbedc00640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806d900 0x7fbbe80ace80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c5e0 tx=0x7fbbdc007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.926+0000 7fbbe4c00640 1 -- 172.21.15.2:0/2186230002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc012630 con 0x7fbbe806d900 2024-08-17T02:46:43.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.926+0000 7fbbe4c00640 1 -- 172.21.15.2:0/2186230002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0127b0 con 0x7fbbe806d900 2024-08-17T02:46:43.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.926+0000 7fbbe4c00640 1 -- 172.21.15.2:0/2186230002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc012bb0 con 0x7fbbe806d900 2024-08-17T02:46:43.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.926+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe814d7d0 con 0x7fbbe806d900 2024-08-17T02:46:43.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.926+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe814cec0 con 0x7fbbe806d900 2024-08-17T02:46:43.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.927+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe8070720 con 0x7fbbe806d900 2024-08-17T02:46:43.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.928+0000 7fbbe4c00640 1 -- 172.21.15.2:0/2186230002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbbdc01a3b0 con 0x7fbbe806d900 2024-08-17T02:46:43.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.929+0000 7fbbe4c00640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbbc8065150 0x7fbbc8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:43.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.929+0000 7fbbe4c00640 1 -- 172.21.15.2:0/2186230002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbdc081e50 con 0x7fbbe806d900 2024-08-17T02:46:43.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.929+0000 7fbbed200640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbbc8065150 0x7fbbc8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:43.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.930+0000 7fbbed200640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbbc8065150 0x7fbbc8067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4034000 tx=0x7fbbd4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:43.933+0000 7fbbe4c00640 1 -- 172.21.15.2:0/2186230002 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbbdc04ffc0 con 0x7fbbe806d900 2024-08-17T02:46:44.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.113+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbe80c7750 con 0x7fbbe806d900 2024-08-17T02:46:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.114+0000 7fbbe4c00640 1 -- 172.21.15.2:0/2186230002 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbdc0160a0 con 0x7fbbe806d900 2024-08-17T02:46:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.115+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbbc8065150 msgr2=0x7fbbc8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.115+0000 7fbbef000640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbbc8065150 0x7fbbc8067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4034000 tx=0x7fbbd4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806d900 msgr2=0x7fbbe80ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806d900 0x7fbbe80ace80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c5e0 tx=0x7fbbdc007ed0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 shutdown_connections 2024-08-17T02:46:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbe80ae6c0 0x7fbbe80c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbbc8065150 0x7fbbc8067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbbe806dcd0 0x7fbbe8157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 --2- 172.21.15.2:0/2186230002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbe806d900 0x7fbbe80ace80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 >> 172.21.15.2:0/2186230002 conn(0x7fbbe80cb770 msgr2=0x7fbbe8158550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 shutdown_connections 2024-08-17T02:46:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.116+0000 7fbbef000640 1 -- 172.21.15.2:0/2186230002 wait complete. 2024-08-17T02:46:44.130 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:44.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.285+0000 7f9775400640 1 Processor -- start 2024-08-17T02:46:44.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.285+0000 7f9775400640 1 -- start start 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f9775400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9770158b90 0x7f97700b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f9775400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97700b2370 0x7f97700aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f9775400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97700aef60 0x7f9770068630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f9775400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97700af360 con 0x7f97700b2370 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f9775400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97700afd20 con 0x7f9770158b90 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f9775400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700affe0 con 0x7f97700aef60 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f976de00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97700b2370 0x7f97700aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f976de00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f97700b2370 0x7f97700aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33386/0 (socket says 172.21.15.2:33386) 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.286+0000 7f976de00640 1 -- 172.21.15.2:0/349423972 learned_addr learned my addr 172.21.15.2:0/349423972 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.287+0000 7f976e800640 1 --2- 172.21.15.2:0/349423972 >> v2:172.21.15.26:3300/0 conn(0x7f9770158b90 0x7f97700b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.287+0000 7f976f200640 1 --2- 172.21.15.2:0/349423972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97700aef60 0x7f9770068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.287+0000 7f976de00640 1 -- 172.21.15.2:0/349423972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97700aef60 msgr2=0x7f9770068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.287+0000 7f976de00640 1 --2- 172.21.15.2:0/349423972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97700aef60 0x7f9770068630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.287+0000 7f976de00640 1 -- 172.21.15.2:0/349423972 >> v2:172.21.15.26:3300/0 conn(0x7f9770158b90 msgr2=0x7f97700b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.287+0000 7f976de00640 1 --2- 172.21.15.2:0/349423972 >> v2:172.21.15.26:3300/0 conn(0x7f9770158b90 0x7f97700b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.287+0000 7f976de00640 1 -- 172.21.15.2:0/349423972 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97700b02c0 con 0x7f97700b2370 2024-08-17T02:46:44.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.287+0000 7f976f200640 1 --2- 172.21.15.2:0/349423972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97700aef60 0x7f9770068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.288+0000 7f976de00640 1 --2- 172.21.15.2:0/349423972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97700aea20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f97700cd650 tx=0x7f975c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1ee1c6c4778d00 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.288+0000 7f976d400640 1 -- 172.21.15.2:0/349423972 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c02add0 con 0x7f97700b2370 2024-08-17T02:46:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.288+0000 7f976d400640 1 -- 172.21.15.2:0/349423972 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c032440 con 0x7f97700b2370 2024-08-17T02:46:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.288+0000 7f976d400640 1 -- 172.21.15.2:0/349423972 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c032820 con 0x7f97700b2370 2024-08-17T02:46:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 -- 172.21.15.2:0/349423972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 msgr2=0x7f97700aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 --2- 172.21.15.2:0/349423972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97700aea20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f97700cd650 tx=0x7f975c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 -- 172.21.15.2:0/349423972 shutdown_connections 2024-08-17T02:46:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 --2- 172.21.15.2:0/349423972 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97700aef60 0x7f9770068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 --2- 172.21.15.2:0/349423972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97700aea20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 --2- 172.21.15.2:0/349423972 >> v2:172.21.15.26:3300/0 conn(0x7f9770158b90 0x7f97700b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 -- 172.21.15.2:0/349423972 >> 172.21.15.2:0/349423972 conn(0x7f977006e590 msgr2=0x7f977006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 -- 172.21.15.2:0/349423972 shutdown_connections 2024-08-17T02:46:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.289+0000 7f9775400640 1 -- 172.21.15.2:0/349423972 wait complete. 2024-08-17T02:46:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.290+0000 7f9775400640 1 Processor -- start 2024-08-17T02:46:44.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.291+0000 7f9775400640 1 -- start start 2024-08-17T02:46:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.291+0000 7f9775400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97700aef60 0x7f977015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.291+0000 7f9775400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97701580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.291+0000 7f9775400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9770158b90 0x7f9770168ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.291+0000 7f9775400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977015c2f0 con 0x7f97700b2370 2024-08-17T02:46:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.291+0000 7f9775400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770159a30 con 0x7f97700aef60 2024-08-17T02:46:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.291+0000 7f9775400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9770159100 con 0x7f9770158b90 2024-08-17T02:46:44.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97701580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97701580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33398/0 (socket says 172.21.15.2:33398) 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 -- 172.21.15.2:0/788671442 learned_addr learned my addr 172.21.15.2:0/788671442 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976e800640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97700aef60 0x7f977015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 -- 172.21.15.2:0/788671442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9770158b90 msgr2=0x7f9770168ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9770158b90 0x7f9770168ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 -- 172.21.15.2:0/788671442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97700aef60 msgr2=0x7f977015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97700aef60 0x7f977015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 -- 172.21.15.2:0/788671442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c009450 con 0x7f97700b2370 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976e800640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97700aef60 0x7f977015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:44.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.292+0000 7f976de00640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97701580e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f975c035040 tx=0x7f975c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.293+0000 7f9766000640 1 -- 172.21.15.2:0/788671442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c000c40 con 0x7f97700b2370 2024-08-17T02:46:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.293+0000 7f9766000640 1 -- 172.21.15.2:0/788671442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c031a60 con 0x7f97700b2370 2024-08-17T02:46:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.293+0000 7f9766000640 1 -- 172.21.15.2:0/788671442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c031e60 con 0x7f97700b2370 2024-08-17T02:46:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.293+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97701593e0 con 0x7f97700b2370 2024-08-17T02:46:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.293+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977015bfe0 con 0x7f97700b2370 2024-08-17T02:46:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.294+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9770063fb0 con 0x7f97700b2370 2024-08-17T02:46:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.295+0000 7f9766000640 1 -- 172.21.15.2:0/788671442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f975c039040 con 0x7f97700b2370 2024-08-17T02:46:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.295+0000 7f9766000640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9750065180 0x7f9750067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.296+0000 7f9766000640 1 -- 172.21.15.2:0/788671442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f975c0a1fe0 con 0x7f97700b2370 2024-08-17T02:46:44.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.296+0000 7f976e800640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9750065180 0x7f9750067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.296+0000 7f976e800640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9750065180 0x7f9750067630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9760006e70 tx=0x7f9760008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.300+0000 7f9766000640 1 -- 172.21.15.2:0/788671442 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f975c070040 con 0x7f97700b2370 2024-08-17T02:46:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.480+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9770159b70 con 0x7f97700b2370 2024-08-17T02:46:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.480+0000 7f9766000640 1 -- 172.21.15.2:0/788671442 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f975c037020 con 0x7f97700b2370 2024-08-17T02:46:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.482+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9750065180 msgr2=0x7f9750067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.482+0000 7f9775400640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9750065180 0x7f9750067630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9760006e70 tx=0x7f9760008040 comp rx=0 tx=0).stop 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.482+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 msgr2=0x7f97701580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.482+0000 7f9775400640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97701580e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f975c035040 tx=0x7f975c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.483+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 shutdown_connections 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.483+0000 7f9775400640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9750065180 0x7f9750067630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.483+0000 7f9775400640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9770158b90 0x7f9770168ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.483+0000 7f9775400640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97700b2370 0x7f97701580e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.483+0000 7f9775400640 1 --2- 172.21.15.2:0/788671442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97700aef60 0x7f977015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.483+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 >> 172.21.15.2:0/788671442 conn(0x7f977006e590 msgr2=0x7f97700cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.483+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 shutdown_connections 2024-08-17T02:46:44.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.483+0000 7f9775400640 1 -- 172.21.15.2:0/788671442 wait complete. 2024-08-17T02:46:44.497 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.652+0000 7f38e7200640 1 Processor -- start 2024-08-17T02:46:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.652+0000 7f38e7200640 1 -- start start 2024-08-17T02:46:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.653+0000 7f38e7200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 0x7f38e00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.653+0000 7f38e7200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38e00acf10 0x7f38e0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.653+0000 7f38e7200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f38e01589a0 0x7f38e0158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.653+0000 7f38e7200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e00b0980 con 0x7f38e00acf10 2024-08-17T02:46:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.653+0000 7f38e7200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e015a4e0 con 0x7f38e01589a0 2024-08-17T02:46:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.653+0000 7f38e7200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e00c92b0 con 0x7f38e00afca0 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38df400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38e00acf10 0x7f38e0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38df400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f38e00acf10 0x7f38e0159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33402/0 (socket says 172.21.15.2:33402) 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38df400640 1 -- 172.21.15.2:0/4250130946 learned_addr learned my addr 172.21.15.2:0/4250130946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38dfe00640 1 --2- 172.21.15.2:0/4250130946 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 0x7f38e00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38e5200640 1 --2- 172.21.15.2:0/4250130946 >> v2:172.21.15.26:3300/0 conn(0x7f38e01589a0 0x7f38e0158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38df400640 1 -- 172.21.15.2:0/4250130946 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 msgr2=0x7f38e00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38df400640 1 --2- 172.21.15.2:0/4250130946 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 0x7f38e00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38df400640 1 -- 172.21.15.2:0/4250130946 >> v2:172.21.15.26:3300/0 conn(0x7f38e01589a0 msgr2=0x7f38e0158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38df400640 1 --2- 172.21.15.2:0/4250130946 >> v2:172.21.15.26:3300/0 conn(0x7f38e01589a0 0x7f38e0158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.654+0000 7f38df400640 1 -- 172.21.15.2:0/4250130946 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0159360 con 0x7f38e00acf10 2024-08-17T02:46:44.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.655+0000 7f38df400640 1 --2- 172.21.15.2:0/4250130946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e0159fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009910 tx=0x7f38cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1560bf82b02105e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38dea00640 1 -- 172.21.15.2:0/4250130946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc02adb0 con 0x7f38e00acf10 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38dea00640 1 -- 172.21.15.2:0/4250130946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc032440 con 0x7f38e00acf10 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38dea00640 1 -- 172.21.15.2:0/4250130946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc032820 con 0x7f38e00acf10 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 -- 172.21.15.2:0/4250130946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 msgr2=0x7f38e0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 --2- 172.21.15.2:0/4250130946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e0159fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009910 tx=0x7f38cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 -- 172.21.15.2:0/4250130946 shutdown_connections 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 --2- 172.21.15.2:0/4250130946 >> v2:172.21.15.26:3300/0 conn(0x7f38e01589a0 0x7f38e0158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 --2- 172.21.15.2:0/4250130946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e0159fa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 --2- 172.21.15.2:0/4250130946 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 0x7f38e00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 -- 172.21.15.2:0/4250130946 >> 172.21.15.2:0/4250130946 conn(0x7f38e0066e60 msgr2=0x7f38e0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 -- 172.21.15.2:0/4250130946 shutdown_connections 2024-08-17T02:46:44.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.656+0000 7f38e7200640 1 -- 172.21.15.2:0/4250130946 wait complete. 2024-08-17T02:46:44.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.658+0000 7f38e7200640 1 Processor -- start 2024-08-17T02:46:44.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.658+0000 7f38e7200640 1 -- start start 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38e7200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38e7200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 0x7f38e00c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38e7200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38e01589a0 0x7f38e01531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38e7200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e01503d0 con 0x7f38e00acf10 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38e7200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e0152d50 con 0x7f38e01589a0 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38e7200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e00c1700 con 0x7f38e00afca0 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38dfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38dfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e014fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33406/0 (socket says 172.21.15.2:33406) 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38dfe00640 1 -- 172.21.15.2:0/1195279521 learned_addr learned my addr 172.21.15.2:0/1195279521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:44.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38e5200640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38e01589a0 0x7f38e01531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38df400640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 0x7f38e00c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38dfe00640 1 -- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 msgr2=0x7f38e00c11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38dfe00640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 0x7f38e00c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38dfe00640 1 -- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38e01589a0 msgr2=0x7f38e01531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38dfe00640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38e01589a0 0x7f38e01531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38dfe00640 1 -- 172.21.15.2:0/1195279521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc009450 con 0x7f38e00acf10 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.659+0000 7f38e5200640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38e01589a0 0x7f38e01531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.660+0000 7f38dfe00640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e014fe90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38d000ea20 tx=0x7f38d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.660+0000 7f38d7400640 1 -- 172.21.15.2:0/1195279521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000ca10 con 0x7f38e00acf10 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.660+0000 7f38d7400640 1 -- 172.21.15.2:0/1195279521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d000cb70 con 0x7f38e00acf10 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.660+0000 7f38d7400640 1 -- 172.21.15.2:0/1195279521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0013470 con 0x7f38e00acf10 2024-08-17T02:46:44.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.660+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e0152420 con 0x7f38e00acf10 2024-08-17T02:46:44.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.660+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e01529e0 con 0x7f38e00acf10 2024-08-17T02:46:44.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.661+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e0063fb0 con 0x7f38e00acf10 2024-08-17T02:46:44.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.662+0000 7f38d7400640 1 -- 172.21.15.2:0/1195279521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38d0013860 con 0x7f38e00acf10 2024-08-17T02:46:44.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.662+0000 7f38d7400640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38c0065150 0x7f38c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:44.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.663+0000 7f38d7400640 1 -- 172.21.15.2:0/1195279521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38d0082880 con 0x7f38e00acf10 2024-08-17T02:46:44.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.663+0000 7f38df400640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38c0065150 0x7f38c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:44.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.663+0000 7f38df400640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38c0065150 0x7f38c0067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38cc034000 tx=0x7f38cc032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:44.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.666+0000 7f38d7400640 1 -- 172.21.15.2:0/1195279521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f38d00508a0 con 0x7f38e00acf10 2024-08-17T02:46:44.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.851+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38e0067b70 con 0x7f38e00acf10 2024-08-17T02:46:44.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.851+0000 7f38d7400640 1 -- 172.21.15.2:0/1195279521 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38d0017020 con 0x7f38e00acf10 2024-08-17T02:46:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:46:44.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38c0065150 msgr2=0x7f38c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38c0065150 0x7f38c0067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38cc034000 tx=0x7f38cc032000 comp rx=0 tx=0).stop 2024-08-17T02:46:44.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 msgr2=0x7f38e014fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:44.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e014fe90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38d000ea20 tx=0x7f38d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 shutdown_connections 2024-08-17T02:46:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38e01589a0 0x7f38e01531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38c0065150 0x7f38c0067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f38e00afca0 0x7f38e00c11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 --2- 172.21.15.2:0/1195279521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38e00acf10 0x7f38e014fe90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 >> 172.21.15.2:0/1195279521 conn(0x7f38e0066e60 msgr2=0x7f38e00c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 shutdown_connections 2024-08-17T02:46:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:44.854+0000 7f38e7200640 1 -- 172.21.15.2:0/1195279521 wait complete. 2024-08-17T02:46:44.941 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:46:44.941 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:46:44.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:45.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.093+0000 7f846aa00640 1 Processor -- start 2024-08-17T02:46:45.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.093+0000 7f846aa00640 1 -- start start 2024-08-17T02:46:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.094+0000 7f846aa00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f846415cb20 0x7f846415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.094+0000 7f846aa00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8464069850 con 0x7f84640ab740 2024-08-17T02:46:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.095+0000 7f846aa00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8464068980 con 0x7f846415d530 2024-08-17T02:46:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.095+0000 7f846aa00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8464068c40 con 0x7f846415cb20 2024-08-17T02:46:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.095+0000 7f846a000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f84640ab740 0x7f84640ae340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42980/0 (socket says 172.21.15.2:42980) 2024-08-17T02:46:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.095+0000 7f846a000640 1 -- 172.21.15.2:0/3390182984 learned_addr learned my addr 172.21.15.2:0/3390182984 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.095+0000 7f8469600640 1 --2- 172.21.15.2:0/3390182984 >> v2:172.21.15.26:3300/0 conn(0x7f846415cb20 0x7f846415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.095+0000 7f8469600640 1 -- 172.21.15.2:0/3390182984 >> v1:172.21.15.26:6789/0 conn(0x7f846415d530 legacy=0x7f846415bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.095+0000 7f8469600640 1 -- 172.21.15.2:0/3390182984 >> v1:172.21.15.2:6789/0 conn(0x7f84640ab740 legacy=0x7f84640ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.095+0000 7f8463e00640 1 -- 172.21.15.2:0/3390182984 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668700792 0 0) 0x7f8464069850 con 0x7f84640ab740 2024-08-17T02:46:45.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.096+0000 7f8469600640 1 -- 172.21.15.2:0/3390182984 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8464068f20 con 0x7f846415cb20 2024-08-17T02:46:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.097+0000 7f8469600640 1 --2- 172.21.15.2:0/3390182984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f846415cb20 0x7f846415cef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8458009850 tx=0x7f84580090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3815f54b73124f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.097+0000 7f8463e00640 1 -- 172.21.15.2:0/3390182984 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845802ae20 con 0x7f846415cb20 2024-08-17T02:46:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.097+0000 7f8463e00640 1 -- 172.21.15.2:0/3390182984 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8458032440 con 0x7f846415cb20 2024-08-17T02:46:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.097+0000 7f8463e00640 1 -- 172.21.15.2:0/3390182984 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84580327e0 con 0x7f846415cb20 2024-08-17T02:46:45.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.098+0000 7f846aa00640 1 -- 172.21.15.2:0/3390182984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f846415cb20 msgr2=0x7f846415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.098+0000 7f846aa00640 1 --2- 172.21.15.2:0/3390182984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f846415cb20 0x7f846415cef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8458009850 tx=0x7f84580090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.098+0000 7f846aa00640 1 -- 172.21.15.2:0/3390182984 shutdown_connections 2024-08-17T02:46:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.098+0000 7f846aa00640 1 --2- 172.21.15.2:0/3390182984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f846415cb20 0x7f846415cef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.098+0000 7f846aa00640 1 -- 172.21.15.2:0/3390182984 >> 172.21.15.2:0/3390182984 conn(0x7f84640ce4e0 msgr2=0x7f8464095c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.098+0000 7f846aa00640 1 -- 172.21.15.2:0/3390182984 shutdown_connections 2024-08-17T02:46:45.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.098+0000 7f846aa00640 1 -- 172.21.15.2:0/3390182984 wait complete. 2024-08-17T02:46:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.099+0000 7f846aa00640 1 Processor -- start 2024-08-17T02:46:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.099+0000 7f846aa00640 1 -- start start 2024-08-17T02:46:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f846aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84640ab740 0x7f8464096ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f846aa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f846415cb20 0x7f846414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f846aa00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8464156a30 0x7f8464156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f846aa00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84641573f0 con 0x7f84640ab740 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f846aa00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8464155900 con 0x7f8464156a30 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f846aa00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8464158920 con 0x7f846415cb20 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f8469600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84640ab740 0x7f8464096ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f8469600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84640ab740 0x7f8464096ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33412/0 (socket says 172.21.15.2:33412) 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f8469600640 1 -- 172.21.15.2:0/4038550457 learned_addr learned my addr 172.21.15.2:0/4038550457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.100+0000 7f846a000640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8464156a30 0x7f8464156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.101+0000 7f8468c00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f846415cb20 0x7f846414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.101+0000 7f8469600640 1 -- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f846415cb20 msgr2=0x7f846414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.101+0000 7f8469600640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f846415cb20 0x7f846414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.101+0000 7f8469600640 1 -- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8464156a30 msgr2=0x7f8464156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.101+0000 7f8469600640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8464156a30 0x7f8464156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.101+0000 7f8469600640 1 -- 172.21.15.2:0/4038550457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458009390 con 0x7f84640ab740 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.101+0000 7f846a000640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8464156a30 0x7f8464156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.101+0000 7f8469600640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84640ab740 0x7f8464096ce0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8458009360 tx=0x7f8458032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.102+0000 7f8460c00640 1 -- 172.21.15.2:0/4038550457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458031b30 con 0x7f84640ab740 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.102+0000 7f8460c00640 1 -- 172.21.15.2:0/4038550457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8458031c90 con 0x7f84640ab740 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.102+0000 7f8460c00640 1 -- 172.21.15.2:0/4038550457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845803c660 con 0x7f84640ab740 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.102+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84641591c0 con 0x7f84640ab740 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.102+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8464158b70 con 0x7f84640ab740 2024-08-17T02:46:45.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.103+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8464070720 con 0x7f84640ab740 2024-08-17T02:46:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.103+0000 7f8460c00640 1 -- 172.21.15.2:0/4038550457 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8458039050 con 0x7f84640ab740 2024-08-17T02:46:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.104+0000 7f8460c00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8444065150 0x7f8444067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.104+0000 7f8460c00640 1 -- 172.21.15.2:0/4038550457 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84580a2e90 con 0x7f84640ab740 2024-08-17T02:46:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.105+0000 7f8468c00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8444065150 0x7f8444067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.105+0000 7f8468c00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8444065150 0x7f8444067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f846416c4f0 tx=0x7f8450007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.108+0000 7f8460c00640 1 -- 172.21.15.2:0/4038550457 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f84580710c0 con 0x7f84640ab740 2024-08-17T02:46:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.292+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84640b37d0 con 0x7f84640ab740 2024-08-17T02:46:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.293+0000 7f8460c00640 1 -- 172.21.15.2:0/4038550457 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f845804a090 con 0x7f84640ab740 2024-08-17T02:46:45.293 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8444065150 msgr2=0x7f8444067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8444065150 0x7f8444067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f846416c4f0 tx=0x7f8450007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84640ab740 msgr2=0x7f8464096ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84640ab740 0x7f8464096ce0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8458009360 tx=0x7f8458032000 comp rx=0 tx=0).stop 2024-08-17T02:46:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 shutdown_connections 2024-08-17T02:46:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8464156a30 0x7f8464156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8444065150 0x7f8444067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f846415cb20 0x7f846414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 --2- 172.21.15.2:0/4038550457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84640ab740 0x7f8464096ce0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 >> 172.21.15.2:0/4038550457 conn(0x7f84640ce4e0 msgr2=0x7f84640ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 shutdown_connections 2024-08-17T02:46:45.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.295+0000 7f846aa00640 1 -- 172.21.15.2:0/4038550457 wait complete. 2024-08-17T02:46:45.311 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:10.965028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:12.163837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:45.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:45.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.467+0000 7f01d1800640 1 Processor -- start 2024-08-17T02:46:45.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.467+0000 7f01d1800640 1 -- start start 2024-08-17T02:46:45.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.468+0000 7f01d1800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc153400 0x7f01cc069100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.468+0000 7f01d1800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f01cc1537d0 0x7f01cc15a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.468+0000 7f01d1800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc0cde70 con 0x7f01cc0683b0 2024-08-17T02:46:45.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.468+0000 7f01d1800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc0b5b90 con 0x7f01cc1537d0 2024-08-17T02:46:45.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.468+0000 7f01d1800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0ce130 con 0x7f01cc153400 2024-08-17T02:46:45.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.468+0000 7f01c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f01cc1537d0 0x7f01cc15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.468+0000 7f01c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f01cc1537d0 0x7f01cc15a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33424/0 (socket says 172.21.15.2:33424) 2024-08-17T02:46:45.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.468+0000 7f01c3e00640 1 -- 172.21.15.2:0/3630078468 learned_addr learned my addr 172.21.15.2:0/3630078468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:45.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.469+0000 7f01caa00640 1 --2- 172.21.15.2:0/3630078468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc153400 0x7f01cc069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.469+0000 7f01c3e00640 1 -- 172.21.15.2:0/3630078468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc153400 msgr2=0x7f01cc069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:45.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.469+0000 7f01c3e00640 1 --2- 172.21.15.2:0/3630078468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc153400 0x7f01cc069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.469+0000 7f01c3e00640 1 -- 172.21.15.2:0/3630078468 >> v1:172.21.15.26:6789/0 conn(0x7f01cc0683b0 legacy=0x7f01cc0687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.469+0000 7f01c3e00640 1 -- 172.21.15.2:0/3630078468 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0b55d0 con 0x7f01cc1537d0 2024-08-17T02:46:45.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.470+0000 7f01c3e00640 1 --2- 172.21.15.2:0/3630078468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1537d0 0x7f01cc15a080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009910 tx=0x7f01b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8542e081be6d4b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.470+0000 7f01ca000640 1 -- 172.21.15.2:0/3630078468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b402adb0 con 0x7f01cc1537d0 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.470+0000 7f01ca000640 1 -- 172.21.15.2:0/3630078468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b4032440 con 0x7f01cc1537d0 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.470+0000 7f01ca000640 1 -- 172.21.15.2:0/3630078468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4032820 con 0x7f01cc1537d0 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.471+0000 7f01d1800640 1 -- 172.21.15.2:0/3630078468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1537d0 msgr2=0x7f01cc15a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.471+0000 7f01d1800640 1 --2- 172.21.15.2:0/3630078468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1537d0 0x7f01cc15a080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009910 tx=0x7f01b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.471+0000 7f01d1800640 1 -- 172.21.15.2:0/3630078468 shutdown_connections 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.471+0000 7f01d1800640 1 --2- 172.21.15.2:0/3630078468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc1537d0 0x7f01cc15a080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.471+0000 7f01d1800640 1 --2- 172.21.15.2:0/3630078468 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc153400 0x7f01cc069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.471+0000 7f01d1800640 1 -- 172.21.15.2:0/3630078468 >> 172.21.15.2:0/3630078468 conn(0x7f01cc0d07c0 msgr2=0x7f01cc0b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.471+0000 7f01d1800640 1 -- 172.21.15.2:0/3630078468 shutdown_connections 2024-08-17T02:46:45.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.471+0000 7f01d1800640 1 -- 172.21.15.2:0/3630078468 wait complete. 2024-08-17T02:46:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.472+0000 7f01d1800640 1 Processor -- start 2024-08-17T02:46:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.472+0000 7f01d1800640 1 -- start start 2024-08-17T02:46:45.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.473+0000 7f01d1800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01cc0683b0 0x7f01cc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.473+0000 7f01d1800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc153400 0x7f01cc155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.473+0000 7f01d1800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc1537d0 0x7f01cc1422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.473+0000 7f01d1800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc1571c0 con 0x7f01cc153400 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.473+0000 7f01d1800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0b4d10 con 0x7f01cc0683b0 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.473+0000 7f01d1800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc1565b0 con 0x7f01cc1537d0 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc153400 0x7f01cc155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc153400 0x7f01cc155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33438/0 (socket says 172.21.15.2:33438) 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01caa00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01cc0683b0 0x7f01cc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01c3e00640 1 -- 172.21.15.2:0/203439880 learned_addr learned my addr 172.21.15.2:0/203439880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:45.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01cb400640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc1537d0 0x7f01cc1422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01c3e00640 1 -- 172.21.15.2:0/203439880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc1537d0 msgr2=0x7f01cc1422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01c3e00640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc1537d0 0x7f01cc1422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01c3e00640 1 -- 172.21.15.2:0/203439880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01cc0683b0 msgr2=0x7f01cc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01c3e00640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01cc0683b0 0x7f01cc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.474+0000 7f01c3e00640 1 -- 172.21.15.2:0/203439880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4009450 con 0x7f01cc153400 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.475+0000 7f01c3e00640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc153400 0x7f01cc155bd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f01b4035040 tx=0x7f01b4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.475+0000 7f01c2000640 1 -- 172.21.15.2:0/203439880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4031c80 con 0x7f01cc153400 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.475+0000 7f01c2000640 1 -- 172.21.15.2:0/203439880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b4031e00 con 0x7f01cc153400 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.475+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc156890 con 0x7f01cc153400 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.475+0000 7f01c2000640 1 -- 172.21.15.2:0/203439880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b403d670 con 0x7f01cc153400 2024-08-17T02:46:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.475+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc156e50 con 0x7f01cc153400 2024-08-17T02:46:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.476+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc157330 con 0x7f01cc153400 2024-08-17T02:46:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.477+0000 7f01c2000640 1 -- 172.21.15.2:0/203439880 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f01b4039040 con 0x7f01cc153400 2024-08-17T02:46:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.478+0000 7f01c2000640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f01a8065180 0x7f01a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.478+0000 7f01c2000640 1 -- 172.21.15.2:0/203439880 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01b40a2770 con 0x7f01cc153400 2024-08-17T02:46:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.478+0000 7f01caa00640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f01a8065180 0x7f01a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.479+0000 7f01caa00640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f01a8065180 0x7f01a8067630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01bc007ba0 tx=0x7f01bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.482+0000 7f01c2000640 1 -- 172.21.15.2:0/203439880 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f01b4070840 con 0x7f01cc153400 2024-08-17T02:46:45.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.663+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01cc063fb0 con 0x7f01cc153400 2024-08-17T02:46:45.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.663+0000 7f01c2000640 1 -- 172.21.15.2:0/203439880 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01b4073e60 con 0x7f01cc153400 2024-08-17T02:46:45.664 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:45.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f01a8065180 msgr2=0x7f01a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f01a8065180 0x7f01a8067630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01bc007ba0 tx=0x7f01bc008040 comp rx=0 tx=0).stop 2024-08-17T02:46:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc153400 msgr2=0x7f01cc155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc153400 0x7f01cc155bd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f01b4035040 tx=0x7f01b4032000 comp rx=0 tx=0).stop 2024-08-17T02:46:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 shutdown_connections 2024-08-17T02:46:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f01a8065180 0x7f01a8067630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f01cc1537d0 0x7f01cc1422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01cc153400 0x7f01cc155bd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 --2- 172.21.15.2:0/203439880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01cc0683b0 0x7f01cc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.665+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 >> 172.21.15.2:0/203439880 conn(0x7f01cc0d07c0 msgr2=0x7f01cc15b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.666+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 shutdown_connections 2024-08-17T02:46:45.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.666+0000 7f01d1800640 1 -- 172.21.15.2:0/203439880 wait complete. 2024-08-17T02:46:45.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:45.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.837+0000 7f4ce7e00640 1 Processor -- start 2024-08-17T02:46:45.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.837+0000 7f4ce7e00640 1 -- start start 2024-08-17T02:46:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.838+0000 7f4ce7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4ce00ca050 0x7f4ce0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.838+0000 7f4ce7e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce00cb160 con 0x7f4ce00ad960 2024-08-17T02:46:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce7e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce00b0d10 con 0x7f4ce00add30 2024-08-17T02:46:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce7e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce00ca550 con 0x7f4ce00ca050 2024-08-17T02:46:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce4a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4ce00ca050 0x7f4ce0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce4a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4ce00ca050 0x7f4ce0156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33446/0 (socket says 172.21.15.2:33446) 2024-08-17T02:46:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce4a00640 1 -- 172.21.15.2:0/3911724514 learned_addr learned my addr 172.21.15.2:0/3911724514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce5400640 1 --1- 172.21.15.2:0/3911724514 >> v1:172.21.15.2:6789/0 conn(0x7f4ce00ad960 0x7f4ce0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42986/0 (socket says 172.21.15.2:42986) 2024-08-17T02:46:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce4a00640 1 -- 172.21.15.2:0/3911724514 >> v1:172.21.15.26:6789/0 conn(0x7f4ce00add30 legacy=0x7f4ce00aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce4a00640 1 -- 172.21.15.2:0/3911724514 >> v1:172.21.15.2:6789/0 conn(0x7f4ce00ad960 legacy=0x7f4ce0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.839+0000 7f4ce4a00640 1 -- 172.21.15.2:0/3911724514 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00ca830 con 0x7f4ce00ca050 2024-08-17T02:46:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.840+0000 7f4ce4a00640 1 --2- 172.21.15.2:0/3911724514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce0156b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009910 tx=0x7f4ccc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7583afda5bd4db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.840+0000 7f4cdfe00640 1 -- 172.21.15.2:0/3911724514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc032440 con 0x7f4ce00ca050 2024-08-17T02:46:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.840+0000 7f4cdfe00640 1 -- 172.21.15.2:0/3911724514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc0325a0 con 0x7f4ce00ca050 2024-08-17T02:46:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.840+0000 7f4cdfe00640 1 -- 172.21.15.2:0/3911724514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc032980 con 0x7f4ce00ca050 2024-08-17T02:46:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.841+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3911724514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 msgr2=0x7f4ce0156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.841+0000 7f4ce7e00640 1 --2- 172.21.15.2:0/3911724514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce0156b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009910 tx=0x7f4ccc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.841+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3911724514 shutdown_connections 2024-08-17T02:46:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.841+0000 7f4ce7e00640 1 --2- 172.21.15.2:0/3911724514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce0156b30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.841+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3911724514 >> 172.21.15.2:0/3911724514 conn(0x7f4ce0066e60 msgr2=0x7f4ce0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.841+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3911724514 shutdown_connections 2024-08-17T02:46:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.841+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3911724514 wait complete. 2024-08-17T02:46:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.842+0000 7f4ce7e00640 1 Processor -- start 2024-08-17T02:46:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.843+0000 7f4ce7e00640 1 -- start start 2024-08-17T02:46:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.843+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ce00ad960 0x7f4ce015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.843+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ce00add30 0x7f4ce0152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.843+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce01531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.843+0000 7f4ce7e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00ad130 con 0x7f4ce00ca050 2024-08-17T02:46:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.843+0000 7f4ce7e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0157230 con 0x7f4ce00ad960 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.843+0000 7f4ce7e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0157510 con 0x7f4ce00add30 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce01531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce01531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33456/0 (socket says 172.21.15.2:33456) 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 -- 172.21.15.2:0/3065578477 learned_addr learned my addr 172.21.15.2:0/3065578477 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5400640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ce00ad960 0x7f4ce015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce4a00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ce00add30 0x7f4ce0152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 -- 172.21.15.2:0/3065578477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ce00add30 msgr2=0x7f4ce0152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ce00add30 0x7f4ce0152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 -- 172.21.15.2:0/3065578477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ce00ad960 msgr2=0x7f4ce015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ce00ad960 0x7f4ce015bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 -- 172.21.15.2:0/3065578477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc009450 con 0x7f4ce00ca050 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.844+0000 7f4ce5e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce01531d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800c890 tx=0x7f4cd8002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.845+0000 7f4cdcc00640 1 -- 172.21.15.2:0/3065578477 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd800ce80 con 0x7f4ce00ca050 2024-08-17T02:46:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.845+0000 7f4cdcc00640 1 -- 172.21.15.2:0/3065578477 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd800a7f0 con 0x7f4ce00ca050 2024-08-17T02:46:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.845+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce01577f0 con 0x7f4ce00ca050 2024-08-17T02:46:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.845+0000 7f4cdcc00640 1 -- 172.21.15.2:0/3065578477 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd800abf0 con 0x7f4ce00ca050 2024-08-17T02:46:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.845+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce0157ff0 con 0x7f4ce00ca050 2024-08-17T02:46:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.846+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce0063fb0 con 0x7f4ce00ca050 2024-08-17T02:46:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.847+0000 7f4cdcc00640 1 -- 172.21.15.2:0/3065578477 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4cd800ad50 con 0x7f4ce00ca050 2024-08-17T02:46:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.848+0000 7f4cdcc00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4cc0065150 0x7f4cc0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.848+0000 7f4cdcc00640 1 -- 172.21.15.2:0/3065578477 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4cd8082790 con 0x7f4ce00ca050 2024-08-17T02:46:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.848+0000 7f4ce5400640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4cc0065150 0x7f4cc0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.849+0000 7f4ce5400640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4cc0065150 0x7f4cc0067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00aa390 tx=0x7f4cd4007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:45.852+0000 7f4cdcc00640 1 -- 172.21.15.2:0/3065578477 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4cd8050860 con 0x7f4ce00ca050 2024-08-17T02:46:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.030+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ce00ab200 con 0x7f4ce00ca050 2024-08-17T02:46:46.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.031+0000 7f4cdcc00640 1 -- 172.21.15.2:0/3065578477 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4cd8016020 con 0x7f4ce00ca050 2024-08-17T02:46:46.032 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:46:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.032+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4cc0065150 msgr2=0x7f4cc0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.032+0000 7f4ce7e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4cc0065150 0x7f4cc0067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00aa390 tx=0x7f4cd4007e20 comp rx=0 tx=0).stop 2024-08-17T02:46:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.032+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 msgr2=0x7f4ce01531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.032+0000 7f4ce7e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce01531d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800c890 tx=0x7f4cd8002640 comp rx=0 tx=0).stop 2024-08-17T02:46:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.033+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 shutdown_connections 2024-08-17T02:46:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.033+0000 7f4ce7e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ce00ca050 0x7f4ce01531d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.033+0000 7f4ce7e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4cc0065150 0x7f4cc0067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.033+0000 7f4ce7e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ce00add30 0x7f4ce0152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.033+0000 7f4ce7e00640 1 --2- 172.21.15.2:0/3065578477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ce00ad960 0x7f4ce015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.033+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 >> 172.21.15.2:0/3065578477 conn(0x7f4ce0066e60 msgr2=0x7f4ce006de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.033+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 shutdown_connections 2024-08-17T02:46:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.033+0000 7f4ce7e00640 1 -- 172.21.15.2:0/3065578477 wait complete. 2024-08-17T02:46:46.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.203+0000 7f6259400640 1 Processor -- start 2024-08-17T02:46:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.203+0000 7f6259400640 1 -- start start 2024-08-17T02:46:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.204+0000 7f6259400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62540afca0 0x7f62540b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.204+0000 7f6259400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 0x7f6254159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6259400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625415a4e0 con 0x7f62541589a0 2024-08-17T02:46:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6259400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62540b0980 con 0x7f62540afca0 2024-08-17T02:46:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6259400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62540c92b0 con 0x7f62540acf10 2024-08-17T02:46:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6253200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f62541589a0 0x7f625406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42994/0 (socket says 172.21.15.2:42994) 2024-08-17T02:46:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6253200640 1 -- 172.21.15.2:0/297159220 learned_addr learned my addr 172.21.15.2:0/297159220 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6252800640 1 --2- 172.21.15.2:0/297159220 >> v2:172.21.15.26:3300/0 conn(0x7f62540afca0 0x7f62540b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6249e00640 1 --2- 172.21.15.2:0/297159220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 0x7f6254159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6251e00640 1 -- 172.21.15.2:0/297159220 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832707461 0 0) 0x7f624c001490 con 0x7f62541589a0 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.205+0000 7f6251e00640 1 -- 172.21.15.2:0/297159220 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62380034e0 con 0x7f62541589a0 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.206+0000 7f6251e00640 1 -- 172.21.15.2:0/297159220 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1893173213 0 0) 0x7f62380034e0 con 0x7f62541589a0 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.206+0000 7f6252800640 1 -- 172.21.15.2:0/297159220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 msgr2=0x7f6254159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.206+0000 7f6252800640 1 --2- 172.21.15.2:0/297159220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 0x7f6254159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.206+0000 7f6252800640 1 -- 172.21.15.2:0/297159220 >> v1:172.21.15.2:6789/0 conn(0x7f62541589a0 legacy=0x7f625406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.206+0000 7f6252800640 1 -- 172.21.15.2:0/297159220 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540ad480 con 0x7f62540afca0 2024-08-17T02:46:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.207+0000 7f6252800640 1 --2- 172.21.15.2:0/297159220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62540afca0 0x7f62540b0070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6244009880 tx=0x7f62440090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17221ebf25993b3d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.207+0000 7f6251e00640 1 -- 172.21.15.2:0/297159220 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c001980 con 0x7f62540afca0 2024-08-17T02:46:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.207+0000 7f6251e00640 1 -- 172.21.15.2:0/297159220 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624402aa70 con 0x7f62540afca0 2024-08-17T02:46:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.207+0000 7f6251e00640 1 -- 172.21.15.2:0/297159220 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624402ae10 con 0x7f62540afca0 2024-08-17T02:46:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.208+0000 7f6259400640 1 -- 172.21.15.2:0/297159220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62540afca0 msgr2=0x7f62540b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.208+0000 7f6259400640 1 --2- 172.21.15.2:0/297159220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62540afca0 0x7f62540b0070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6244009880 tx=0x7f62440090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.208+0000 7f6259400640 1 -- 172.21.15.2:0/297159220 shutdown_connections 2024-08-17T02:46:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.208+0000 7f6259400640 1 --2- 172.21.15.2:0/297159220 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 0x7f6254159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.208+0000 7f6259400640 1 --2- 172.21.15.2:0/297159220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62540afca0 0x7f62540b0070 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.208+0000 7f6259400640 1 -- 172.21.15.2:0/297159220 >> 172.21.15.2:0/297159220 conn(0x7f6254066e60 msgr2=0x7f6254067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.208+0000 7f6259400640 1 -- 172.21.15.2:0/297159220 shutdown_connections 2024-08-17T02:46:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.208+0000 7f6259400640 1 -- 172.21.15.2:0/297159220 wait complete. 2024-08-17T02:46:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.209+0000 7f6259400640 1 Processor -- start 2024-08-17T02:46:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.210+0000 7f6259400640 1 -- start start 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.210+0000 7f6259400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 0x7f62540a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.210+0000 7f6259400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62540afca0 0x7f625414d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6259400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62541589a0 0x7f6254148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6259400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62541498a0 con 0x7f62540afca0 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6259400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540a4b80 con 0x7f62541589a0 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6259400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62540a4570 con 0x7f62540acf10 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6249e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62540afca0 0x7f625414d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6249e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62540afca0 0x7f625414d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33468/0 (socket says 172.21.15.2:33468) 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6249e00640 1 -- 172.21.15.2:0/2895786294 learned_addr learned my addr 172.21.15.2:0/2895786294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6252800640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 0x7f62540a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6253200640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62541589a0 0x7f6254148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6249e00640 1 -- 172.21.15.2:0/2895786294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 msgr2=0x7f62540a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6249e00640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 0x7f62540a5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6249e00640 1 -- 172.21.15.2:0/2895786294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62541589a0 msgr2=0x7f6254148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6249e00640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62541589a0 0x7f6254148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.211+0000 7f6249e00640 1 -- 172.21.15.2:0/2895786294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244009390 con 0x7f62540afca0 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.212+0000 7f6249e00640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62540afca0 0x7f625414d900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f623c00ea20 tx=0x7f623c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.212+0000 7f624aa00640 1 -- 172.21.15.2:0/2895786294 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00ca10 con 0x7f62540afca0 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.212+0000 7f624aa00640 1 -- 172.21.15.2:0/2895786294 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00cb70 con 0x7f62540afca0 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.212+0000 7f624aa00640 1 -- 172.21.15.2:0/2895786294 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c013470 con 0x7f62540afca0 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.212+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625414cbb0 con 0x7f62540afca0 2024-08-17T02:46:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.212+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625414ce90 con 0x7f62540afca0 2024-08-17T02:46:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.213+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6254063fb0 con 0x7f62540afca0 2024-08-17T02:46:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.214+0000 7f624aa00640 1 -- 172.21.15.2:0/2895786294 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f623c013820 con 0x7f62540afca0 2024-08-17T02:46:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.215+0000 7f624aa00640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6230065150 0x7f6230067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.215+0000 7f624aa00640 1 -- 172.21.15.2:0/2895786294 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f623c0826d0 con 0x7f62540afca0 2024-08-17T02:46:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.215+0000 7f6252800640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6230065150 0x7f6230067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.216+0000 7f6252800640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6230065150 0x7f6230067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6244034000 tx=0x7f6244032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.219+0000 7f624aa00640 1 -- 172.21.15.2:0/2895786294 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f623c0507a0 con 0x7f62540afca0 2024-08-17T02:46:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.399+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6254067b70 con 0x7f62540afca0 2024-08-17T02:46:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.399+0000 7f624aa00640 1 -- 172.21.15.2:0/2895786294 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f623c053dc0 con 0x7f62540afca0 2024-08-17T02:46:46.401 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.401+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6230065150 msgr2=0x7f6230067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.401+0000 7f6259400640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6230065150 0x7f6230067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6244034000 tx=0x7f6244032000 comp rx=0 tx=0).stop 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.401+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62540afca0 msgr2=0x7f625414d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.401+0000 7f6259400640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62540afca0 0x7f625414d900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f623c00ea20 tx=0x7f623c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.401+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 shutdown_connections 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.401+0000 7f6259400640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62541589a0 0x7f6254148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.402+0000 7f6259400640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62540afca0 0x7f625414d900 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.402+0000 7f6259400640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6230065150 0x7f6230067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.402+0000 7f6259400640 1 --2- 172.21.15.2:0/2895786294 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f62540acf10 0x7f62540a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.402+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 >> 172.21.15.2:0/2895786294 conn(0x7f6254066e60 msgr2=0x7f62540cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:46.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.402+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 shutdown_connections 2024-08-17T02:46:46.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.402+0000 7f6259400640 1 -- 172.21.15.2:0/2895786294 wait complete. 2024-08-17T02:46:46.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:46:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.568+0000 7efc4fe00640 1 Processor -- start 2024-08-17T02:46:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.568+0000 7efc4fe00640 1 -- start start 2024-08-17T02:46:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.569+0000 7efc4fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc5015a490 0x7efc500ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.569+0000 7efc4fe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efc500b1920 0x7efc500b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.569+0000 7efc4fe00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5015b6b0 con 0x7efc50158c60 2024-08-17T02:46:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.569+0000 7efc4fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500b0540 con 0x7efc5015a490 2024-08-17T02:46:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.569+0000 7efc4fe00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5015a8b0 con 0x7efc500b1920 2024-08-17T02:46:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.569+0000 7efc4e000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc5015a490 0x7efc500ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.569+0000 7efc4e000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc5015a490 0x7efc500ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33484/0 (socket says 172.21.15.2:33484) 2024-08-17T02:46:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.569+0000 7efc4e000640 1 -- 172.21.15.2:0/242820552 learned_addr learned my addr 172.21.15.2:0/242820552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.570+0000 7efc4f400640 1 --2- 172.21.15.2:0/242820552 >> v2:172.21.15.26:3300/0 conn(0x7efc500b1920 0x7efc500b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.570+0000 7efc4e000640 1 -- 172.21.15.2:0/242820552 >> v2:172.21.15.26:3300/0 conn(0x7efc500b1920 msgr2=0x7efc500b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.570+0000 7efc4e000640 1 --2- 172.21.15.2:0/242820552 >> v2:172.21.15.26:3300/0 conn(0x7efc500b1920 0x7efc500b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.570+0000 7efc4e000640 1 -- 172.21.15.2:0/242820552 >> v1:172.21.15.26:6789/0 conn(0x7efc50158c60 legacy=0x7efc50159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.570+0000 7efc4e000640 1 -- 172.21.15.2:0/242820552 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5015aac0 con 0x7efc5015a490 2024-08-17T02:46:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.570+0000 7efc4f400640 1 --2- 172.21.15.2:0/242820552 >> v2:172.21.15.26:3300/0 conn(0x7efc500b1920 0x7efc500b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.571+0000 7efc4e000640 1 --2- 172.21.15.2:0/242820552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc5015a490 0x7efc500ca8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efc500b11b0 tx=0x7efc3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e3803d5263eb07 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.571+0000 7efc4d600640 1 -- 172.21.15.2:0/242820552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c02add0 con 0x7efc5015a490 2024-08-17T02:46:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.571+0000 7efc4d600640 1 -- 172.21.15.2:0/242820552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c032440 con 0x7efc5015a490 2024-08-17T02:46:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.571+0000 7efc4d600640 1 -- 172.21.15.2:0/242820552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c032820 con 0x7efc5015a490 2024-08-17T02:46:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.572+0000 7efc4fe00640 1 -- 172.21.15.2:0/242820552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc5015a490 msgr2=0x7efc500ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.572+0000 7efc4fe00640 1 --2- 172.21.15.2:0/242820552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc5015a490 0x7efc500ca8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efc500b11b0 tx=0x7efc3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.572+0000 7efc4fe00640 1 -- 172.21.15.2:0/242820552 shutdown_connections 2024-08-17T02:46:46.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.572+0000 7efc4fe00640 1 --2- 172.21.15.2:0/242820552 >> v2:172.21.15.26:3300/0 conn(0x7efc500b1920 0x7efc500b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.572+0000 7efc4fe00640 1 --2- 172.21.15.2:0/242820552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc5015a490 0x7efc500ca8b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.572+0000 7efc4fe00640 1 -- 172.21.15.2:0/242820552 >> 172.21.15.2:0/242820552 conn(0x7efc5006e590 msgr2=0x7efc5006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:46.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.572+0000 7efc4fe00640 1 -- 172.21.15.2:0/242820552 shutdown_connections 2024-08-17T02:46:46.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.572+0000 7efc4fe00640 1 -- 172.21.15.2:0/242820552 wait complete. 2024-08-17T02:46:46.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.573+0000 7efc4fe00640 1 Processor -- start 2024-08-17T02:46:46.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.574+0000 7efc4fe00640 1 -- start start 2024-08-17T02:46:46.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.574+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc500b1920 0x7efc500cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.574+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50158c60 0x7efc500cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.574+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5015a490 0x7efc5015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.574+0000 7efc4fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc500c3610 con 0x7efc50158c60 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.574+0000 7efc4fe00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5015e450 con 0x7efc5015a490 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.574+0000 7efc4fe00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5015e730 con 0x7efc500b1920 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50158c60 0x7efc500cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50158c60 0x7efc500cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33500/0 (socket says 172.21.15.2:33500) 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4e000640 1 -- 172.21.15.2:0/4119571955 learned_addr learned my addr 172.21.15.2:0/4119571955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4ea00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc500b1920 0x7efc500cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4f400640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5015a490 0x7efc5015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4e000640 1 -- 172.21.15.2:0/4119571955 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc500b1920 msgr2=0x7efc500cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4e000640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc500b1920 0x7efc500cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4e000640 1 -- 172.21.15.2:0/4119571955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5015a490 msgr2=0x7efc5015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4e000640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5015a490 0x7efc5015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.575+0000 7efc4e000640 1 -- 172.21.15.2:0/4119571955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009450 con 0x7efc50158c60 2024-08-17T02:46:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.576+0000 7efc4e000640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50158c60 0x7efc500cc980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009210 tx=0x7efc3c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.576+0000 7efc46000640 1 -- 172.21.15.2:0/4119571955 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c006b30 con 0x7efc50158c60 2024-08-17T02:46:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.576+0000 7efc46000640 1 -- 172.21.15.2:0/4119571955 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c031a40 con 0x7efc50158c60 2024-08-17T02:46:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.576+0000 7efc46000640 1 -- 172.21.15.2:0/4119571955 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c031e00 con 0x7efc50158c60 2024-08-17T02:46:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.576+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5015ea10 con 0x7efc50158c60 2024-08-17T02:46:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.576+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc501566f0 con 0x7efc50158c60 2024-08-17T02:46:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.577+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc500c3780 con 0x7efc50158c60 2024-08-17T02:46:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.578+0000 7efc46000640 1 -- 172.21.15.2:0/4119571955 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc3c039040 con 0x7efc50158c60 2024-08-17T02:46:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.579+0000 7efc46000640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efc30065150 0x7efc30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.579+0000 7efc46000640 1 -- 172.21.15.2:0/4119571955 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc3c0a1fd0 con 0x7efc50158c60 2024-08-17T02:46:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.579+0000 7efc4ea00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efc30065150 0x7efc30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.579+0000 7efc4ea00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efc30065150 0x7efc30067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc40007fd0 tx=0x7efc40007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.583+0000 7efc46000640 1 -- 172.21.15.2:0/4119571955 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc3c070140 con 0x7efc50158c60 2024-08-17T02:46:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:46.830+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7efc50070720 con 0x7efc50158c60 2024-08-17T02:46:47.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.101+0000 7efc46000640 1 -- 172.21.15.2:0/4119571955 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7efc3c073760 con 0x7efc50158c60 2024-08-17T02:46:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efc30065150 msgr2=0x7efc30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efc30065150 0x7efc30067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efc40007fd0 tx=0x7efc40007e30 comp rx=0 tx=0).stop 2024-08-17T02:46:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50158c60 msgr2=0x7efc500cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50158c60 0x7efc500cc980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009210 tx=0x7efc3c032000 comp rx=0 tx=0).stop 2024-08-17T02:46:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 shutdown_connections 2024-08-17T02:46:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc5015a490 0x7efc5015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc50158c60 0x7efc500cc980 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efc30065150 0x7efc30067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 --2- 172.21.15.2:0/4119571955 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efc500b1920 0x7efc500cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 >> 172.21.15.2:0/4119571955 conn(0x7efc5006e590 msgr2=0x7efc501597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 shutdown_connections 2024-08-17T02:46:47.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.103+0000 7efc4fe00640 1 -- 172.21.15.2:0/4119571955 wait complete. 2024-08-17T02:46:47.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:46:47.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.272+0000 7f4540e00640 1 Processor -- start 2024-08-17T02:46:47.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.272+0000 7f4540e00640 1 -- start start 2024-08-17T02:46:47.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.273+0000 7f4540e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f453c1590b0 0x7f453c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.273+0000 7f4540e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f453c0acf10 0x7f453c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.273+0000 7f4540e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c15a4e0 con 0x7f453c0afca0 2024-08-17T02:46:47.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.273+0000 7f4540e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c0b0980 con 0x7f453c1590b0 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.273+0000 7f4540e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c0c92b0 con 0x7f453c0acf10 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f4539400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f453c1590b0 0x7f453c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f4539400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f453c1590b0 0x7f453c0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33504/0 (socket says 172.21.15.2:33504) 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f4539400640 1 -- 172.21.15.2:0/2163539761 learned_addr learned my addr 172.21.15.2:0/2163539761 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f453a800640 1 --2- 172.21.15.2:0/2163539761 >> v2:172.21.15.26:3300/0 conn(0x7f453c0acf10 0x7f453c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f4539400640 1 -- 172.21.15.2:0/2163539761 >> v2:172.21.15.26:3300/0 conn(0x7f453c0acf10 msgr2=0x7f453c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f4539400640 1 --2- 172.21.15.2:0/2163539761 >> v2:172.21.15.26:3300/0 conn(0x7f453c0acf10 0x7f453c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f4539400640 1 -- 172.21.15.2:0/2163539761 >> v1:172.21.15.26:6789/0 conn(0x7f453c0afca0 legacy=0x7f453c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f4539400640 1 -- 172.21.15.2:0/2163539761 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0ad480 con 0x7f453c1590b0 2024-08-17T02:46:47.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.274+0000 7f453a800640 1 --2- 172.21.15.2:0/2163539761 >> v2:172.21.15.26:3300/0 conn(0x7f453c0acf10 0x7f453c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:47.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.275+0000 7f4539400640 1 --2- 172.21.15.2:0/2163539761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c1590b0 0x7f453c0b0070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f453c0cb4a0 tx=0x7f45280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e191f689655d181d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:47.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.275+0000 7f4538a00640 1 -- 172.21.15.2:0/2163539761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802ae80 con 0x7f453c1590b0 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.275+0000 7f4538a00640 1 -- 172.21.15.2:0/2163539761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4528032440 con 0x7f453c1590b0 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.275+0000 7f4538a00640 1 -- 172.21.15.2:0/2163539761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528032800 con 0x7f453c1590b0 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.276+0000 7f4540e00640 1 -- 172.21.15.2:0/2163539761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c1590b0 msgr2=0x7f453c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.276+0000 7f4540e00640 1 --2- 172.21.15.2:0/2163539761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c1590b0 0x7f453c0b0070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f453c0cb4a0 tx=0x7f45280091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.276+0000 7f4540e00640 1 -- 172.21.15.2:0/2163539761 shutdown_connections 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.276+0000 7f4540e00640 1 --2- 172.21.15.2:0/2163539761 >> v2:172.21.15.26:3300/0 conn(0x7f453c0acf10 0x7f453c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.276+0000 7f4540e00640 1 --2- 172.21.15.2:0/2163539761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c1590b0 0x7f453c0b0070 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.276+0000 7f4540e00640 1 -- 172.21.15.2:0/2163539761 >> 172.21.15.2:0/2163539761 conn(0x7f453c066e60 msgr2=0x7f453c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.276+0000 7f4540e00640 1 -- 172.21.15.2:0/2163539761 shutdown_connections 2024-08-17T02:46:47.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.276+0000 7f4540e00640 1 -- 172.21.15.2:0/2163539761 wait complete. 2024-08-17T02:46:47.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.278+0000 7f4540e00640 1 Processor -- start 2024-08-17T02:46:47.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.278+0000 7f4540e00640 1 -- start start 2024-08-17T02:46:47.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4540e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c0acf10 0x7f453c0a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4540e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c0afca0 0x7f453c0a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4540e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c1590b0 0x7f453c155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4540e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0a94d0 con 0x7f453c0acf10 2024-08-17T02:46:47.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4540e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0a5a30 con 0x7f453c1590b0 2024-08-17T02:46:47.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4540e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0a6550 con 0x7f453c0afca0 2024-08-17T02:46:47.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c0acf10 0x7f453c0a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c0acf10 0x7f453c0a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33518/0 (socket says 172.21.15.2:33518) 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539e00640 1 -- 172.21.15.2:0/2516168967 learned_addr learned my addr 172.21.15.2:0/2516168967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f453a800640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c1590b0 0x7f453c155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539400640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c0afca0 0x7f453c0a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539e00640 1 -- 172.21.15.2:0/2516168967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c0afca0 msgr2=0x7f453c0a54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c0afca0 0x7f453c0a54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539e00640 1 -- 172.21.15.2:0/2516168967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c1590b0 msgr2=0x7f453c155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c1590b0 0x7f453c155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.279+0000 7f4539e00640 1 -- 172.21.15.2:0/2516168967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528009450 con 0x7f453c0acf10 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.280+0000 7f4539e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c0acf10 0x7f453c0a7be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f452c00c560 tx=0x7f452c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.280+0000 7f4531600640 1 -- 172.21.15.2:0/2516168967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c011590 con 0x7f453c0acf10 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.280+0000 7f4531600640 1 -- 172.21.15.2:0/2516168967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c011710 con 0x7f453c0acf10 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.280+0000 7f4531600640 1 -- 172.21.15.2:0/2516168967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c011ad0 con 0x7f453c0acf10 2024-08-17T02:46:47.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.280+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c0a9700 con 0x7f453c0acf10 2024-08-17T02:46:47.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.280+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c0a6270 con 0x7f453c0acf10 2024-08-17T02:46:47.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.281+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c063fb0 con 0x7f453c0acf10 2024-08-17T02:46:47.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.282+0000 7f4531600640 1 -- 172.21.15.2:0/2516168967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f452c01b3b0 con 0x7f453c0acf10 2024-08-17T02:46:47.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.283+0000 7f4531600640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f451c065150 0x7f451c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:47.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.283+0000 7f4531600640 1 -- 172.21.15.2:0/2516168967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f452c081890 con 0x7f453c0acf10 2024-08-17T02:46:47.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.283+0000 7f4539400640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f451c065150 0x7f451c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:47.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.284+0000 7f4539400640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f451c065150 0x7f451c067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4528034000 tx=0x7f4528032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:47.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.287+0000 7f4531600640 1 -- 172.21.15.2:0/2516168967 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f452c04f8b0 con 0x7f453c0acf10 2024-08-17T02:46:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.468+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f453c15a4e0 con 0x7f453c0acf10 2024-08-17T02:46:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.472+0000 7f4531600640 1 -- 172.21.15.2:0/2516168967 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f453c15a4e0 con 0x7f453c0acf10 2024-08-17T02:46:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f451c065150 msgr2=0x7f451c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f451c065150 0x7f451c067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4528034000 tx=0x7f4528032000 comp rx=0 tx=0).stop 2024-08-17T02:46:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c0acf10 msgr2=0x7f453c0a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c0acf10 0x7f453c0a7be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f452c00c560 tx=0x7f452c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 shutdown_connections 2024-08-17T02:46:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f453c1590b0 0x7f453c155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f451c065150 0x7f451c067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f453c0afca0 0x7f453c0a54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 --2- 172.21.15.2:0/2516168967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f453c0acf10 0x7f453c0a7be0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 >> 172.21.15.2:0/2516168967 conn(0x7f453c066e60 msgr2=0x7f453c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 shutdown_connections 2024-08-17T02:46:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:47.474+0000 7f4540e00640 1 -- 172.21.15.2:0/2516168967 wait complete. 2024-08-17T02:46:47.490 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:46:47.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:46:47.588 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:46:47.678 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:46:47.678 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:46:47.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:46:47.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:46:47.740 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:46:47.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:47.740 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:46:47.783 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:46:47.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:46:47.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:46:47.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:46:47.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:47.850 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:46:47.893 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:46:47.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:46:47.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:46:47.955 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:46:47.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:47.955 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:46:47.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:46:47.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:46:47.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:46:48.053 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:46:48.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:46:48.053 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:46:48.089 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:46:48.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:48.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.240+0000 7fb879400640 1 Processor -- start 2024-08-17T02:46:48.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.240+0000 7fb879400640 1 -- start start 2024-08-17T02:46:48.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb879400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8740b0e30 0x7fb8740b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb879400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb874156f90 0x7fb8740cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb879400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb87415a590 0x7fb87413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb879400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87406d7c0 con 0x7fb87415a590 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb879400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8740cb5b0 con 0x7fb874156f90 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb879400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87415ab30 con 0x7fb8740b0e30 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb878a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb87415a590 0x7fb87413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb878a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb87415a590 0x7fb87413fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33532/0 (socket says 172.21.15.2:33532) 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb878a00640 1 -- 172.21.15.2:0/1972366337 learned_addr learned my addr 172.21.15.2:0/1972366337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb873e00640 1 --2- 172.21.15.2:0/1972366337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8740b0e30 0x7fb8740b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb873400640 1 --2- 172.21.15.2:0/1972366337 >> v2:172.21.15.26:3300/0 conn(0x7fb874156f90 0x7fb8740cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb878a00640 1 -- 172.21.15.2:0/1972366337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8740b0e30 msgr2=0x7fb8740b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb878a00640 1 --2- 172.21.15.2:0/1972366337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8740b0e30 0x7fb8740b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb878a00640 1 -- 172.21.15.2:0/1972366337 >> v2:172.21.15.26:3300/0 conn(0x7fb874156f90 msgr2=0x7fb8740cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb878a00640 1 --2- 172.21.15.2:0/1972366337 >> v2:172.21.15.26:3300/0 conn(0x7fb874156f90 0x7fb8740cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.242+0000 7fb878a00640 1 -- 172.21.15.2:0/1972366337 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87415ae10 con 0x7fb87415a590 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.244+0000 7fb878a00640 1 --2- 172.21.15.2:0/1972366337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb87413fcc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb87406bcd0 tx=0x7fb86c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb9620ec8c6d730 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.244+0000 7fb872a00640 1 -- 172.21.15.2:0/1972366337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c031400 con 0x7fb87415a590 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.244+0000 7fb872a00640 1 -- 172.21.15.2:0/1972366337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c02d050 con 0x7fb87415a590 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.244+0000 7fb872a00640 1 -- 172.21.15.2:0/1972366337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0317d0 con 0x7fb87415a590 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.244+0000 7fb879400640 1 -- 172.21.15.2:0/1972366337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 msgr2=0x7fb87413fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.244+0000 7fb879400640 1 --2- 172.21.15.2:0/1972366337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb87413fcc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb87406bcd0 tx=0x7fb86c009840 comp rx=0 tx=0).stop 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.244+0000 7fb879400640 1 -- 172.21.15.2:0/1972366337 shutdown_connections 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.244+0000 7fb879400640 1 --2- 172.21.15.2:0/1972366337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb87413fcc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.245+0000 7fb879400640 1 --2- 172.21.15.2:0/1972366337 >> v2:172.21.15.26:3300/0 conn(0x7fb874156f90 0x7fb8740cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.245+0000 7fb879400640 1 --2- 172.21.15.2:0/1972366337 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb8740b0e30 0x7fb8740b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.245+0000 7fb879400640 1 -- 172.21.15.2:0/1972366337 >> 172.21.15.2:0/1972366337 conn(0x7fb874062af0 msgr2=0x7fb874062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:48.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.245+0000 7fb879400640 1 -- 172.21.15.2:0/1972366337 shutdown_connections 2024-08-17T02:46:48.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.245+0000 7fb879400640 1 -- 172.21.15.2:0/1972366337 wait complete. 2024-08-17T02:46:48.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.246+0000 7fb879400640 1 Processor -- start 2024-08-17T02:46:48.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.246+0000 7fb879400640 1 -- start start 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb879400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8740b0e30 0x7fb874158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb879400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb874156f90 0x7fb87413cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb879400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb874154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb879400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb874159db0 con 0x7fb87415a590 2024-08-17T02:46:48.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb879400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb874154570 con 0x7fb8740b0e30 2024-08-17T02:46:48.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb879400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741591a0 con 0x7fb874156f90 2024-08-17T02:46:48.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb878a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb874154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb878a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb874154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33546/0 (socket says 172.21.15.2:33546) 2024-08-17T02:46:48.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb878a00640 1 -- 172.21.15.2:0/2719326840 learned_addr learned my addr 172.21.15.2:0/2719326840 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:48.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb873e00640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8740b0e30 0x7fb874158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.247+0000 7fb873400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb874156f90 0x7fb87413cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb878a00640 1 -- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb874156f90 msgr2=0x7fb87413cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb878a00640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb874156f90 0x7fb87413cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb878a00640 1 -- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8740b0e30 msgr2=0x7fb874158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb878a00640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8740b0e30 0x7fb874158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb878a00640 1 -- 172.21.15.2:0/2719326840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009ae0 con 0x7fb87415a590 2024-08-17T02:46:48.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb873400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb874156f90 0x7fb87413cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:48.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb878a00640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb874154030 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009f20 tx=0x7fb86c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb86b400640 1 -- 172.21.15.2:0/2719326840 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c007170 con 0x7fb87415a590 2024-08-17T02:46:48.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb86b400640 1 -- 172.21.15.2:0/2719326840 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c008e80 con 0x7fb87415a590 2024-08-17T02:46:48.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb86b400640 1 -- 172.21.15.2:0/2719326840 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c03b640 con 0x7fb87415a590 2024-08-17T02:46:48.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb874159480 con 0x7fb87415a590 2024-08-17T02:46:48.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.248+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb874159a40 con 0x7fb87415a590 2024-08-17T02:46:48.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.249+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb874159f60 con 0x7fb87415a590 2024-08-17T02:46:48.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.250+0000 7fb86b400640 1 -- 172.21.15.2:0/2719326840 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb86c038050 con 0x7fb87415a590 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.251+0000 7fb86b400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb854065150 0x7fb854067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.251+0000 7fb86b400640 1 -- 172.21.15.2:0/2719326840 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb86c0a2980 con 0x7fb87415a590 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.251+0000 7fb873e00640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb854065150 0x7fb854067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.252+0000 7fb873e00640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb854065150 0x7fb854067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb864009d20 tx=0x7fb8640090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.255+0000 7fb86b400640 1 -- 172.21.15.2:0/2719326840 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb874159f60 con 0x7fb87415a590 2024-08-17T02:46:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.473+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb874159f60 con 0x7fb87415a590 2024-08-17T02:46:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.473+0000 7fb86b400640 1 -- 172.21.15.2:0/2719326840 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fb874159f60 con 0x7fb87415a590 2024-08-17T02:46:48.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:48.475 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:13.176093+0000","modified":"2024-08-17T02:46:16.759354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:48.475 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-08-17T02:46:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb854065150 msgr2=0x7fb854067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb854065150 0x7fb854067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb864009d20 tx=0x7fb8640090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 msgr2=0x7fb874154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb874154030 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009f20 tx=0x7fb86c036000 comp rx=0 tx=0).stop 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 shutdown_connections 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87415a590 0x7fb874154030 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb854065150 0x7fb854067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb874156f90 0x7fb87413cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 --2- 172.21.15.2:0/2719326840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8740b0e30 0x7fb874158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.475+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 >> 172.21.15.2:0/2719326840 conn(0x7fb874062af0 msgr2=0x7fb8740c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.476+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 shutdown_connections 2024-08-17T02:46:48.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.476+0000 7fb879400640 1 -- 172.21.15.2:0/2719326840 wait complete. 2024-08-17T02:46:48.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.642+0000 7f6969800640 1 Processor -- start 2024-08-17T02:46:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.642+0000 7f6969800640 1 -- start start 2024-08-17T02:46:48.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.643+0000 7f6969800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69640afca0 0x7f69640b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.643+0000 7f6969800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640c92b0 con 0x7f69641590b0 2024-08-17T02:46:48.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6969800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640ad480 con 0x7f69640acf10 2024-08-17T02:46:48.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6969800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640b0980 con 0x7f69640afca0 2024-08-17T02:46:48.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6963400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f69641590b0 0x7f69640c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43000/0 (socket says 172.21.15.2:43000) 2024-08-17T02:46:48.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6963400640 1 -- 172.21.15.2:0/3030849607 learned_addr learned my addr 172.21.15.2:0/3030849607 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6962a00640 1 --2- 172.21.15.2:0/3030849607 >> v2:172.21.15.26:3300/0 conn(0x7f69640afca0 0x7f69640b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6961600640 1 -- 172.21.15.2:0/3030849607 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322577591 0 0) 0x7f69640c92b0 con 0x7f69641590b0 2024-08-17T02:46:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6961600640 1 -- 172.21.15.2:0/3030849607 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69480034e0 con 0x7f69641590b0 2024-08-17T02:46:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6961600640 1 -- 172.21.15.2:0/3030849607 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442284400 0 0) 0x7f69640ad480 con 0x7f69640acf10 2024-08-17T02:46:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.644+0000 7f6961600640 1 -- 172.21.15.2:0/3030849607 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69640c92b0 con 0x7f69640acf10 2024-08-17T02:46:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.645+0000 7f6962a00640 1 -- 172.21.15.2:0/3030849607 >> v1:172.21.15.26:6789/0 conn(0x7f69640acf10 legacy=0x7f69641589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.645+0000 7f6961600640 1 -- 172.21.15.2:0/3030849607 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340902484 0 0) 0x7f69480034e0 con 0x7f69641590b0 2024-08-17T02:46:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.645+0000 7f6962a00640 1 -- 172.21.15.2:0/3030849607 >> v1:172.21.15.2:6789/0 conn(0x7f69641590b0 legacy=0x7f69640c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.645+0000 7f6962a00640 1 -- 172.21.15.2:0/3030849607 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640ad760 con 0x7f69640afca0 2024-08-17T02:46:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6962a00640 1 --2- 172.21.15.2:0/3030849607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 0x7f69640b0070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6954009850 tx=0x7f69540090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d435c73f5c848105 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6961600640 1 -- 172.21.15.2:0/3030849607 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0017f0 con 0x7f69640afca0 2024-08-17T02:46:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6961600640 1 -- 172.21.15.2:0/3030849607 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695402ab00 con 0x7f69640afca0 2024-08-17T02:46:48.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6961600640 1 -- 172.21.15.2:0/3030849607 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695402ae80 con 0x7f69640afca0 2024-08-17T02:46:48.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6969800640 1 -- 172.21.15.2:0/3030849607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 msgr2=0x7f69640b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6969800640 1 --2- 172.21.15.2:0/3030849607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 0x7f69640b0070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6954009850 tx=0x7f69540090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6969800640 1 -- 172.21.15.2:0/3030849607 shutdown_connections 2024-08-17T02:46:48.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6969800640 1 --2- 172.21.15.2:0/3030849607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 0x7f69640b0070 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.646+0000 7f6969800640 1 -- 172.21.15.2:0/3030849607 >> 172.21.15.2:0/3030849607 conn(0x7f6964066e60 msgr2=0x7f6964067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:48.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.647+0000 7f6969800640 1 -- 172.21.15.2:0/3030849607 shutdown_connections 2024-08-17T02:46:48.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.647+0000 7f6969800640 1 -- 172.21.15.2:0/3030849607 wait complete. 2024-08-17T02:46:48.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.648+0000 7f6969800640 1 Processor -- start 2024-08-17T02:46:48.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.648+0000 7f6969800640 1 -- start start 2024-08-17T02:46:48.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6969800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69640acf10 0x7f69640c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6969800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 0x7f69640a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6969800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69641590b0 0x7f69640a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6969800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640c5d70 con 0x7f69640acf10 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6969800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640c6bb0 con 0x7f69640afca0 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6969800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640c5fa0 con 0x7f69641590b0 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6962a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69640acf10 0x7f69640c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6962a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69640acf10 0x7f69640c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33556/0 (socket says 172.21.15.2:33556) 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6962a00640 1 -- 172.21.15.2:0/1143937866 learned_addr learned my addr 172.21.15.2:0/1143937866 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6962000640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 0x7f69640a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.649+0000 7f6963400640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69641590b0 0x7f69640a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f6962a00640 1 -- 172.21.15.2:0/1143937866 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69641590b0 msgr2=0x7f69640a95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f6962a00640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69641590b0 0x7f69640a95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f6962a00640 1 -- 172.21.15.2:0/1143937866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 msgr2=0x7f69640a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f6962a00640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 0x7f69640a9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f6962a00640 1 -- 172.21.15.2:0/1143937866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954009390 con 0x7f69640acf10 2024-08-17T02:46:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f6962a00640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69640acf10 0x7f69640c7040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6954009360 tx=0x7f6954032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f695a000640 1 -- 172.21.15.2:0/1143937866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695403c6f0 con 0x7f69640acf10 2024-08-17T02:46:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f695a000640 1 -- 172.21.15.2:0/1143937866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695403c850 con 0x7f69640acf10 2024-08-17T02:46:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f695a000640 1 -- 172.21.15.2:0/1143937866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695403cbd0 con 0x7f69640acf10 2024-08-17T02:46:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69640c6280 con 0x7f69640acf10 2024-08-17T02:46:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.650+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69640c6840 con 0x7f69640acf10 2024-08-17T02:46:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.651+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6964063fb0 con 0x7f69640acf10 2024-08-17T02:46:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.652+0000 7f695a000640 1 -- 172.21.15.2:0/1143937866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6954039050 con 0x7f69640acf10 2024-08-17T02:46:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.653+0000 7f695a000640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6944065150 0x7f6944067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.653+0000 7f695a000640 1 -- 172.21.15.2:0/1143937866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69540a2a50 con 0x7f69640acf10 2024-08-17T02:46:48.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.653+0000 7f6962000640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6944065150 0x7f6944067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:48.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.654+0000 7f6962000640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6944065150 0x7f6944067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f69640ac3b0 tx=0x7f6950007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.657+0000 7f695a000640 1 -- 172.21.15.2:0/1143937866 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6954070b20 con 0x7f69640acf10 2024-08-17T02:46:48.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.840+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6964067b70 con 0x7f69640acf10 2024-08-17T02:46:48.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.841+0000 7f695a000640 1 -- 172.21.15.2:0/1143937866 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f6954037090 con 0x7f69640acf10 2024-08-17T02:46:48.843 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6944065150 msgr2=0x7f6944067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6944065150 0x7f6944067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f69640ac3b0 tx=0x7f6950007ca0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69640acf10 msgr2=0x7f69640c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69640acf10 0x7f69640c7040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6954009360 tx=0x7f6954032000 comp rx=0 tx=0).stop 2024-08-17T02:46:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 shutdown_connections 2024-08-17T02:46:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6944065150 0x7f6944067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69641590b0 0x7f69640a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69640afca0 0x7f69640a9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 --2- 172.21.15.2:0/1143937866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69640acf10 0x7f69640c7040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:48.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 >> 172.21.15.2:0/1143937866 conn(0x7f6964066e60 msgr2=0x7f69640ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:48.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 shutdown_connections 2024-08-17T02:46:48.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:48.844+0000 7f6969800640 1 -- 172.21.15.2:0/1143937866 wait complete. 2024-08-17T02:46:48.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:46:10.965028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:46:12.163837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:46:48.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:46:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.014+0000 7f05e6a00640 1 Processor -- start 2024-08-17T02:46:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.015+0000 7f05e6a00640 1 -- start start 2024-08-17T02:46:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05e6a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05e015c010 0x7f05e015d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05e6a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f05e015c3e0 0x7f05e006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05e6a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e006b710 0x7f05e00ac480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05e6a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e006ad40 con 0x7f05e015c010 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05e6a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e0069e50 con 0x7f05e015c3e0 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05e6a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e006a130 con 0x7f05e006b710 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05dfe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05e015c010 0x7f05e015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05dfe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05e015c010 0x7f05e015d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33566/0 (socket says 172.21.15.2:33566) 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05dfe00640 1 -- 172.21.15.2:0/2754322354 learned_addr learned my addr 172.21.15.2:0/2754322354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.017+0000 7f05d7e00640 1 --2- 172.21.15.2:0/2754322354 >> v2:172.21.15.26:3300/0 conn(0x7f05e015c3e0 0x7f05e006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.016+0000 7f05e4a00640 1 --2- 172.21.15.2:0/2754322354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e006b710 0x7f05e00ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.017+0000 7f05dfe00640 1 -- 172.21.15.2:0/2754322354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e006b710 msgr2=0x7f05e00ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.017+0000 7f05dfe00640 1 --2- 172.21.15.2:0/2754322354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e006b710 0x7f05e00ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.017+0000 7f05dfe00640 1 -- 172.21.15.2:0/2754322354 >> v2:172.21.15.26:3300/0 conn(0x7f05e015c3e0 msgr2=0x7f05e006b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.017+0000 7f05dfe00640 1 --2- 172.21.15.2:0/2754322354 >> v2:172.21.15.26:3300/0 conn(0x7f05e015c3e0 0x7f05e006b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.017+0000 7f05dfe00640 1 -- 172.21.15.2:0/2754322354 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e006a410 con 0x7f05e015c010 2024-08-17T02:46:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.018+0000 7f05dfe00640 1 --2- 172.21.15.2:0/2754322354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c010 0x7f05e015d250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05e006d1b0 tx=0x7f05d00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4de4db78a0b2ada server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.018+0000 7f05df400640 1 -- 172.21.15.2:0/2754322354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d002add0 con 0x7f05e015c010 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.018+0000 7f05df400640 1 -- 172.21.15.2:0/2754322354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0032440 con 0x7f05e015c010 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.018+0000 7f05df400640 1 -- 172.21.15.2:0/2754322354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0032820 con 0x7f05e015c010 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 -- 172.21.15.2:0/2754322354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c010 msgr2=0x7f05e015d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2754322354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c010 0x7f05e015d250 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05e006d1b0 tx=0x7f05d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 -- 172.21.15.2:0/2754322354 shutdown_connections 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2754322354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e006b710 0x7f05e00ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2754322354 >> v2:172.21.15.26:3300/0 conn(0x7f05e015c3e0 0x7f05e006b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2754322354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c010 0x7f05e015d250 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 -- 172.21.15.2:0/2754322354 >> 172.21.15.2:0/2754322354 conn(0x7f05e006dda0 msgr2=0x7f05e00b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 -- 172.21.15.2:0/2754322354 shutdown_connections 2024-08-17T02:46:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.019+0000 7f05e6a00640 1 -- 172.21.15.2:0/2754322354 wait complete. 2024-08-17T02:46:49.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.020+0000 7f05e6a00640 1 Processor -- start 2024-08-17T02:46:49.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.020+0000 7f05e6a00640 1 -- start start 2024-08-17T02:46:49.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.021+0000 7f05e6a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05e006b710 0x7f05e015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.021+0000 7f05e6a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e015c010 0x7f05e0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.021+0000 7f05e6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c3e0 0x7f05e014a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.021+0000 7f05e6a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e015b160 con 0x7f05e015c3e0 2024-08-17T02:46:49.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.021+0000 7f05e6a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e01560d0 con 0x7f05e006b710 2024-08-17T02:46:49.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.021+0000 7f05e6a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00c1c90 con 0x7f05e015c010 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05e4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c3e0 0x7f05e014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05dfe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05e006b710 0x7f05e015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05dfe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05e006b710 0x7f05e015ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:52684/0 (socket says 172.21.15.2:52684) 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05dfe00640 1 -- 172.21.15.2:0/2340662578 learned_addr learned my addr 172.21.15.2:0/2340662578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05e4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c3e0 0x7f05e014a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33568/0 (socket says 172.21.15.2:33568) 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05d7e00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e015c010 0x7f05e0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05e4a00640 1 -- 172.21.15.2:0/2340662578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e015c010 msgr2=0x7f05e0159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05e4a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e015c010 0x7f05e0159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05e4a00640 1 -- 172.21.15.2:0/2340662578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05e006b710 msgr2=0x7f05e015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05e4a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05e006b710 0x7f05e015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05e4a00640 1 -- 172.21.15.2:0/2340662578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0009450 con 0x7f05e015c3e0 2024-08-17T02:46:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05dfe00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05e006b710 0x7f05e015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:49.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05e4a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c3e0 0x7f05e014a500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f05d8007ed0 tx=0x7f05d8009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.022+0000 7f05d7400640 1 -- 172.21.15.2:0/2340662578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8018070 con 0x7f05e015c3e0 2024-08-17T02:46:49.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.023+0000 7f05d7400640 1 -- 172.21.15.2:0/2340662578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d800ee30 con 0x7f05e015c3e0 2024-08-17T02:46:49.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.023+0000 7f05d7400640 1 -- 172.21.15.2:0/2340662578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8014650 con 0x7f05e015c3e0 2024-08-17T02:46:49.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.023+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e0158eb0 con 0x7f05e015c3e0 2024-08-17T02:46:49.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.023+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e01594f0 con 0x7f05e015c3e0 2024-08-17T02:46:49.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.024+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e0063fb0 con 0x7f05e015c3e0 2024-08-17T02:46:49.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.024+0000 7f05d7400640 1 -- 172.21.15.2:0/2340662578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f05d8003020 con 0x7f05e015c3e0 2024-08-17T02:46:49.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.025+0000 7f05d7400640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f05bc065150 0x7f05bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.025+0000 7f05d7400640 1 -- 172.21.15.2:0/2340662578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05d80825f0 con 0x7f05e015c3e0 2024-08-17T02:46:49.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.025+0000 7f05dfe00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f05bc065150 0x7f05bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.026+0000 7f05dfe00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f05bc065150 0x7f05bc067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009420 tx=0x7f05d0032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.030+0000 7f05d7400640 1 -- 172.21.15.2:0/2340662578 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f05d80506c0 con 0x7f05e015c3e0 2024-08-17T02:46:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.215+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05e00b13c0 con 0x7f05e015c3e0 2024-08-17T02:46:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.215+0000 7f05d7400640 1 -- 172.21.15.2:0/2340662578 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05d8001250 con 0x7f05e015c3e0 2024-08-17T02:46:49.217 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.217+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f05bc065150 msgr2=0x7f05bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.217+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f05bc065150 0x7f05bc067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009420 tx=0x7f05d0032000 comp rx=0 tx=0).stop 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.217+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c3e0 msgr2=0x7f05e014a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.217+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c3e0 0x7f05e014a500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f05d8007ed0 tx=0x7f05d8009850 comp rx=0 tx=0).stop 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.217+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 shutdown_connections 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.217+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05e015c3e0 0x7f05e014a500 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.217+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f05bc065150 0x7f05bc067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.217+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f05e015c010 0x7f05e0159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.218+0000 7f05e6a00640 1 --2- 172.21.15.2:0/2340662578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05e006b710 0x7f05e015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.218+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 >> 172.21.15.2:0/2340662578 conn(0x7f05e006dda0 msgr2=0x7f05e0156600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.218+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 shutdown_connections 2024-08-17T02:46:49.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.218+0000 7f05e6a00640 1 -- 172.21.15.2:0/2340662578 wait complete. 2024-08-17T02:46:49.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:46:49.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.387+0000 7f484ec00640 1 Processor -- start 2024-08-17T02:46:49.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.387+0000 7f484ec00640 1 -- start start 2024-08-17T02:46:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.388+0000 7f484ec00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f48481590b0 0x7f48480b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.388+0000 7f484ec00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48480c92b0 con 0x7f48480acf10 2024-08-17T02:46:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.388+0000 7f484ec00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48480ad480 con 0x7f48480afca0 2024-08-17T02:46:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.388+0000 7f484ec00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48480b0980 con 0x7f48481590b0 2024-08-17T02:46:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.389+0000 7f484cc00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f48480acf10 0x7f48480c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43004/0 (socket says 172.21.15.2:43004) 2024-08-17T02:46:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.389+0000 7f484cc00640 1 -- 172.21.15.2:0/4024805677 learned_addr learned my addr 172.21.15.2:0/4024805677 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.389+0000 7f4847400640 1 --2- 172.21.15.2:0/4024805677 >> v2:172.21.15.2:3300/0 conn(0x7f48481590b0 0x7f48480b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.389+0000 7f4847400640 1 -- 172.21.15.2:0/4024805677 >> v1:172.21.15.26:6789/0 conn(0x7f48480afca0 legacy=0x7f48481589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.389+0000 7f4847400640 1 -- 172.21.15.2:0/4024805677 >> v1:172.21.15.2:6789/0 conn(0x7f48480acf10 legacy=0x7f48480c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.389+0000 7f4847400640 1 -- 172.21.15.2:0/4024805677 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48480ad760 con 0x7f48481590b0 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.390+0000 7f4847400640 1 --2- 172.21.15.2:0/4024805677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48481590b0 0x7f48480b0070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4834009850 tx=0x7f48340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2d3a6369f78fa8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.390+0000 7f4846a00640 1 -- 172.21.15.2:0/4024805677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483402ae20 con 0x7f48481590b0 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.390+0000 7f4846a00640 1 -- 172.21.15.2:0/4024805677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4834032440 con 0x7f48481590b0 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.390+0000 7f4846a00640 1 -- 172.21.15.2:0/4024805677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834032820 con 0x7f48481590b0 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.391+0000 7f484ec00640 1 -- 172.21.15.2:0/4024805677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48481590b0 msgr2=0x7f48480b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.391+0000 7f484ec00640 1 --2- 172.21.15.2:0/4024805677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48481590b0 0x7f48480b0070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4834009850 tx=0x7f48340090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.391+0000 7f484ec00640 1 -- 172.21.15.2:0/4024805677 shutdown_connections 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.391+0000 7f484ec00640 1 --2- 172.21.15.2:0/4024805677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48481590b0 0x7f48480b0070 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.391+0000 7f484ec00640 1 -- 172.21.15.2:0/4024805677 >> 172.21.15.2:0/4024805677 conn(0x7f4848066e60 msgr2=0x7f4848067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.391+0000 7f484ec00640 1 -- 172.21.15.2:0/4024805677 shutdown_connections 2024-08-17T02:46:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.391+0000 7f484ec00640 1 -- 172.21.15.2:0/4024805677 wait complete. 2024-08-17T02:46:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.392+0000 7f484ec00640 1 Processor -- start 2024-08-17T02:46:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.393+0000 7f484ec00640 1 -- start start 2024-08-17T02:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.393+0000 7f484ec00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48480acf10 0x7f4848169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.393+0000 7f484ec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48480afca0 0x7f48481560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.393+0000 7f484ec00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48481590b0 0x7f484815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.393+0000 7f484ec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48480a4a70 con 0x7f48480afca0 2024-08-17T02:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f484ec00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848155d40 con 0x7f48481590b0 2024-08-17T02:46:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f484ec00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484816a320 con 0x7f48480acf10 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48480afca0 0x7f48481560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48480afca0 0x7f48481560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33584/0 (socket says 172.21.15.2:33584) 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847400640 1 -- 172.21.15.2:0/113272429 learned_addr learned my addr 172.21.15.2:0/113272429 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847e00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48480acf10 0x7f4848169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f484cc00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48481590b0 0x7f484815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847400640 1 -- 172.21.15.2:0/113272429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48480acf10 msgr2=0x7f4848169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847400640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48480acf10 0x7f4848169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847400640 1 -- 172.21.15.2:0/113272429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48481590b0 msgr2=0x7f484815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847400640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48481590b0 0x7f484815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.394+0000 7f4847400640 1 -- 172.21.15.2:0/113272429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834009390 con 0x7f48480afca0 2024-08-17T02:46:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.395+0000 7f4847400640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48480afca0 0x7f48481560d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4834035040 tx=0x7f4834032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.395+0000 7f483f400640 1 -- 172.21.15.2:0/113272429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834031e00 con 0x7f48480afca0 2024-08-17T02:46:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.395+0000 7f483f400640 1 -- 172.21.15.2:0/113272429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483403e450 con 0x7f48480afca0 2024-08-17T02:46:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.395+0000 7f483f400640 1 -- 172.21.15.2:0/113272429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483403e810 con 0x7f48480afca0 2024-08-17T02:46:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.395+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484816cac0 con 0x7f48480afca0 2024-08-17T02:46:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.395+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484815bc80 con 0x7f48480afca0 2024-08-17T02:46:49.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.396+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484816cc50 con 0x7f48480afca0 2024-08-17T02:46:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.397+0000 7f483f400640 1 -- 172.21.15.2:0/113272429 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f483403c400 con 0x7f48480afca0 2024-08-17T02:46:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.398+0000 7f483f400640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4828065150 0x7f4828067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.398+0000 7f483f400640 1 -- 172.21.15.2:0/113272429 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48340a2a50 con 0x7f48480afca0 2024-08-17T02:46:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.398+0000 7f4847e00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4828065150 0x7f4828067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.399+0000 7f4847e00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4828065150 0x7f4828067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f48480acd00 tx=0x7f4838009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.402+0000 7f483f400640 1 -- 172.21.15.2:0/113272429 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4834070b20 con 0x7f48480afca0 2024-08-17T02:46:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.583+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4848063fb0 con 0x7f48480afca0 2024-08-17T02:46:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.584+0000 7f483f400640 1 -- 172.21.15.2:0/113272429 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4834037020 con 0x7f48480afca0 2024-08-17T02:46:49.585 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:46:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4828065150 msgr2=0x7f4828067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4828065150 0x7f4828067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f48480acd00 tx=0x7f4838009040 comp rx=0 tx=0).stop 2024-08-17T02:46:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48480afca0 msgr2=0x7f48481560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48480afca0 0x7f48481560d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4834035040 tx=0x7f4834032000 comp rx=0 tx=0).stop 2024-08-17T02:46:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 shutdown_connections 2024-08-17T02:46:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48481590b0 0x7f484815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48480afca0 0x7f48481560d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4828065150 0x7f4828067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 --2- 172.21.15.2:0/113272429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f48480acf10 0x7f4848169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 >> 172.21.15.2:0/113272429 conn(0x7f4848066e60 msgr2=0x7f48480cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 shutdown_connections 2024-08-17T02:46:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.586+0000 7f484ec00640 1 -- 172.21.15.2:0/113272429 wait complete. 2024-08-17T02:46:49.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:46:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.755+0000 7f03c5800640 1 Processor -- start 2024-08-17T02:46:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.755+0000 7f03c5800640 1 -- start start 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03c5800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0158b90 0x7f03c00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03c5800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f03c00b2370 0x7f03c00aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03c5800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03c00aef60 0x7f03c0068630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03c5800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00af380 con 0x7f03c00b2370 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03c5800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00afd20 con 0x7f03c00aef60 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03c5800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00affe0 con 0x7f03c0158b90 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03be000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f03c00b2370 0x7f03c00aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03be000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f03c00b2370 0x7f03c00aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33598/0 (socket says 172.21.15.2:33598) 2024-08-17T02:46:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.756+0000 7f03be000640 1 -- 172.21.15.2:0/2358219384 learned_addr learned my addr 172.21.15.2:0/2358219384 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.757+0000 7f03bf400640 1 --2- 172.21.15.2:0/2358219384 >> v2:172.21.15.26:3300/0 conn(0x7f03c00aef60 0x7f03c0068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.757+0000 7f03bea00640 1 --2- 172.21.15.2:0/2358219384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0158b90 0x7f03c00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.757+0000 7f03be000640 1 -- 172.21.15.2:0/2358219384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0158b90 msgr2=0x7f03c00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.757+0000 7f03be000640 1 --2- 172.21.15.2:0/2358219384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0158b90 0x7f03c00b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.757+0000 7f03be000640 1 -- 172.21.15.2:0/2358219384 >> v2:172.21.15.26:3300/0 conn(0x7f03c00aef60 msgr2=0x7f03c0068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.757+0000 7f03be000640 1 --2- 172.21.15.2:0/2358219384 >> v2:172.21.15.26:3300/0 conn(0x7f03c00aef60 0x7f03c0068630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.757+0000 7f03be000640 1 -- 172.21.15.2:0/2358219384 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00b02c0 con 0x7f03c00b2370 2024-08-17T02:46:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.757+0000 7f03bf400640 1 --2- 172.21.15.2:0/2358219384 >> v2:172.21.15.26:3300/0 conn(0x7f03c00aef60 0x7f03c0068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.758+0000 7f03be000640 1 --2- 172.21.15.2:0/2358219384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c00aea20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f03c00cc310 tx=0x7f03ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f37b21e6640702c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.758+0000 7f03bd600640 1 -- 172.21.15.2:0/2358219384 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac02add0 con 0x7f03c00b2370 2024-08-17T02:46:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.758+0000 7f03bd600640 1 -- 172.21.15.2:0/2358219384 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac032440 con 0x7f03c00b2370 2024-08-17T02:46:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.758+0000 7f03bd600640 1 -- 172.21.15.2:0/2358219384 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac032820 con 0x7f03c00b2370 2024-08-17T02:46:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 -- 172.21.15.2:0/2358219384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 msgr2=0x7f03c00aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 --2- 172.21.15.2:0/2358219384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c00aea20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f03c00cc310 tx=0x7f03ac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 -- 172.21.15.2:0/2358219384 shutdown_connections 2024-08-17T02:46:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 --2- 172.21.15.2:0/2358219384 >> v2:172.21.15.26:3300/0 conn(0x7f03c00aef60 0x7f03c0068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 --2- 172.21.15.2:0/2358219384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c00aea20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 --2- 172.21.15.2:0/2358219384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c0158b90 0x7f03c00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 -- 172.21.15.2:0/2358219384 >> 172.21.15.2:0/2358219384 conn(0x7f03c006e590 msgr2=0x7f03c006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 -- 172.21.15.2:0/2358219384 shutdown_connections 2024-08-17T02:46:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.759+0000 7f03c5800640 1 -- 172.21.15.2:0/2358219384 wait complete. 2024-08-17T02:46:49.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.760+0000 7f03c5800640 1 Processor -- start 2024-08-17T02:46:49.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.760+0000 7f03c5800640 1 -- start start 2024-08-17T02:46:49.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03c5800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c00aef60 0x7f03c00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03c5800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03c5800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0158b90 0x7f03c015bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03c5800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0159870 con 0x7f03c00b2370 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03c5800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0158f60 con 0x7f03c0158b90 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03c5800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00c8b50 con 0x7f03c00aef60 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03be000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03be000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33602/0 (socket says 172.21.15.2:33602) 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.761+0000 7f03be000640 1 -- 172.21.15.2:0/2357582891 learned_addr learned my addr 172.21.15.2:0/2357582891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03bea00640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c00aef60 0x7f03c00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03bf400640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0158b90 0x7f03c015bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03be000640 1 -- 172.21.15.2:0/2357582891 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c00aef60 msgr2=0x7f03c00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03be000640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c00aef60 0x7f03c00c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03be000640 1 -- 172.21.15.2:0/2357582891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0158b90 msgr2=0x7f03c015bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03be000640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0158b90 0x7f03c015bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03be000640 1 -- 172.21.15.2:0/2357582891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac009450 con 0x7f03c00b2370 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03be000640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c015b6a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009210 tx=0x7f03ac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03b6000640 1 -- 172.21.15.2:0/2357582891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac000d10 con 0x7f03c00b2370 2024-08-17T02:46:49.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03b6000640 1 -- 172.21.15.2:0/2357582891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac031a40 con 0x7f03c00b2370 2024-08-17T02:46:49.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03b6000640 1 -- 172.21.15.2:0/2357582891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac031e00 con 0x7f03c00b2370 2024-08-17T02:46:49.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.762+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c0159220 con 0x7f03c00b2370 2024-08-17T02:46:49.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.763+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c00c6690 con 0x7f03c00b2370 2024-08-17T02:46:49.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.763+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0063fb0 con 0x7f03c00b2370 2024-08-17T02:46:49.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.764+0000 7f03b6000640 1 -- 172.21.15.2:0/2357582891 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f03ac039040 con 0x7f03c00b2370 2024-08-17T02:46:49.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.765+0000 7f03b6000640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03a0065150 0x7f03a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:49.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.765+0000 7f03b6000640 1 -- 172.21.15.2:0/2357582891 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03ac0a21c0 con 0x7f03c00b2370 2024-08-17T02:46:49.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.765+0000 7f03bea00640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03a0065150 0x7f03a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:49.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.766+0000 7f03bea00640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03a0065150 0x7f03a0067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f03b000bb40 tx=0x7f03b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:49.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.769+0000 7f03b6000640 1 -- 172.21.15.2:0/2357582891 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f03ac0701e0 con 0x7f03c00b2370 2024-08-17T02:46:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.950+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03c00b4900 con 0x7f03c00b2370 2024-08-17T02:46:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.951+0000 7f03b6000640 1 -- 172.21.15.2:0/2357582891 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03ac073800 con 0x7f03c00b2370 2024-08-17T02:46:49.952 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:46:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03a0065150 msgr2=0x7f03a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03a0065150 0x7f03a0067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f03b000bb40 tx=0x7f03b0008040 comp rx=0 tx=0).stop 2024-08-17T02:46:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 msgr2=0x7f03c015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c015b6a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009210 tx=0x7f03ac032000 comp rx=0 tx=0).stop 2024-08-17T02:46:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 shutdown_connections 2024-08-17T02:46:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03c0158b90 0x7f03c015bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03c00b2370 0x7f03c015b6a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03a0065150 0x7f03a0067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 --2- 172.21.15.2:0/2357582891 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03c00aef60 0x7f03c00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 >> 172.21.15.2:0/2357582891 conn(0x7f03c006e590 msgr2=0x7f03c00b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 shutdown_connections 2024-08-17T02:46:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:49.953+0000 7f03c5800640 1 -- 172.21.15.2:0/2357582891 wait complete. 2024-08-17T02:46:49.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.120+0000 7f6bfdc00640 1 Processor -- start 2024-08-17T02:46:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.120+0000 7f6bfdc00640 1 -- start start 2024-08-17T02:46:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6bfdc00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bf81590b0 0x7f6bf80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6bfdc00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf80c92b0 con 0x7f6bf80afca0 2024-08-17T02:46:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6bfdc00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf80ad480 con 0x7f6bf80acf10 2024-08-17T02:46:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6bfdc00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf80b0980 con 0x7f6bf81590b0 2024-08-17T02:46:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6bf6a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6bf80afca0 0x7f6bf81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43010/0 (socket says 172.21.15.2:43010) 2024-08-17T02:46:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6bf6a00640 1 -- 172.21.15.2:0/2317286151 learned_addr learned my addr 172.21.15.2:0/2317286151 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576200966 0 0) 0x7f6bf80c92b0 con 0x7f6bf80afca0 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6befe00640 1 --2- 172.21.15.2:0/2317286151 >> v2:172.21.15.26:3300/0 conn(0x7f6bf81590b0 0x7f6bf80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.122+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bdc0034e0 con 0x7f6bf80afca0 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2273358074 0 0) 0x7f6bdc0034e0 con 0x7f6bf80afca0 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 >> v2:172.21.15.26:3300/0 conn(0x7f6bf81590b0 msgr2=0x7f6bf80b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 --2- 172.21.15.2:0/2317286151 >> v2:172.21.15.26:3300/0 conn(0x7f6bf81590b0 0x7f6bf80b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 >> v1:172.21.15.26:6789/0 conn(0x7f6bf80acf10 legacy=0x7f6bf80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf80ad760 con 0x7f6bf80afca0 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f6be8001470 con 0x7f6bf80afca0 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 >> v1:172.21.15.2:6789/0 conn(0x7f6bf80afca0 legacy=0x7f6bf81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bdc003a20 0x7f6bdc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bdc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bdc005180 0x7f6bdc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc00c0a0 con 0x7f6bdc004780 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc00c1e0 con 0x7f6bdc003a20 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc00c3a0 con 0x7f6bdc005180 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6befe00640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bdc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf6a00640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bdc003a20 0x7f6bdc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6bf7400640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bdc005180 0x7f6bdc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6befe00640 1 -- 172.21.15.2:0/2317286151 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bdc005180 msgr2=0x7f6bdc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6befe00640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bdc005180 0x7f6bdc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6befe00640 1 -- 172.21.15.2:0/2317286151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bdc003a20 msgr2=0x7f6bdc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6befe00640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bdc003a20 0x7f6bdc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.123+0000 7f6befe00640 1 -- 172.21.15.2:0/2317286151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0034e0 con 0x7f6bdc004780 2024-08-17T02:46:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.124+0000 7f6bf7400640 1 -- 172.21.15.2:0/2317286151 reap_dead start 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.124+0000 7f6befe00640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bdc004bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6bf81594f0 tx=0x7f6be00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a0689e9fe9bf5d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0031400 con 0x7f6bdc004780 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be002d050 con 0x7f6bdc004780 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bf6000640 1 -- 172.21.15.2:0/2317286151 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0031790 con 0x7f6bdc004780 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2317286151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 msgr2=0x7f6bdc004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bfdc00640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bdc004bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6bf81594f0 tx=0x7f6be00090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2317286151 shutdown_connections 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bfdc00640 1 --2- 172.21.15.2:0/2317286151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bdc004bf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2317286151 >> 172.21.15.2:0/2317286151 conn(0x7f6bf8066e60 msgr2=0x7f6bf8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2317286151 shutdown_connections 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.125+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2317286151 wait complete. 2024-08-17T02:46:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.127+0000 7f6bfdc00640 1 Processor -- start 2024-08-17T02:46:50.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.127+0000 7f6bfdc00640 1 -- start start 2024-08-17T02:46:50.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bfdc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bf814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bfdc00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bf80c7810 0x7f6bf815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bfdc00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf815bd70 0x7f6bf814bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bfdc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf814ddf0 con 0x7f6bdc004780 2024-08-17T02:46:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bfdc00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf814ff10 con 0x7f6bf815bd70 2024-08-17T02:46:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bfdc00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf81501f0 con 0x7f6bf80c7810 2024-08-17T02:46:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bf814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bf814d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33614/0 (socket says 172.21.15.2:33614) 2024-08-17T02:46:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf6a00640 1 -- 172.21.15.2:0/2600197871 learned_addr learned my addr 172.21.15.2:0/2600197871 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6befe00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bf80c7810 0x7f6bf815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf7400640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf815bd70 0x7f6bf814bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf6a00640 1 -- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bf80c7810 msgr2=0x7f6bf815b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf6a00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bf80c7810 0x7f6bf815b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf6a00640 1 -- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf815bd70 msgr2=0x7f6bf814bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf6a00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf815bd70 0x7f6bf814bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6bf6a00640 1 -- 172.21.15.2:0/2600197871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf81504d0 con 0x7f6bdc004780 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.128+0000 7f6befe00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bf80c7810 0x7f6bf815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.129+0000 7f6bf6a00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bf814d420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6be8004b00 tx=0x7f6bf80ad370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.129+0000 7f6bee000640 1 -- 172.21.15.2:0/2600197871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8018030 con 0x7f6bdc004780 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.129+0000 7f6bee000640 1 -- 172.21.15.2:0/2600197871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be800f9c0 con 0x7f6bdc004780 2024-08-17T02:46:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.129+0000 7f6bee000640 1 -- 172.21.15.2:0/2600197871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800fd60 con 0x7f6bdc004780 2024-08-17T02:46:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.129+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf81507b0 con 0x7f6bdc004780 2024-08-17T02:46:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.129+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf8167410 con 0x7f6bdc004780 2024-08-17T02:46:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.130+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf814df60 con 0x7f6bdc004780 2024-08-17T02:46:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.131+0000 7f6bee000640 1 -- 172.21.15.2:0/2600197871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6be801b070 con 0x7f6bdc004780 2024-08-17T02:46:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.132+0000 7f6bee000640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6bd4065150 0x7f6bd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.132+0000 7f6bee000640 1 -- 172.21.15.2:0/2600197871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6be8019070 con 0x7f6bdc004780 2024-08-17T02:46:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.132+0000 7f6befe00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6bd4065150 0x7f6bd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.133+0000 7f6befe00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6bd4065150 0x7f6bd4067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6be0034000 tx=0x7f6be0035000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.136+0000 7f6bee000640 1 -- 172.21.15.2:0/2600197871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6bf814df60 con 0x7f6bdc004780 2024-08-17T02:46:50.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.357+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bf814df30 con 0x7f6bdc004780 2024-08-17T02:46:50.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.357+0000 7f6bee000640 1 -- 172.21.15.2:0/2600197871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f6be80503f0 con 0x7f6bdc004780 2024-08-17T02:46:50.359 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:50.359 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:13.176093+0000","modified":"2024-08-17T02:46:16.759354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:50.359 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-08-17T02:46:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.359+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6bd4065150 msgr2=0x7f6bd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.359+0000 7f6bfdc00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6bd4065150 0x7f6bd4067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6be0034000 tx=0x7f6be0035000 comp rx=0 tx=0).stop 2024-08-17T02:46:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.359+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 msgr2=0x7f6bf814d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.359+0000 7f6bfdc00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bf814d420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6be8004b00 tx=0x7f6bf80ad370 comp rx=0 tx=0).stop 2024-08-17T02:46:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.360+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 shutdown_connections 2024-08-17T02:46:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.360+0000 7f6bfdc00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bf815bd70 0x7f6bf814bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.360+0000 7f6bfdc00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6bd4065150 0x7f6bd4067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.360+0000 7f6bfdc00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6bf80c7810 0x7f6bf815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.360+0000 7f6bfdc00640 1 --2- 172.21.15.2:0/2600197871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bdc004780 0x7f6bf814d420 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.360+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 >> 172.21.15.2:0/2600197871 conn(0x7f6bf8066e60 msgr2=0x7f6bf80ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:50.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.360+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 shutdown_connections 2024-08-17T02:46:50.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.360+0000 7f6bfdc00640 1 -- 172.21.15.2:0/2600197871 wait complete. 2024-08-17T02:46:50.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.526+0000 7fc215e00640 1 Processor -- start 2024-08-17T02:46:50.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.526+0000 7fc215e00640 1 -- start start 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc215e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc2100afca0 0x7fc2100b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc215e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2100acf10 0x7fc210159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc215e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc210158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc215e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2100b0980 con 0x7fc2100acf10 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc215e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21015a4e0 con 0x7fc2100afca0 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc215e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100c92b0 con 0x7fc2101589a0 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc207e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2100acf10 0x7fc210159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc207e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2100acf10 0x7fc210159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33618/0 (socket says 172.21.15.2:33618) 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.527+0000 7fc207e00640 1 -- 172.21.15.2:0/3763068492 learned_addr learned my addr 172.21.15.2:0/3763068492 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:50.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.528+0000 7fc20ea00640 1 --2- 172.21.15.2:0/3763068492 >> v2:172.21.15.26:3300/0 conn(0x7fc2100afca0 0x7fc2100b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.528+0000 7fc20f400640 1 --2- 172.21.15.2:0/3763068492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc210158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.528+0000 7fc207e00640 1 -- 172.21.15.2:0/3763068492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 msgr2=0x7fc210158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.528+0000 7fc207e00640 1 --2- 172.21.15.2:0/3763068492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc210158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.528+0000 7fc207e00640 1 -- 172.21.15.2:0/3763068492 >> v2:172.21.15.26:3300/0 conn(0x7fc2100afca0 msgr2=0x7fc2100b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.528+0000 7fc207e00640 1 --2- 172.21.15.2:0/3763068492 >> v2:172.21.15.26:3300/0 conn(0x7fc2100afca0 0x7fc2100b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.528+0000 7fc207e00640 1 -- 172.21.15.2:0/3763068492 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc210159360 con 0x7fc2100acf10 2024-08-17T02:46:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.528+0000 7fc20f400640 1 --2- 172.21.15.2:0/3763068492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc210158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.529+0000 7fc207e00640 1 --2- 172.21.15.2:0/3763068492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc210159fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc210067e40 tx=0x7fc1f800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d382efa124ae55 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.529+0000 7fc20e000640 1 -- 172.21.15.2:0/3763068492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8032640 con 0x7fc2100acf10 2024-08-17T02:46:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.529+0000 7fc20e000640 1 -- 172.21.15.2:0/3763068492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f80327a0 con 0x7fc2100acf10 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.529+0000 7fc20e000640 1 -- 172.21.15.2:0/3763068492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8032b80 con 0x7fc2100acf10 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 -- 172.21.15.2:0/3763068492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 msgr2=0x7fc210159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 --2- 172.21.15.2:0/3763068492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc210159fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc210067e40 tx=0x7fc1f800b460 comp rx=0 tx=0).stop 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 -- 172.21.15.2:0/3763068492 shutdown_connections 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 --2- 172.21.15.2:0/3763068492 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc210158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 --2- 172.21.15.2:0/3763068492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc210159fa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 --2- 172.21.15.2:0/3763068492 >> v2:172.21.15.26:3300/0 conn(0x7fc2100afca0 0x7fc2100b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 -- 172.21.15.2:0/3763068492 >> 172.21.15.2:0/3763068492 conn(0x7fc210066e60 msgr2=0x7fc210067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 -- 172.21.15.2:0/3763068492 shutdown_connections 2024-08-17T02:46:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.530+0000 7fc215e00640 1 -- 172.21.15.2:0/3763068492 wait complete. 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.531+0000 7fc215e00640 1 Processor -- start 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.531+0000 7fc215e00640 1 -- start start 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc215e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc2101504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc215e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100afca0 0x7fc210150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc215e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc2101523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc215e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21014e5d0 con 0x7fc2100acf10 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc215e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21014d9c0 con 0x7fc2100afca0 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc215e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21014dca0 con 0x7fc2101589a0 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc20ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc2101504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc20ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc2101504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33626/0 (socket says 172.21.15.2:33626) 2024-08-17T02:46:50.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.532+0000 7fc20ea00640 1 -- 172.21.15.2:0/156383736 learned_addr learned my addr 172.21.15.2:0/156383736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.533+0000 7fc207e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100afca0 0x7fc210150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.533+0000 7fc20f400640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc2101523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.533+0000 7fc20ea00640 1 -- 172.21.15.2:0/156383736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 msgr2=0x7fc2101523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.533+0000 7fc20ea00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc2101523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.533+0000 7fc20ea00640 1 -- 172.21.15.2:0/156383736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100afca0 msgr2=0x7fc210150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.533+0000 7fc20ea00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100afca0 0x7fc210150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.533+0000 7fc20ea00640 1 -- 172.21.15.2:0/156383736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f800b700 con 0x7fc2100acf10 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.533+0000 7fc20ea00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc2101504c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc20000d890 tx=0x7fc200008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.534+0000 7fc206000640 1 -- 172.21.15.2:0/156383736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000de20 con 0x7fc2100acf10 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.534+0000 7fc206000640 1 -- 172.21.15.2:0/156383736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20000b8d0 con 0x7fc2100acf10 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.534+0000 7fc206000640 1 -- 172.21.15.2:0/156383736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000bc70 con 0x7fc2100acf10 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.534+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21014df80 con 0x7fc2100acf10 2024-08-17T02:46:50.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.534+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc210152910 con 0x7fc2100acf10 2024-08-17T02:46:50.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.535+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2100ac760 con 0x7fc2100acf10 2024-08-17T02:46:50.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.536+0000 7fc206000640 1 -- 172.21.15.2:0/156383736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc200014640 con 0x7fc2100acf10 2024-08-17T02:46:50.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.536+0000 7fc206000640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc1ec065150 0x7fc1ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.536+0000 7fc206000640 1 -- 172.21.15.2:0/156383736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2000829a0 con 0x7fc2100acf10 2024-08-17T02:46:50.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.537+0000 7fc207e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc1ec065150 0x7fc1ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.537+0000 7fc207e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc1ec065150 0x7fc1ec067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8037000 tx=0x7fc1f803a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.541+0000 7fc206000640 1 -- 172.21.15.2:0/156383736 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc2100ac760 con 0x7fc2100acf10 2024-08-17T02:46:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.724+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2100ac760 con 0x7fc2100acf10 2024-08-17T02:46:50.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.725+0000 7fc206000640 1 -- 172.21.15.2:0/156383736 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7fc2100ac760 con 0x7fc2100acf10 2024-08-17T02:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc1ec065150 msgr2=0x7fc1ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc1ec065150 0x7fc1ec067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8037000 tx=0x7fc1f803a000 comp rx=0 tx=0).stop 2024-08-17T02:46:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 msgr2=0x7fc2101504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc2101504c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc20000d890 tx=0x7fc200008040 comp rx=0 tx=0).stop 2024-08-17T02:46:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 shutdown_connections 2024-08-17T02:46:50.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc1ec065150 0x7fc1ec067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc2101589a0 0x7fc2101523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2100afca0 0x7fc210150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 --2- 172.21.15.2:0/156383736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100acf10 0x7fc2101504c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 >> 172.21.15.2:0/156383736 conn(0x7fc210066e60 msgr2=0x7fc2100699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 shutdown_connections 2024-08-17T02:46:50.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.727+0000 7fc215e00640 1 -- 172.21.15.2:0/156383736 wait complete. 2024-08-17T02:46:50.745 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:46:50.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.896+0000 7f294d200640 1 Processor -- start 2024-08-17T02:46:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.896+0000 7f294d200640 1 -- start start 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.897+0000 7f294d200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29481590b0 0x7f29480b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.897+0000 7f294d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29480acf10 0x7f2948159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f294d200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294815a4e0 con 0x7f29480afca0 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f294d200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480b0980 con 0x7f29480acf10 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f294d200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29480c92b0 con 0x7f29481590b0 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f2946800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29480acf10 0x7f2948159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f2946800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29480acf10 0x7f2948159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33636/0 (socket says 172.21.15.2:33636) 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f2946800640 1 -- 172.21.15.2:0/4112468830 learned_addr learned my addr 172.21.15.2:0/4112468830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f2945400640 1 --2- 172.21.15.2:0/4112468830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29481590b0 0x7f29480b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f2946800640 1 -- 172.21.15.2:0/4112468830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29481590b0 msgr2=0x7f29480b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f2946800640 1 --2- 172.21.15.2:0/4112468830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29481590b0 0x7f29480b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f2946800640 1 -- 172.21.15.2:0/4112468830 >> v1:172.21.15.26:6789/0 conn(0x7f29480afca0 legacy=0x7f29481589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.898+0000 7f2946800640 1 -- 172.21.15.2:0/4112468830 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29480ad480 con 0x7f29480acf10 2024-08-17T02:46:50.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.899+0000 7f2946800640 1 --2- 172.21.15.2:0/4112468830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29480acf10 0x7f2948159fa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2940009f20 tx=0x7f2940009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3859a81a2af0e443 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f2944a00640 1 -- 172.21.15.2:0/4112468830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940031400 con 0x7f29480acf10 2024-08-17T02:46:50.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f2944a00640 1 -- 172.21.15.2:0/4112468830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294002d050 con 0x7f29480acf10 2024-08-17T02:46:50.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f2944a00640 1 -- 172.21.15.2:0/4112468830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29400317d0 con 0x7f29480acf10 2024-08-17T02:46:50.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f294d200640 1 -- 172.21.15.2:0/4112468830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29480acf10 msgr2=0x7f2948159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f294d200640 1 --2- 172.21.15.2:0/4112468830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29480acf10 0x7f2948159fa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2940009f20 tx=0x7f2940009840 comp rx=0 tx=0).stop 2024-08-17T02:46:50.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f294d200640 1 -- 172.21.15.2:0/4112468830 shutdown_connections 2024-08-17T02:46:50.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f294d200640 1 --2- 172.21.15.2:0/4112468830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29480acf10 0x7f2948159fa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f294d200640 1 --2- 172.21.15.2:0/4112468830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29481590b0 0x7f29480b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f294d200640 1 -- 172.21.15.2:0/4112468830 >> 172.21.15.2:0/4112468830 conn(0x7f2948066e60 msgr2=0x7f2948067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:50.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f294d200640 1 -- 172.21.15.2:0/4112468830 shutdown_connections 2024-08-17T02:46:50.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.900+0000 7f294d200640 1 -- 172.21.15.2:0/4112468830 wait complete. 2024-08-17T02:46:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.902+0000 7f294d200640 1 Processor -- start 2024-08-17T02:46:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.902+0000 7f294d200640 1 -- start start 2024-08-17T02:46:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f294d200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29480acf10 0x7f294806a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f294d200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29480afca0 0x7f294806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f294d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29481590b0 0x7f29481556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f294d200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2948156c40 con 0x7f29481590b0 2024-08-17T02:46:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f294d200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2948152c00 con 0x7f29480acf10 2024-08-17T02:46:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f294d200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2948152ee0 con 0x7f29480afca0 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2946800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29481590b0 0x7f29481556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2946800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29481590b0 0x7f29481556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33648/0 (socket says 172.21.15.2:33648) 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2946800640 1 -- 172.21.15.2:0/2618848091 learned_addr learned my addr 172.21.15.2:0/2618848091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2945400640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29480afca0 0x7f294806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2946800640 1 -- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29480afca0 msgr2=0x7f294806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2946800640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29480afca0 0x7f294806a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2946800640 1 -- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29480acf10 msgr2=0x7f294806a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2945e00640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29480acf10 0x7f294806a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2946800640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29480acf10 0x7f294806a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2946800640 1 -- 172.21.15.2:0/2618848091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940009ae0 con 0x7f29481590b0 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2945400640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29480afca0 0x7f294806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.903+0000 7f2945e00640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29480acf10 0x7f294806a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.904+0000 7f2946800640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29481590b0 0x7f29481556d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2940009f20 tx=0x7f2940036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.904+0000 7f293d600640 1 -- 172.21.15.2:0/2618848091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940008e50 con 0x7f29481590b0 2024-08-17T02:46:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.904+0000 7f293d600640 1 -- 172.21.15.2:0/2618848091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294003b410 con 0x7f29481590b0 2024-08-17T02:46:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.904+0000 7f293d600640 1 -- 172.21.15.2:0/2618848091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294003b7d0 con 0x7f29481590b0 2024-08-17T02:46:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.904+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29481531c0 con 0x7f29481590b0 2024-08-17T02:46:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.904+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2948155c10 con 0x7f29481590b0 2024-08-17T02:46:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.905+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2948063fb0 con 0x7f29481590b0 2024-08-17T02:46:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.906+0000 7f293d600640 1 -- 172.21.15.2:0/2618848091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2940038050 con 0x7f29481590b0 2024-08-17T02:46:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.907+0000 7f293d600640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2928065150 0x7f2928067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.907+0000 7f293d600640 1 -- 172.21.15.2:0/2618848091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29400a31f0 con 0x7f29481590b0 2024-08-17T02:46:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.907+0000 7f2945e00640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2928065150 0x7f2928067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:50.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.908+0000 7f2945e00640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2928065150 0x7f2928067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f29380017a0 tx=0x7f2938009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:50.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:50.910+0000 7f293d600640 1 -- 172.21.15.2:0/2618848091 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2940071210 con 0x7f29481590b0 2024-08-17T02:46:51.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.136+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29480699b0 con 0x7f29481590b0 2024-08-17T02:46:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.137+0000 7f293d600640 1 -- 172.21.15.2:0/2618848091 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f2940078e60 con 0x7f29481590b0 2024-08-17T02:46:51.138 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:51.138 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:13.176093+0000","modified":"2024-08-17T02:46:16.759354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:51.138 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-08-17T02:46:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.139+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2928065150 msgr2=0x7f2928067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.139+0000 7f294d200640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2928065150 0x7f2928067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f29380017a0 tx=0x7f2938009040 comp rx=0 tx=0).stop 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.139+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29481590b0 msgr2=0x7f29481556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.139+0000 7f294d200640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29481590b0 0x7f29481556d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2940009f20 tx=0x7f2940036000 comp rx=0 tx=0).stop 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.139+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 shutdown_connections 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.140+0000 7f294d200640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29481590b0 0x7f29481556d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.140+0000 7f294d200640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2928065150 0x7f2928067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.140+0000 7f294d200640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29480afca0 0x7f294806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.140+0000 7f294d200640 1 --2- 172.21.15.2:0/2618848091 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29480acf10 0x7f294806a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.140+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 >> 172.21.15.2:0/2618848091 conn(0x7f2948066e60 msgr2=0x7f29480cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.140+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 shutdown_connections 2024-08-17T02:46:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.140+0000 7f294d200640 1 -- 172.21.15.2:0/2618848091 wait complete. 2024-08-17T02:46:51.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:46:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.306+0000 7f089a600640 1 Processor -- start 2024-08-17T02:46:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.306+0000 7f089a600640 1 -- start start 2024-08-17T02:46:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.307+0000 7f089a600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08940afca0 0x7f08940b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.307+0000 7f089a600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08941590b0 0x7f0894159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.307+0000 7f089a600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089415a4e0 con 0x7f08940acf10 2024-08-17T02:46:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.307+0000 7f089a600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08940b0980 con 0x7f08941590b0 2024-08-17T02:46:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.307+0000 7f089a600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08940c92b0 con 0x7f08940afca0 2024-08-17T02:46:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.308+0000 7f0893e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08941590b0 0x7f0894159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.308+0000 7f0893e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08941590b0 0x7f0894159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33664/0 (socket says 172.21.15.2:33664) 2024-08-17T02:46:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.308+0000 7f0893e00640 1 -- 172.21.15.2:0/1673395607 learned_addr learned my addr 172.21.15.2:0/1673395607 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.308+0000 7f0893400640 1 --2- 172.21.15.2:0/1673395607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08940afca0 0x7f08940b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.308+0000 7f0893e00640 1 -- 172.21.15.2:0/1673395607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08940afca0 msgr2=0x7f08940b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.308+0000 7f0893e00640 1 --2- 172.21.15.2:0/1673395607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08940afca0 0x7f08940b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.308+0000 7f0893e00640 1 -- 172.21.15.2:0/1673395607 >> v1:172.21.15.26:6789/0 conn(0x7f08940acf10 legacy=0x7f08941589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.308+0000 7f0893e00640 1 -- 172.21.15.2:0/1673395607 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940ad480 con 0x7f08941590b0 2024-08-17T02:46:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.309+0000 7f0893e00640 1 --2- 172.21.15.2:0/1673395607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08941590b0 0x7f0894159fa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f088c009f20 tx=0x7f088c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf32a776d09323b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.309+0000 7f0892a00640 1 -- 172.21.15.2:0/1673395607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c031400 con 0x7f08941590b0 2024-08-17T02:46:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.309+0000 7f0892a00640 1 -- 172.21.15.2:0/1673395607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c02d050 con 0x7f08941590b0 2024-08-17T02:46:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.309+0000 7f0892a00640 1 -- 172.21.15.2:0/1673395607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c0317d0 con 0x7f08941590b0 2024-08-17T02:46:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.310+0000 7f089a600640 1 -- 172.21.15.2:0/1673395607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08941590b0 msgr2=0x7f0894159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.310+0000 7f089a600640 1 --2- 172.21.15.2:0/1673395607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08941590b0 0x7f0894159fa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f088c009f20 tx=0x7f088c009840 comp rx=0 tx=0).stop 2024-08-17T02:46:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.310+0000 7f089a600640 1 -- 172.21.15.2:0/1673395607 shutdown_connections 2024-08-17T02:46:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.310+0000 7f089a600640 1 --2- 172.21.15.2:0/1673395607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08941590b0 0x7f0894159fa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.310+0000 7f089a600640 1 --2- 172.21.15.2:0/1673395607 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08940afca0 0x7f08940b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.310+0000 7f089a600640 1 -- 172.21.15.2:0/1673395607 >> 172.21.15.2:0/1673395607 conn(0x7f0894066e60 msgr2=0x7f0894067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.310+0000 7f089a600640 1 -- 172.21.15.2:0/1673395607 shutdown_connections 2024-08-17T02:46:51.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.310+0000 7f089a600640 1 -- 172.21.15.2:0/1673395607 wait complete. 2024-08-17T02:46:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.311+0000 7f089a600640 1 Processor -- start 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.312+0000 7f089a600640 1 -- start start 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.312+0000 7f089a600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08940acf10 0x7f0894164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.312+0000 7f089a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08940afca0 0x7f0894155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.312+0000 7f089a600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08941590b0 0x7f089414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.312+0000 7f089a600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089414e3c0 con 0x7f08940afca0 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.312+0000 7f089a600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089414d7b0 con 0x7f08940acf10 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.312+0000 7f089a600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089414da90 con 0x7f08941590b0 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f088be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08940afca0 0x7f0894155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f0893400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08940acf10 0x7f0894164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f088be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08940afca0 0x7f0894155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33678/0 (socket says 172.21.15.2:33678) 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f0893e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08941590b0 0x7f089414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f088be00640 1 -- 172.21.15.2:0/2404370930 learned_addr learned my addr 172.21.15.2:0/2404370930 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f088be00640 1 -- 172.21.15.2:0/2404370930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08941590b0 msgr2=0x7f089414fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f088be00640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08941590b0 0x7f089414fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f088be00640 1 -- 172.21.15.2:0/2404370930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08940acf10 msgr2=0x7f0894164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f088be00640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08940acf10 0x7f0894164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.313+0000 7f088be00640 1 -- 172.21.15.2:0/2404370930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c009ae0 con 0x7f08940afca0 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.314+0000 7f088be00640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08940afca0 0x7f0894155be0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c560 tx=0x7f087c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.314+0000 7f088aa00640 1 -- 172.21.15.2:0/2404370930 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c011590 con 0x7f08940afca0 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.314+0000 7f088aa00640 1 -- 172.21.15.2:0/2404370930 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c011710 con 0x7f08940afca0 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.314+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089414dd70 con 0x7f08940afca0 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.314+0000 7f088aa00640 1 -- 172.21.15.2:0/2404370930 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c011ad0 con 0x7f08940afca0 2024-08-17T02:46:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.314+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08941653c0 con 0x7f08940afca0 2024-08-17T02:46:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.315+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0894063fb0 con 0x7f08940afca0 2024-08-17T02:46:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.316+0000 7f088aa00640 1 -- 172.21.15.2:0/2404370930 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f087c01b3b0 con 0x7f08940afca0 2024-08-17T02:46:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.317+0000 7f088aa00640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0870065150 0x7f0870067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.317+0000 7f088aa00640 1 -- 172.21.15.2:0/2404370930 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f087c0817e0 con 0x7f08940afca0 2024-08-17T02:46:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.317+0000 7f0893400640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0870065150 0x7f0870067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.318+0000 7f0893400640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0870065150 0x7f0870067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f088400ffd0 tx=0x7f0884008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.320+0000 7f088aa00640 1 -- 172.21.15.2:0/2404370930 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f087c04f8b0 con 0x7f08940afca0 2024-08-17T02:46:51.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.538+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f089415a4e0 con 0x7f08940afca0 2024-08-17T02:46:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.539+0000 7f088aa00640 1 -- 172.21.15.2:0/2404370930 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f089415a4e0 con 0x7f08940afca0 2024-08-17T02:46:51.540 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:51.540 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/2728231721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":2728231721},{"type":"v1","addr":"172.21.15.26:6834","nonce":2728231721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1725282046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1725282046},{"type":"v1","addr":"172.21.15.2:6836","nonce":1725282046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/1649054134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1649054134},{"type":"v1","addr":"172.21.15.2:6837","nonce":1649054134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:46:13.176093+0000","modified":"2024-08-17T02:46:16.759354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.26:6835/4209722818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":4209722818},{"type":"v1","addr":"172.21.15.26:6835","nonce":4209722818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:46:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-08-17T02:46:51.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0870065150 msgr2=0x7f0870067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0870065150 0x7f0870067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f088400ffd0 tx=0x7f0884008040 comp rx=0 tx=0).stop 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08940afca0 msgr2=0x7f0894155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08940afca0 0x7f0894155be0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c560 tx=0x7f087c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 shutdown_connections 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0870065150 0x7f0870067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08941590b0 0x7f089414fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08940afca0 0x7f0894155be0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 --2- 172.21.15.2:0/2404370930 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08940acf10 0x7f0894164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.541+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 >> 172.21.15.2:0/2404370930 conn(0x7f0894066e60 msgr2=0x7f08940c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.542+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 shutdown_connections 2024-08-17T02:46:51.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.542+0000 7f089a600640 1 -- 172.21.15.2:0/2404370930 wait complete. 2024-08-17T02:46:51.560 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:46:51.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.709+0000 7f7bb1a00640 1 Processor -- start 2024-08-17T02:46:51.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.709+0000 7f7bb1a00640 1 -- start start 2024-08-17T02:46:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7bb1a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bac06e4b0 0x7f7bac0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7bb1a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bac0aeeb0 con 0x7f7bac155040 2024-08-17T02:46:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7bb1a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bac0aadd0 con 0x7f7bac06e060 2024-08-17T02:46:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7bb1a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bac1597f0 con 0x7f7bac06e4b0 2024-08-17T02:46:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7baaa00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7bac155040 0x7f7bac158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43018/0 (socket says 172.21.15.2:43018) 2024-08-17T02:46:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7baaa00640 1 -- 172.21.15.2:0/2528865265 learned_addr learned my addr 172.21.15.2:0/2528865265 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7bab400640 1 --2- 172.21.15.2:0/2528865265 >> v2:172.21.15.2:3300/0 conn(0x7f7bac06e4b0 0x7f7bac0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7baa000640 1 -- 172.21.15.2:0/2528865265 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696184594 0 0) 0x7f7bac0aeeb0 con 0x7f7bac155040 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.711+0000 7f7baa000640 1 -- 172.21.15.2:0/2528865265 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b900045f0 con 0x7f7bac155040 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.712+0000 7f7bab400640 1 -- 172.21.15.2:0/2528865265 >> v1:172.21.15.26:6789/0 conn(0x7f7bac06e060 legacy=0x7f7bac0af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.712+0000 7f7bab400640 1 -- 172.21.15.2:0/2528865265 >> v1:172.21.15.2:6789/0 conn(0x7f7bac155040 legacy=0x7f7bac158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.712+0000 7f7bab400640 1 -- 172.21.15.2:0/2528865265 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac159ad0 con 0x7f7bac06e4b0 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7bab400640 1 --2- 172.21.15.2:0/2528865265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac06e4b0 0x7f7bac0afa50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009e60 tx=0x7f7ba4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7070b8a92f15976e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7baa000640 1 -- 172.21.15.2:0/2528865265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4007550 con 0x7f7bac06e4b0 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7baa000640 1 -- 172.21.15.2:0/2528865265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba402d050 con 0x7f7bac06e4b0 2024-08-17T02:46:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7baa000640 1 -- 172.21.15.2:0/2528865265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40078e0 con 0x7f7bac06e4b0 2024-08-17T02:46:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7bb1a00640 1 -- 172.21.15.2:0/2528865265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac06e4b0 msgr2=0x7f7bac0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7bb1a00640 1 --2- 172.21.15.2:0/2528865265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac06e4b0 0x7f7bac0afa50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009e60 tx=0x7f7ba4009780 comp rx=0 tx=0).stop 2024-08-17T02:46:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7bb1a00640 1 -- 172.21.15.2:0/2528865265 shutdown_connections 2024-08-17T02:46:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7bb1a00640 1 --2- 172.21.15.2:0/2528865265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac06e4b0 0x7f7bac0afa50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.713+0000 7f7bb1a00640 1 -- 172.21.15.2:0/2528865265 >> 172.21.15.2:0/2528865265 conn(0x7f7bac066e60 msgr2=0x7f7bac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.714+0000 7f7bb1a00640 1 -- 172.21.15.2:0/2528865265 shutdown_connections 2024-08-17T02:46:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.714+0000 7f7bb1a00640 1 -- 172.21.15.2:0/2528865265 wait complete. 2024-08-17T02:46:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.715+0000 7f7bb1a00640 1 Processor -- start 2024-08-17T02:46:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.715+0000 7f7bb1a00640 1 -- start start 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.716+0000 7f7bb1a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bac06e060 0x7f7bac157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.716+0000 7f7bb1a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bac06e4b0 0x7f7bac168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.716+0000 7f7bb1a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac155040 0x7f7bac156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.716+0000 7f7bb1a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac158740 con 0x7f7bac155040 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.716+0000 7f7bb1a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac1555b0 con 0x7f7bac06e4b0 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.716+0000 7f7bb1a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac155850 con 0x7f7bac06e060 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.716+0000 7f7bab400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac155040 0x7f7bac156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.716+0000 7f7bab400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac155040 0x7f7bac156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33698/0 (socket says 172.21.15.2:33698) 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7bab400640 1 -- 172.21.15.2:0/1797320217 learned_addr learned my addr 172.21.15.2:0/1797320217 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7baaa00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bac06e060 0x7f7bac157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7ba2000640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bac06e4b0 0x7f7bac168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7bab400640 1 -- 172.21.15.2:0/1797320217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bac06e060 msgr2=0x7f7bac157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7bab400640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bac06e060 0x7f7bac157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7bab400640 1 -- 172.21.15.2:0/1797320217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bac06e4b0 msgr2=0x7f7bac168d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7bab400640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bac06e4b0 0x7f7bac168d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7bab400640 1 -- 172.21.15.2:0/1797320217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba4009a20 con 0x7f7bac155040 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7bab400640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac155040 0x7f7bac156330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40099f0 tx=0x7f7ba4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.717+0000 7f7ba2a00640 1 -- 172.21.15.2:0/1797320217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4031960 con 0x7f7bac155040 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.718+0000 7f7ba2a00640 1 -- 172.21.15.2:0/1797320217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba4040070 con 0x7f7bac155040 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.718+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac155b30 con 0x7f7bac155040 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.718+0000 7f7ba2a00640 1 -- 172.21.15.2:0/1797320217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4031d10 con 0x7f7bac155040 2024-08-17T02:46:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.718+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac158430 con 0x7f7bac155040 2024-08-17T02:46:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.719+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac063fb0 con 0x7f7bac155040 2024-08-17T02:46:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.719+0000 7f7ba2a00640 1 -- 172.21.15.2:0/1797320217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7ba4042030 con 0x7f7bac155040 2024-08-17T02:46:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.720+0000 7f7ba2a00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7b88065150 0x7f7b88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.720+0000 7f7ba2a00640 1 -- 172.21.15.2:0/1797320217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ba40a3cb0 con 0x7f7bac155040 2024-08-17T02:46:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.720+0000 7f7baaa00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7b88065150 0x7f7b88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.721+0000 7f7baaa00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7b88065150 0x7f7b88067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005840 tx=0x7f7b9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.724+0000 7f7ba2a00640 1 -- 172.21.15.2:0/1797320217 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7ba4071d80 con 0x7f7bac155040 2024-08-17T02:46:51.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.907+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bac0a9490 con 0x7f7bac155040 2024-08-17T02:46:51.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.908+0000 7f7ba2a00640 1 -- 172.21.15.2:0/1797320217 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15254 (secure 0 0 0) 0x7f7ba40753a0 con 0x7f7bac155040 2024-08-17T02:46:51.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:46:51.910 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:46:14.748658+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:46:10.965028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:46:12.163837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:46:51.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7b88065150 msgr2=0x7f7b88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7b88065150 0x7f7b88067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005840 tx=0x7f7b9c009040 comp rx=0 tx=0).stop 2024-08-17T02:46:51.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac155040 msgr2=0x7f7bac156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:51.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac155040 0x7f7bac156330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40099f0 tx=0x7f7ba4037000 comp rx=0 tx=0).stop 2024-08-17T02:46:51.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 shutdown_connections 2024-08-17T02:46:51.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bac155040 0x7f7bac156330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bac06e4b0 0x7f7bac168d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7b88065150 0x7f7b88067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 --2- 172.21.15.2:0/1797320217 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7bac06e060 0x7f7bac157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:51.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 >> 172.21.15.2:0/1797320217 conn(0x7f7bac066e60 msgr2=0x7f7bac0ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:51.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 shutdown_connections 2024-08-17T02:46:51.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:51.910+0000 7f7bb1a00640 1 -- 172.21.15.2:0/1797320217 wait complete. 2024-08-17T02:46:51.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:46:52.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.080+0000 7f9a48a00640 1 Processor -- start 2024-08-17T02:46:52.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.080+0000 7f9a48a00640 1 -- start start 2024-08-17T02:46:52.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a48a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a440ae910 0x7f9a440aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a48a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a44160720 0x7f9a44162b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a48a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a440aab10 con 0x7f9a440ae540 2024-08-17T02:46:52.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a48a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a440abfb0 con 0x7f9a44160720 2024-08-17T02:46:52.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a48a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a440ac250 con 0x7f9a440ae910 2024-08-17T02:46:52.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a43e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a44160720 0x7f9a44162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a43400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9a440ae540 0x7f9a44068950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43030/0 (socket says 172.21.15.2:43030) 2024-08-17T02:46:52.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a43400640 1 -- 172.21.15.2:0/2913673703 learned_addr learned my addr 172.21.15.2:0/2913673703 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:52.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.081+0000 7f9a42a00640 1 --2- 172.21.15.2:0/2913673703 >> v2:172.21.15.26:3300/0 conn(0x7f9a440ae910 0x7f9a440aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.082+0000 7f9a43e00640 1 -- 172.21.15.2:0/2913673703 >> v2:172.21.15.26:3300/0 conn(0x7f9a440ae910 msgr2=0x7f9a440aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:52.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.082+0000 7f9a43e00640 1 --2- 172.21.15.2:0/2913673703 >> v2:172.21.15.26:3300/0 conn(0x7f9a440ae910 0x7f9a440aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.082+0000 7f9a43e00640 1 -- 172.21.15.2:0/2913673703 >> v1:172.21.15.2:6789/0 conn(0x7f9a440ae540 legacy=0x7f9a44068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.082+0000 7f9a43e00640 1 -- 172.21.15.2:0/2913673703 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440693e0 con 0x7f9a44160720 2024-08-17T02:46:52.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.082+0000 7f9a42000640 1 -- 172.21.15.2:0/2913673703 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198472246 0 0) 0x7f9a440aab10 con 0x7f9a440ae540 2024-08-17T02:46:52.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.083+0000 7f9a43e00640 1 --2- 172.21.15.2:0/2913673703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44162b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a4406f4a0 tx=0x7f9a3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1516c7c140ce19b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.083+0000 7f9a42000640 1 -- 172.21.15.2:0/2913673703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c007550 con 0x7f9a44160720 2024-08-17T02:46:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.083+0000 7f9a42000640 1 -- 172.21.15.2:0/2913673703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c02d050 con 0x7f9a44160720 2024-08-17T02:46:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.083+0000 7f9a42000640 1 -- 172.21.15.2:0/2913673703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0078e0 con 0x7f9a44160720 2024-08-17T02:46:52.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.084+0000 7f9a48a00640 1 -- 172.21.15.2:0/2913673703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 msgr2=0x7f9a44162b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.084+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2913673703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44162b00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a4406f4a0 tx=0x7f9a3c009780 comp rx=0 tx=0).stop 2024-08-17T02:46:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.084+0000 7f9a48a00640 1 -- 172.21.15.2:0/2913673703 shutdown_connections 2024-08-17T02:46:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.084+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2913673703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44162b00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.084+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2913673703 >> v2:172.21.15.26:3300/0 conn(0x7f9a440ae910 0x7f9a440aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.084+0000 7f9a48a00640 1 -- 172.21.15.2:0/2913673703 >> 172.21.15.2:0/2913673703 conn(0x7f9a440ce400 msgr2=0x7f9a44095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.084+0000 7f9a48a00640 1 -- 172.21.15.2:0/2913673703 shutdown_connections 2024-08-17T02:46:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.084+0000 7f9a48a00640 1 -- 172.21.15.2:0/2913673703 wait complete. 2024-08-17T02:46:52.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.085+0000 7f9a48a00640 1 Processor -- start 2024-08-17T02:46:52.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.085+0000 7f9a48a00640 1 -- start start 2024-08-17T02:46:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.086+0000 7f9a48a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a440ae540 0x7f9a4414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.086+0000 7f9a48a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a440ae910 0x7f9a4415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.086+0000 7f9a48a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44095bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.086+0000 7f9a48a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4409a8b0 con 0x7f9a44160720 2024-08-17T02:46:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.086+0000 7f9a48a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4409ab50 con 0x7f9a440ae540 2024-08-17T02:46:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.086+0000 7f9a48a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4409ae30 con 0x7f9a440ae910 2024-08-17T02:46:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44095bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44095bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33712/0 (socket says 172.21.15.2:33712) 2024-08-17T02:46:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 -- 172.21.15.2:0/2307660980 learned_addr learned my addr 172.21.15.2:0/2307660980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43400640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a440ae540 0x7f9a4414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a42a00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a440ae910 0x7f9a4415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 -- 172.21.15.2:0/2307660980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a440ae910 msgr2=0x7f9a4415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a440ae910 0x7f9a4415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 -- 172.21.15.2:0/2307660980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a440ae540 msgr2=0x7f9a4414a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a440ae540 0x7f9a4414a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 -- 172.21.15.2:0/2307660980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c009a20 con 0x7f9a44160720 2024-08-17T02:46:52.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.087+0000 7f9a43e00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44095bc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009e90 tx=0x7f9a3c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.088+0000 7f9a3aa00640 1 -- 172.21.15.2:0/2307660980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0318b0 con 0x7f9a44160720 2024-08-17T02:46:52.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.088+0000 7f9a3aa00640 1 -- 172.21.15.2:0/2307660980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c040070 con 0x7f9a44160720 2024-08-17T02:46:52.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.088+0000 7f9a3aa00640 1 -- 172.21.15.2:0/2307660980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c031c40 con 0x7f9a44160720 2024-08-17T02:46:52.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.088+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4409b110 con 0x7f9a44160720 2024-08-17T02:46:52.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.088+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4415f240 con 0x7f9a44160720 2024-08-17T02:46:52.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.089+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a44070720 con 0x7f9a44160720 2024-08-17T02:46:52.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.090+0000 7f9a3aa00640 1 -- 172.21.15.2:0/2307660980 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9a3c042030 con 0x7f9a44160720 2024-08-17T02:46:52.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.090+0000 7f9a3aa00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a24065150 0x7f9a24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.091+0000 7f9a3aa00640 1 -- 172.21.15.2:0/2307660980 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a3c0a3d60 con 0x7f9a44160720 2024-08-17T02:46:52.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.091+0000 7f9a43400640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a24065150 0x7f9a24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.091+0000 7f9a43400640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a24065150 0x7f9a24067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9a4406a6f0 tx=0x7f9a34007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.095+0000 7f9a3aa00640 1 -- 172.21.15.2:0/2307660980 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9a3c071e30 con 0x7f9a44160720 2024-08-17T02:46:52.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.316+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9a440ad1c0 con 0x7f9a44160720 2024-08-17T02:46:52.318 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-08-17T02:46:52.317+0000 7fa73ce00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:46:52.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.321+0000 7f9a3aa00640 1 -- 172.21.15.2:0/2307660980 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9a3c075450 con 0x7f9a44160720 2024-08-17T02:46:52.322 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:46:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a24065150 msgr2=0x7f9a24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a24065150 0x7f9a24067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9a4406a6f0 tx=0x7f9a34007ec0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 msgr2=0x7f9a44095bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44095bc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009e90 tx=0x7f9a3c037000 comp rx=0 tx=0).stop 2024-08-17T02:46:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 shutdown_connections 2024-08-17T02:46:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a44160720 0x7f9a44095bc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9a24065150 0x7f9a24067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9a440ae910 0x7f9a4415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 --2- 172.21.15.2:0/2307660980 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a440ae540 0x7f9a4414a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.323+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 >> 172.21.15.2:0/2307660980 conn(0x7f9a440ce400 msgr2=0x7f9a4406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.324+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 shutdown_connections 2024-08-17T02:46:52.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.324+0000 7f9a48a00640 1 -- 172.21.15.2:0/2307660980 wait complete. 2024-08-17T02:46:52.329 INFO:tasks.ceph.mds.d.smithi026.stderr: -1980> 2024-08-17T02:46:17.267+0000 7fabc4000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:46:52.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:46:52.372 INFO:tasks.ceph.mds.d.smithi026.stdout:starting mds.d at 2024-08-17T02:46:52.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.495+0000 7fbd3a200640 1 Processor -- start 2024-08-17T02:46:52.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.495+0000 7fbd3a200640 1 -- start start 2024-08-17T02:46:52.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.496+0000 7fbd3a200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbd340ad960 0x7fbd3415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.496+0000 7fbd3a200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd340ca050 0x7fbd34156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.496+0000 7fbd3a200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3415b5e0 con 0x7fbd340add30 2024-08-17T02:46:52.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.496+0000 7fbd3a200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd340cb160 con 0x7fbd340ad960 2024-08-17T02:46:52.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.496+0000 7fbd3a200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd340b0d10 con 0x7fbd340ca050 2024-08-17T02:46:52.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.496+0000 7fbd33400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbd340ad960 0x7fbd3415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.496+0000 7fbd33400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbd340ad960 0x7fbd3415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33724/0 (socket says 172.21.15.2:33724) 2024-08-17T02:46:52.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.497+0000 7fbd33400640 1 -- 172.21.15.2:0/4060392242 learned_addr learned my addr 172.21.15.2:0/4060392242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:52.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.497+0000 7fbd32a00640 1 --2- 172.21.15.2:0/4060392242 >> v2:172.21.15.26:3300/0 conn(0x7fbd340ca050 0x7fbd34156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.497+0000 7fbd33400640 1 -- 172.21.15.2:0/4060392242 >> v2:172.21.15.26:3300/0 conn(0x7fbd340ca050 msgr2=0x7fbd34156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.497+0000 7fbd33400640 1 --2- 172.21.15.2:0/4060392242 >> v2:172.21.15.26:3300/0 conn(0x7fbd340ca050 0x7fbd34156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.497+0000 7fbd33400640 1 -- 172.21.15.2:0/4060392242 >> v1:172.21.15.26:6789/0 conn(0x7fbd340add30 legacy=0x7fbd34156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.497+0000 7fbd33400640 1 -- 172.21.15.2:0/4060392242 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd340ca550 con 0x7fbd340ad960 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.498+0000 7fbd33400640 1 --2- 172.21.15.2:0/4060392242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd3415b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbd34063600 tx=0x7fbd240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc3868908606227 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.498+0000 7fbd32000640 1 -- 172.21.15.2:0/4060392242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2402ae60 con 0x7fbd340ad960 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.498+0000 7fbd32000640 1 -- 172.21.15.2:0/4060392242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24032440 con 0x7fbd340ad960 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.498+0000 7fbd32000640 1 -- 172.21.15.2:0/4060392242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd240327e0 con 0x7fbd340ad960 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.499+0000 7fbd3a200640 1 -- 172.21.15.2:0/4060392242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 msgr2=0x7fbd3415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.499+0000 7fbd3a200640 1 --2- 172.21.15.2:0/4060392242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd3415b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbd34063600 tx=0x7fbd240091d0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.499+0000 7fbd3a200640 1 -- 172.21.15.2:0/4060392242 shutdown_connections 2024-08-17T02:46:52.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.499+0000 7fbd3a200640 1 --2- 172.21.15.2:0/4060392242 >> v2:172.21.15.26:3300/0 conn(0x7fbd340ca050 0x7fbd34156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.499+0000 7fbd3a200640 1 --2- 172.21.15.2:0/4060392242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd3415b0a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.499+0000 7fbd3a200640 1 -- 172.21.15.2:0/4060392242 >> 172.21.15.2:0/4060392242 conn(0x7fbd34066e60 msgr2=0x7fbd34067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:52.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.499+0000 7fbd3a200640 1 -- 172.21.15.2:0/4060392242 shutdown_connections 2024-08-17T02:46:52.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.499+0000 7fbd3a200640 1 -- 172.21.15.2:0/4060392242 wait complete. 2024-08-17T02:46:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.500+0000 7fbd3a200640 1 Processor -- start 2024-08-17T02:46:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.500+0000 7fbd3a200640 1 -- start start 2024-08-17T02:46:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.501+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd34143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.501+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd340add30 0x7fbd34069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.501+0000 7fbd3a200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd340ca050 0x7fbd3415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.501+0000 7fbd3a200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3415dc30 con 0x7fbd340ad960 2024-08-17T02:46:52.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.501+0000 7fbd3a200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd34159710 con 0x7fbd340add30 2024-08-17T02:46:52.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.501+0000 7fbd3a200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd341599f0 con 0x7fbd340ca050 2024-08-17T02:46:52.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd34143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd34143250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33738/0 (socket says 172.21.15.2:33738) 2024-08-17T02:46:52.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 -- 172.21.15.2:0/2121300163 learned_addr learned my addr 172.21.15.2:0/2121300163 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:52.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd32a00640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd340add30 0x7fbd34069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33e00640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd340ca050 0x7fbd3415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 -- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd340ca050 msgr2=0x7fbd3415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd340ca050 0x7fbd3415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 -- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd340add30 msgr2=0x7fbd34069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd340add30 0x7fbd34069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 -- 172.21.15.2:0/2121300163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24009450 con 0x7fbd340ad960 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd32a00640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd340add30 0x7fbd34069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.502+0000 7fbd33400640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd34143250 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbd24035040 tx=0x7fbd24032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.503+0000 7fbd2aa00640 1 -- 172.21.15.2:0/2121300163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24000d10 con 0x7fbd340ad960 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.503+0000 7fbd2aa00640 1 -- 172.21.15.2:0/2121300163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24031de0 con 0x7fbd340ad960 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.503+0000 7fbd2aa00640 1 -- 172.21.15.2:0/2121300163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2403d670 con 0x7fbd340ad960 2024-08-17T02:46:52.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.503+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd34159cd0 con 0x7fbd340ad960 2024-08-17T02:46:52.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.503+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3415d8f0 con 0x7fbd340ad960 2024-08-17T02:46:52.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.504+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd34063fb0 con 0x7fbd340ad960 2024-08-17T02:46:52.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.505+0000 7fbd2aa00640 1 -- 172.21.15.2:0/2121300163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbd24039040 con 0x7fbd340ad960 2024-08-17T02:46:52.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.505+0000 7fbd2aa00640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbd14065150 0x7fbd14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:52.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.506+0000 7fbd2aa00640 1 -- 172.21.15.2:0/2121300163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fbd240a21c0 con 0x7fbd340ad960 2024-08-17T02:46:52.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.506+0000 7fbd32a00640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbd14065150 0x7fbd14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:52.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.506+0000 7fbd32a00640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbd14065150 0x7fbd14067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd3406eac0 tx=0x7fbd20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:52.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.509+0000 7fbd2aa00640 1 -- 172.21.15.2:0/2121300163 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbd24070240 con 0x7fbd340ad960 2024-08-17T02:46:52.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:52.731+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbd3415b5e0 con 0x7fbd340ad960 2024-08-17T02:46:53.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.325+0000 7fbd2aa00640 1 -- 172.21.15.2:0/2121300163 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbd3415b5e0 con 0x7fbd340ad960 2024-08-17T02:46:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbd14065150 msgr2=0x7fbd14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbd14065150 0x7fbd14067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd3406eac0 tx=0x7fbd20008040 comp rx=0 tx=0).stop 2024-08-17T02:46:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 msgr2=0x7fbd34143250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd34143250 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbd24035040 tx=0x7fbd24032000 comp rx=0 tx=0).stop 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 shutdown_connections 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbd14065150 0x7fbd14067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbd340ca050 0x7fbd3415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd340add30 0x7fbd34069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 --2- 172.21.15.2:0/2121300163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd340ad960 0x7fbd34143250 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 >> 172.21.15.2:0/2121300163 conn(0x7fbd34066e60 msgr2=0x7fbd340af100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 shutdown_connections 2024-08-17T02:46:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.328+0000 7fbd3a200640 1 -- 172.21.15.2:0/2121300163 wait complete. 2024-08-17T02:46:53.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:46:53.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.501+0000 7f7cda400640 1 Processor -- start 2024-08-17T02:46:53.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.502+0000 7f7cda400640 1 -- start start 2024-08-17T02:46:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cda400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7cd40ad780 0x7f7cd40adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cda400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd40ae6e0 0x7f7cd4157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cda400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd40ca060 con 0x7f7cd40cae20 2024-08-17T02:46:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cda400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd40aead0 con 0x7f7cd40ad780 2024-08-17T02:46:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cda400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40ca340 con 0x7f7cd40ae6e0 2024-08-17T02:46:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cd3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7cd40cae20 0x7f7cd40af6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42578/0 (socket says 172.21.15.2:42578) 2024-08-17T02:46:53.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cd3e00640 1 -- 172.21.15.2:0/3594440491 learned_addr learned my addr 172.21.15.2:0/3594440491 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cd9a00640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd40ae6e0 0x7f7cd4157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cd9000640 1 --2- 172.21.15.2:0/3594440491 >> v2:172.21.15.26:3300/0 conn(0x7f7cd40ad780 0x7f7cd40adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.503+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250999267 0 0) 0x7f7cd40ca060 con 0x7f7cd40cae20 2024-08-17T02:46:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cbc0034e0 con 0x7f7cd40cae20 2024-08-17T02:46:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588263188 0 0) 0x7f7cbc0034e0 con 0x7f7cd40cae20 2024-08-17T02:46:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd40ae6e0 msgr2=0x7f7cd4157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd40ae6e0 0x7f7cd4157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 >> v2:172.21.15.26:3300/0 conn(0x7f7cd40ad780 msgr2=0x7f7cd40adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 --2- 172.21.15.2:0/3594440491 >> v2:172.21.15.26:3300/0 conn(0x7f7cd40ad780 0x7f7cd40adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40ca620 con 0x7f7cd40cae20 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f7cc0001470 con 0x7f7cd40cae20 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 >> v1:172.21.15.2:6789/0 conn(0x7f7cd40cae20 legacy=0x7f7cd40af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cbc003a50 0x7f7cbc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cbc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd40ae6e0 0x7f7cbc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40aead0 con 0x7f7cbc004780 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40ca340 con 0x7f7cbc003a50 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc00ba80 con 0x7f7cd40ae6e0 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd9a00640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd40ae6e0 0x7f7cbc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd3e00640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cbc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.504+0000 7f7cd9000640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cbc003a50 0x7f7cbc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.505+0000 7f7cd3e00640 1 -- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd40ae6e0 msgr2=0x7f7cbc005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.505+0000 7f7cd3e00640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd40ae6e0 0x7f7cbc005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.505+0000 7f7cd3e00640 1 -- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cbc003a50 msgr2=0x7f7cbc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:53.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.505+0000 7f7cd3e00640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cbc003a50 0x7f7cbc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.505+0000 7f7cd3e00640 1 -- 172.21.15.2:0/3594440491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc0034e0 con 0x7f7cbc004780 2024-08-17T02:46:53.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.506+0000 7f7cd3e00640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cbc004bf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c210 tx=0x7f7cc0001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cc2cf7c00c667 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.506+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0005890 con 0x7f7cbc004780 2024-08-17T02:46:53.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.506+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00059f0 con 0x7f7cbc004780 2024-08-17T02:46:53.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.506+0000 7f7cd3400640 1 -- 172.21.15.2:0/3594440491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0005db0 con 0x7f7cbc004780 2024-08-17T02:46:53.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.506+0000 7f7cda400640 1 -- 172.21.15.2:0/3594440491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 msgr2=0x7f7cbc004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.506+0000 7f7cda400640 1 --2- 172.21.15.2:0/3594440491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cbc004bf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c210 tx=0x7f7cc0001dc0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.506+0000 7f7cd9a00640 1 -- 172.21.15.2:0/3594440491 reap_dead start 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.507+0000 7f7cda400640 1 -- 172.21.15.2:0/3594440491 shutdown_connections 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.507+0000 7f7cda400640 1 -- 172.21.15.2:0/3594440491 >> 172.21.15.2:0/3594440491 conn(0x7f7cd4066e60 msgr2=0x7f7cd4067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.507+0000 7f7cda400640 1 -- 172.21.15.2:0/3594440491 shutdown_connections 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.507+0000 7f7cda400640 1 -- 172.21.15.2:0/3594440491 wait complete. 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.508+0000 7f7cda400640 1 Processor -- start 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.508+0000 7f7cda400640 1 -- start start 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cda400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cd414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cda400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cd4150880 0x7f7cd4170440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cda400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd4170980 0x7f7cd4170dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cda400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd4171310 con 0x7f7cbc004780 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cda400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd4153f10 con 0x7f7cd4150880 2024-08-17T02:46:53.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cda400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41519a0 con 0x7f7cd4170980 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cd9000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cd414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cd9000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cd414eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43378/0 (socket says 172.21.15.2:43378) 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.509+0000 7f7cd9000640 1 -- 172.21.15.2:0/575709989 learned_addr learned my addr 172.21.15.2:0/575709989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd3e00640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cd4150880 0x7f7cd4170440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd9000640 1 -- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd4170980 msgr2=0x7f7cd4170dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd9a00640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd4170980 0x7f7cd4170dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd9000640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd4170980 0x7f7cd4170dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd9000640 1 -- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cd4150880 msgr2=0x7f7cd4170440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd9000640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cd4150880 0x7f7cd4170440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd9000640 1 -- 172.21.15.2:0/575709989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd414f3b0 con 0x7f7cbc004780 2024-08-17T02:46:53.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd3e00640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cd4150880 0x7f7cd4170440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:46:53.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cd9000640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cd414eda0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8011b20 tx=0x7f7cc80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cc7e00640 1 -- 172.21.15.2:0/575709989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800fb00 con 0x7f7cbc004780 2024-08-17T02:46:53.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cc7e00640 1 -- 172.21.15.2:0/575709989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc800fc60 con 0x7f7cbc004780 2024-08-17T02:46:53.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cc7e00640 1 -- 172.21.15.2:0/575709989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8014440 con 0x7f7cbc004780 2024-08-17T02:46:53.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd4151070 con 0x7f7cbc004780 2024-08-17T02:46:53.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.510+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd4151630 con 0x7f7cbc004780 2024-08-17T02:46:53.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.511+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd4063f10 con 0x7f7cbc004780 2024-08-17T02:46:53.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.512+0000 7f7cc7e00640 1 -- 172.21.15.2:0/575709989 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7cc8014830 con 0x7f7cbc004780 2024-08-17T02:46:53.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.513+0000 7f7cc7e00640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7cb4065150 0x7f7cb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:53.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.513+0000 7f7cc7e00640 1 -- 172.21.15.2:0/575709989 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f7cc8018030 con 0x7f7cbc004780 2024-08-17T02:46:53.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.513+0000 7f7cd3e00640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7cb4065150 0x7f7cb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:53.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.514+0000 7f7cd3e00640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7cb4065150 0x7f7cb4067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0032000 tx=0x7f7cc0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:53.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.517+0000 7f7cc7e00640 1 -- 172.21.15.2:0/575709989 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7cc80549f0 con 0x7f7cbc004780 2024-08-17T02:46:53.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:53.698+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7cd4157db0 con 0x7f7cbc004780 2024-08-17T02:46:54.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.328+0000 7f7cc7e00640 1 -- 172.21.15.2:0/575709989 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7cc80220d0 con 0x7f7cbc004780 2024-08-17T02:46:54.330 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:46:54.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7cb4065150 msgr2=0x7f7cb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7cb4065150 0x7f7cb4067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0032000 tx=0x7f7cc0030000 comp rx=0 tx=0).stop 2024-08-17T02:46:54.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 msgr2=0x7f7cd414eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cd414eda0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8011b20 tx=0x7f7cc80090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 shutdown_connections 2024-08-17T02:46:54.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7cb4065150 0x7f7cb4067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7cd4170980 0x7f7cd4170dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7cd4150880 0x7f7cd4170440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 --2- 172.21.15.2:0/575709989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cbc004780 0x7f7cd414eda0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 >> 172.21.15.2:0/575709989 conn(0x7f7cd4066e60 msgr2=0x7f7cd40ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 shutdown_connections 2024-08-17T02:46:54.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.332+0000 7f7cda400640 1 -- 172.21.15.2:0/575709989 wait complete. 2024-08-17T02:46:54.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:46:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.519+0000 7ff4ca000640 1 Processor -- start 2024-08-17T02:46:54.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.519+0000 7ff4ca000640 1 -- start start 2024-08-17T02:46:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.520+0000 7ff4ca000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4c40ac000 0x7ff4c4156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.520+0000 7ff4ca000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c40afa00 0x7ff4c40afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.520+0000 7ff4ca000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c4159ad0 con 0x7ff4c40ad020 2024-08-17T02:46:54.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.520+0000 7ff4ca000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40b0380 con 0x7ff4c40ac000 2024-08-17T02:46:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.520+0000 7ff4ca000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4156f40 con 0x7ff4c40afa00 2024-08-17T02:46:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.520+0000 7ff4c2a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff4c40ad020 0x7ff4c4159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42594/0 (socket says 172.21.15.2:42594) 2024-08-17T02:46:54.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2a00640 1 -- 172.21.15.2:0/3872746443 learned_addr learned my addr 172.21.15.2:0/3872746443 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:46:54.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c3400640 1 --2- 172.21.15.2:0/3872746443 >> v2:172.21.15.26:3300/0 conn(0x7ff4c40ac000 0x7ff4c4156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c3e00640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c40afa00 0x7ff4c40afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930669212 0 0) 0x7ff4c4159ad0 con 0x7ff4c40ad020 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a80034e0 con 0x7ff4c40ad020 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773537829 0 0) 0x7ff4a80034e0 con 0x7ff4c40ad020 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c40afa00 msgr2=0x7ff4c40afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c40afa00 0x7ff4c40afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 >> v2:172.21.15.26:3300/0 conn(0x7ff4c40ac000 msgr2=0x7ff4c4156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 --2- 172.21.15.2:0/3872746443 >> v2:172.21.15.26:3300/0 conn(0x7ff4c40ac000 0x7ff4c4156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40ad590 con 0x7ff4c40ad020 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7ff4b0001470 con 0x7ff4c40ad020 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 >> v1:172.21.15.2:6789/0 conn(0x7ff4c40ad020 legacy=0x7ff4c4159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a80039d0 0x7ff4a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a8004780 0x7ff4a8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c40afa00 0x7ff4a8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.521+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40b0380 con 0x7ff4a80039d0 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4156f40 con 0x7ff4a8004780 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a800dbe0 con 0x7ff4c40afa00 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c3400640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a80039d0 0x7ff4a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c2a00640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a8004780 0x7ff4a8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c3e00640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c40afa00 0x7ff4a8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c3400640 1 -- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c40afa00 msgr2=0x7ff4a8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c3400640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c40afa00 0x7ff4a8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c3400640 1 -- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a8004780 msgr2=0x7ff4a8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c3400640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a8004780 0x7ff4a8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.522+0000 7ff4c3400640 1 -- 172.21.15.2:0/3872746443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40ad590 con 0x7ff4a80039d0 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.523+0000 7ff4c3400640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a80039d0 0x7ff4a8003de0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009ba0 tx=0x7ff4b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd4c79117a23852 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.523+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4031400 con 0x7ff4a80039d0 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.523+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b402d050 con 0x7ff4a80039d0 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.523+0000 7ff4c2000640 1 -- 172.21.15.2:0/3872746443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4031790 con 0x7ff4a80039d0 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.524+0000 7ff4ca000640 1 -- 172.21.15.2:0/3872746443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a80039d0 msgr2=0x7ff4a8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.524+0000 7ff4ca000640 1 --2- 172.21.15.2:0/3872746443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4a80039d0 0x7ff4a8003de0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009ba0 tx=0x7ff4b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.524+0000 7ff4c3e00640 1 -- 172.21.15.2:0/3872746443 reap_dead start 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.524+0000 7ff4ca000640 1 -- 172.21.15.2:0/3872746443 shutdown_connections 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.524+0000 7ff4ca000640 1 -- 172.21.15.2:0/3872746443 >> 172.21.15.2:0/3872746443 conn(0x7ff4c4066e60 msgr2=0x7ff4c4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.524+0000 7ff4ca000640 1 -- 172.21.15.2:0/3872746443 shutdown_connections 2024-08-17T02:46:54.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.524+0000 7ff4ca000640 1 -- 172.21.15.2:0/3872746443 wait complete. 2024-08-17T02:46:54.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.525+0000 7ff4ca000640 1 Processor -- start 2024-08-17T02:46:54.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.526+0000 7ff4ca000640 1 -- start start 2024-08-17T02:46:54.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.526+0000 7ff4ca000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a80039d0 0x7ff4c41572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4ca000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c414fcb0 0x7ff4c4158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4ca000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c4157c40 0x7ff4c4165420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4ca000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4157990 con 0x7ff4c4157c40 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4ca000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4164f90 con 0x7ff4a80039d0 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4ca000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41594c0 con 0x7ff4c414fcb0 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c4157c40 0x7ff4c4165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c4157c40 0x7ff4c4165420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43394/0 (socket says 172.21.15.2:43394) 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3e00640 1 -- 172.21.15.2:0/1236666944 learned_addr learned my addr 172.21.15.2:0/1236666944 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3400640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a80039d0 0x7ff4c41572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c2a00640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c414fcb0 0x7ff4c4158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3e00640 1 -- 172.21.15.2:0/1236666944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c414fcb0 msgr2=0x7ff4c4158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3e00640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c414fcb0 0x7ff4c4158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3e00640 1 -- 172.21.15.2:0/1236666944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a80039d0 msgr2=0x7ff4c41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3e00640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a80039d0 0x7ff4c41572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.527+0000 7ff4c3e00640 1 -- 172.21.15.2:0/1236666944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c414dc80 con 0x7ff4c4157c40 2024-08-17T02:46:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.528+0000 7ff4c3e00640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c4157c40 0x7ff4c4165420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4c406d730 tx=0x7ff4bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.528+0000 7ff4baa00640 1 -- 172.21.15.2:0/1236666944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00e070 con 0x7ff4c4157c40 2024-08-17T02:46:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.528+0000 7ff4baa00640 1 -- 172.21.15.2:0/1236666944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc0156b0 con 0x7ff4c4157c40 2024-08-17T02:46:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.528+0000 7ff4baa00640 1 -- 172.21.15.2:0/1236666944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc015a70 con 0x7ff4c4157c40 2024-08-17T02:46:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.528+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c414d6c0 con 0x7ff4c4157c40 2024-08-17T02:46:54.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.528+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c41580b0 con 0x7ff4c4157c40 2024-08-17T02:46:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.529+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c4063fb0 con 0x7ff4c4157c40 2024-08-17T02:46:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.530+0000 7ff4baa00640 1 -- 172.21.15.2:0/1236666944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff4bc016470 con 0x7ff4c4157c40 2024-08-17T02:46:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.531+0000 7ff4baa00640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff4a4065150 0x7ff4a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:46:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.531+0000 7ff4baa00640 1 -- 172.21.15.2:0/1236666944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7ff4bc082720 con 0x7ff4c4157c40 2024-08-17T02:46:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.531+0000 7ff4c3400640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff4a4065150 0x7ff4a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:46:54.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.532+0000 7ff4c3400640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff4a4065150 0x7ff4a4067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4034000 tx=0x7ff4b4035000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:46:54.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.535+0000 7ff4baa00640 1 -- 172.21.15.2:0/1236666944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff4bc050950 con 0x7ff4c4157c40 2024-08-17T02:46:54.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:54.718+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff4c4155960 con 0x7ff4c4157c40 2024-08-17T02:46:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.334+0000 7ff4baa00640 1 -- 172.21.15.2:0/1236666944 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff4bc053f70 con 0x7ff4c4157c40 2024-08-17T02:46:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-08-17T02:46:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.339+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff4a4065150 msgr2=0x7ff4a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.339+0000 7ff4ca000640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff4a4065150 0x7ff4a4067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4034000 tx=0x7ff4b4035000 comp rx=0 tx=0).stop 2024-08-17T02:46:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.339+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c4157c40 msgr2=0x7ff4c4165420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:46:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.339+0000 7ff4ca000640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c4157c40 0x7ff4c4165420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4c406d730 tx=0x7ff4bc00b040 comp rx=0 tx=0).stop 2024-08-17T02:46:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.340+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 shutdown_connections 2024-08-17T02:46:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.340+0000 7ff4ca000640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c4157c40 0x7ff4c4165420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.340+0000 7ff4ca000640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff4a4065150 0x7ff4a4067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.340+0000 7ff4ca000640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4c414fcb0 0x7ff4c4158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.340+0000 7ff4ca000640 1 --2- 172.21.15.2:0/1236666944 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4a80039d0 0x7ff4c41572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:46:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.340+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 >> 172.21.15.2:0/1236666944 conn(0x7ff4c4066e60 msgr2=0x7ff4c406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:46:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.340+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 shutdown_connections 2024-08-17T02:46:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:46:55.340+0000 7ff4ca000640 1 -- 172.21.15.2:0/1236666944 wait complete. 2024-08-17T02:46:55.359 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:46:55.359 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:46:55.360 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:46:55.360 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:46:55.360 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:46:55.360 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:46:55.360 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:46:55.360 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:46:55.360 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:46:55.361 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:46:55.361 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:46:55.361 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:46:55.361 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:46:55.361 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:46:55.361 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:46:55.361 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:46:55.374 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:46:55.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:46:55.376 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:46:55.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:46:55.379 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:46:55.379 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:46:55.419 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:46:55.420 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:55.422 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:46:55.422 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:55.423 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:46:55.423 DEBUG:teuthology.parallel:result is None 2024-08-17T02:46:55.546 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-08-17T02:46:55.546 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-08-17T02:46:55.551 INFO:tasks.ceph.mds.b.smithi026.stdout:starting mds.b at 2024-08-17T02:47:00.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-08-17T02:47:01.384 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:47:01.385 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:47:01.391 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:47:01.391 DEBUG:teuthology.parallel:result is None 2024-08-17T02:47:01.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:47:01.522 INFO:tasks.ceph.mds.d.smithi026.stdout:starting mds.d at 2024-08-17T02:47:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.554+0000 7fb991a00640 1 Processor -- start 2024-08-17T02:47:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.554+0000 7fb991a00640 1 -- start start 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.555+0000 7fb991a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c0afca0 0x7fb98c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.555+0000 7fb991a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb98c0acf10 0x7fb98c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.555+0000 7fb991a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb98c15a4e0 con 0x7fb98c1589a0 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.555+0000 7fb991a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98c0b0980 con 0x7fb98c0acf10 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.555+0000 7fb991a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c0c92b0 con 0x7fb98c0afca0 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.556+0000 7fb98a000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb98c0acf10 0x7fb98c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.556+0000 7fb98b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb98c1589a0 0x7fb98c06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42616/0 (socket says 172.21.15.2:42616) 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.556+0000 7fb98b400640 1 -- 172.21.15.2:0/4140276998 learned_addr learned my addr 172.21.15.2:0/4140276998 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.556+0000 7fb98aa00640 1 --2- 172.21.15.2:0/4140276998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c0afca0 0x7fb98c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.556+0000 7fb98a000640 1 -- 172.21.15.2:0/4140276998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c0afca0 msgr2=0x7fb98c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:01.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.556+0000 7fb98a000640 1 --2- 172.21.15.2:0/4140276998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c0afca0 0x7fb98c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.556+0000 7fb98a000640 1 -- 172.21.15.2:0/4140276998 >> v1:172.21.15.2:6789/0 conn(0x7fb98c1589a0 legacy=0x7fb98c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.556+0000 7fb98a000640 1 -- 172.21.15.2:0/4140276998 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c0ad480 con 0x7fb98c0acf10 2024-08-17T02:47:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.557+0000 7fb98a000640 1 --2- 172.21.15.2:0/4140276998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c159fa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb978009880 tx=0x7fb9780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa06e3e7cccab51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.557+0000 7fb989600640 1 -- 172.21.15.2:0/4140276998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97802ad70 con 0x7fb98c0acf10 2024-08-17T02:47:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.557+0000 7fb989600640 1 -- 172.21.15.2:0/4140276998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978032440 con 0x7fb98c0acf10 2024-08-17T02:47:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.557+0000 7fb989600640 1 -- 172.21.15.2:0/4140276998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978032820 con 0x7fb98c0acf10 2024-08-17T02:47:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.558+0000 7fb991a00640 1 -- 172.21.15.2:0/4140276998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 msgr2=0x7fb98c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.558+0000 7fb991a00640 1 --2- 172.21.15.2:0/4140276998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c159fa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb978009880 tx=0x7fb9780090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.558+0000 7fb991a00640 1 -- 172.21.15.2:0/4140276998 shutdown_connections 2024-08-17T02:47:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.558+0000 7fb991a00640 1 --2- 172.21.15.2:0/4140276998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c159fa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.558+0000 7fb991a00640 1 --2- 172.21.15.2:0/4140276998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c0afca0 0x7fb98c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.558+0000 7fb991a00640 1 -- 172.21.15.2:0/4140276998 >> 172.21.15.2:0/4140276998 conn(0x7fb98c066e60 msgr2=0x7fb98c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.558+0000 7fb991a00640 1 -- 172.21.15.2:0/4140276998 shutdown_connections 2024-08-17T02:47:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.558+0000 7fb991a00640 1 -- 172.21.15.2:0/4140276998 wait complete. 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.559+0000 7fb991a00640 1 Processor -- start 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.560+0000 7fb991a00640 1 -- start start 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.560+0000 7fb991a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.560+0000 7fb991a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb98c0afca0 0x7fb98c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.560+0000 7fb991a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c1589a0 0x7fb98c144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb991a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c14cfd0 con 0x7fb98c0acf10 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb991a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c14c3c0 con 0x7fb98c0afca0 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb991a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c14c6a0 con 0x7fb98c1589a0 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c14bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43432/0 (socket says 172.21.15.2:43432) 2024-08-17T02:47:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98aa00640 1 -- 172.21.15.2:0/3782229138 learned_addr learned my addr 172.21.15.2:0/3782229138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98a000640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb98c0afca0 0x7fb98c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98b400640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c1589a0 0x7fb98c144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98aa00640 1 -- 172.21.15.2:0/3782229138 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c1589a0 msgr2=0x7fb98c144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98aa00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c1589a0 0x7fb98c144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98aa00640 1 -- 172.21.15.2:0/3782229138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb98c0afca0 msgr2=0x7fb98c14db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98aa00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb98c0afca0 0x7fb98c14db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.561+0000 7fb98aa00640 1 -- 172.21.15.2:0/3782229138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978009390 con 0x7fb98c0acf10 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.562+0000 7fb98aa00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c14bd80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00d890 tx=0x7fb97c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.562+0000 7fb982000640 1 -- 172.21.15.2:0/3782229138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00de20 con 0x7fb98c0acf10 2024-08-17T02:47:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.562+0000 7fb982000640 1 -- 172.21.15.2:0/3782229138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c00b8d0 con 0x7fb98c0acf10 2024-08-17T02:47:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.562+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c14c980 con 0x7fb98c0acf10 2024-08-17T02:47:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.562+0000 7fb982000640 1 -- 172.21.15.2:0/3782229138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00bc70 con 0x7fb98c0acf10 2024-08-17T02:47:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.562+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c14e070 con 0x7fb98c0acf10 2024-08-17T02:47:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.563+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c063fb0 con 0x7fb98c0acf10 2024-08-17T02:47:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.564+0000 7fb982000640 1 -- 172.21.15.2:0/3782229138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb97c014640 con 0x7fb98c0acf10 2024-08-17T02:47:01.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.565+0000 7fb982000640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb96c065180 0x7fb96c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:01.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.565+0000 7fb982000640 1 -- 172.21.15.2:0/3782229138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb97c0825f0 con 0x7fb98c0acf10 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.565+0000 7fb98a000640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb96c065180 0x7fb96c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:01.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.566+0000 7fb98a000640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb96c065180 0x7fb96c067630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb978034000 tx=0x7fb978032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:01.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.569+0000 7fb982000640 1 -- 172.21.15.2:0/3782229138 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb97c050a80 con 0x7fb98c0acf10 2024-08-17T02:47:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:01.763+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb98c067b70 con 0x7fb98c0acf10 2024-08-17T02:47:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.358+0000 7fb982000640 1 -- 172.21.15.2:0/3782229138 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb97c0540a0 con 0x7fb98c0acf10 2024-08-17T02:47:03.359 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2024-08-17T02:47:03.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb96c065180 msgr2=0x7fb96c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb96c065180 0x7fb96c067630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb978034000 tx=0x7fb978032000 comp rx=0 tx=0).stop 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 msgr2=0x7fb98c14bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c14bd80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00d890 tx=0x7fb97c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 shutdown_connections 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb96c065180 0x7fb96c067630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb98c1589a0 0x7fb98c144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb98c0afca0 0x7fb98c14db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 --2- 172.21.15.2:0/3782229138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb98c0acf10 0x7fb98c14bd80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.361+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 >> 172.21.15.2:0/3782229138 conn(0x7fb98c066e60 msgr2=0x7fb98c0ca830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.362+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 shutdown_connections 2024-08-17T02:47:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.362+0000 7fb991a00640 1 -- 172.21.15.2:0/3782229138 wait complete. 2024-08-17T02:47:03.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:47:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.536+0000 7fb3bfa00640 1 Processor -- start 2024-08-17T02:47:03.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.536+0000 7fb3bfa00640 1 -- start start 2024-08-17T02:47:03.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.537+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80acf10 0x7fb3b80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.537+0000 7fb3bfa00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b80c92b0 con 0x7fb3b80afca0 2024-08-17T02:47:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.537+0000 7fb3bfa00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b80ad480 con 0x7fb3b81590b0 2024-08-17T02:47:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.537+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80b0980 con 0x7fb3b80acf10 2024-08-17T02:47:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3bd000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb3b80afca0 0x7fb3b81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48008/0 (socket says 172.21.15.2:48008) 2024-08-17T02:47:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3bd000640 1 -- 172.21.15.2:0/3207954613 learned_addr learned my addr 172.21.15.2:0/3207954613 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:03.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3bda00640 1 --2- 172.21.15.2:0/3207954613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80acf10 0x7fb3b80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3b7400640 1 -- 172.21.15.2:0/3207954613 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187440698 0 0) 0x7fb3b80c92b0 con 0x7fb3b80afca0 2024-08-17T02:47:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3b7400640 1 -- 172.21.15.2:0/3207954613 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3a00034e0 con 0x7fb3b80afca0 2024-08-17T02:47:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3b7400640 1 -- 172.21.15.2:0/3207954613 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249103122 0 0) 0x7fb3b80ad480 con 0x7fb3b81590b0 2024-08-17T02:47:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3b7400640 1 -- 172.21.15.2:0/3207954613 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b80c92b0 con 0x7fb3b81590b0 2024-08-17T02:47:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3bda00640 1 -- 172.21.15.2:0/3207954613 >> v1:172.21.15.26:6789/0 conn(0x7fb3b81590b0 legacy=0x7fb3b80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3bda00640 1 -- 172.21.15.2:0/3207954613 >> v1:172.21.15.2:6789/0 conn(0x7fb3b80afca0 legacy=0x7fb3b81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.538+0000 7fb3bda00640 1 -- 172.21.15.2:0/3207954613 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b80ad760 con 0x7fb3b80acf10 2024-08-17T02:47:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.539+0000 7fb3bda00640 1 --2- 172.21.15.2:0/3207954613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80acf10 0x7fb3b80b0070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009e90 tx=0x7fb3b0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bf4c250542fbb19 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3b7400640 1 -- 172.21.15.2:0/3207954613 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0007550 con 0x7fb3b80acf10 2024-08-17T02:47:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3b7400640 1 -- 172.21.15.2:0/3207954613 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b002d050 con 0x7fb3b80acf10 2024-08-17T02:47:03.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3b7400640 1 -- 172.21.15.2:0/3207954613 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00078e0 con 0x7fb3b80acf10 2024-08-17T02:47:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3bfa00640 1 -- 172.21.15.2:0/3207954613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80acf10 msgr2=0x7fb3b80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3bfa00640 1 --2- 172.21.15.2:0/3207954613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80acf10 0x7fb3b80b0070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009e90 tx=0x7fb3b0009780 comp rx=0 tx=0).stop 2024-08-17T02:47:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3bfa00640 1 -- 172.21.15.2:0/3207954613 shutdown_connections 2024-08-17T02:47:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3bfa00640 1 --2- 172.21.15.2:0/3207954613 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80acf10 0x7fb3b80b0070 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3bfa00640 1 -- 172.21.15.2:0/3207954613 >> 172.21.15.2:0/3207954613 conn(0x7fb3b8066e60 msgr2=0x7fb3b8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3bfa00640 1 -- 172.21.15.2:0/3207954613 shutdown_connections 2024-08-17T02:47:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.540+0000 7fb3bfa00640 1 -- 172.21.15.2:0/3207954613 wait complete. 2024-08-17T02:47:03.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.542+0000 7fb3bfa00640 1 Processor -- start 2024-08-17T02:47:03.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.542+0000 7fb3bfa00640 1 -- start start 2024-08-17T02:47:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3b80acf10 0x7fb3b80a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80afca0 0x7fb3b80cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bfa00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b81590b0 0x7fb3b80c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8157b90 con 0x7fb3b80acf10 2024-08-17T02:47:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b81580c0 con 0x7fb3b81590b0 2024-08-17T02:47:03.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bfa00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8157de0 con 0x7fb3b80afca0 2024-08-17T02:47:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bd000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3b80acf10 0x7fb3b80a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bd000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3b80acf10 0x7fb3b80a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52654/0 (socket says 172.21.15.2:52654) 2024-08-17T02:47:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bd000640 1 -- 172.21.15.2:0/830764585 learned_addr learned my addr 172.21.15.2:0/830764585 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3bda00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b81590b0 0x7fb3b80c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.543+0000 7fb3b7e00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80afca0 0x7fb3b80cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bd000640 1 -- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80afca0 msgr2=0x7fb3b80cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bd000640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80afca0 0x7fb3b80cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bd000640 1 -- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b81590b0 msgr2=0x7fb3b80c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bd000640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b81590b0 0x7fb3b80c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bd000640 1 -- 172.21.15.2:0/830764585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b0009a20 con 0x7fb3b80acf10 2024-08-17T02:47:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bda00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b81590b0 0x7fb3b80c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bd000640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3b80acf10 0x7fb3b80a44d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac005840 tx=0x7fb3ac007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3abe00640 1 -- 172.21.15.2:0/830764585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac005aa0 con 0x7fb3b80acf10 2024-08-17T02:47:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3abe00640 1 -- 172.21.15.2:0/830764585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac005c00 con 0x7fb3b80acf10 2024-08-17T02:47:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3abe00640 1 -- 172.21.15.2:0/830764585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac0070f0 con 0x7fb3b80acf10 2024-08-17T02:47:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b80c5730 con 0x7fb3b80acf10 2024-08-17T02:47:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.544+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b80c6470 con 0x7fb3b80acf10 2024-08-17T02:47:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.546+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b8063fb0 con 0x7fb3b80acf10 2024-08-17T02:47:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.546+0000 7fb3abe00640 1 -- 172.21.15.2:0/830764585 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb3ac007520 con 0x7fb3b80acf10 2024-08-17T02:47:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.548+0000 7fb3abe00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb398065150 0x7fb398067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.548+0000 7fb3abe00640 1 -- 172.21.15.2:0/830764585 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb3ac081b30 con 0x7fb3b80acf10 2024-08-17T02:47:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.548+0000 7fb3b7e00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb398065150 0x7fb398067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.548+0000 7fb3b7e00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb398065150 0x7fb398067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80c6fa0 tx=0x7fb3a4007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.552+0000 7fb3abe00640 1 -- 172.21.15.2:0/830764585 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3ac04ffd0 con 0x7fb3b80acf10 2024-08-17T02:47:03.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.800+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb3b8067b70 con 0x7fb3b80acf10 2024-08-17T02:47:03.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.801+0000 7fb3abe00640 1 -- 172.21.15.2:0/830764585 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb3ac0535f0 con 0x7fb3b80acf10 2024-08-17T02:47:03.802 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:03.802 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:47:03.802 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2024-08-17T02:47:03.802 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.802 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2024-08-17T02:47:03.802 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC4DsBmkIgGCRAAHgkFzhKVZXp+Lg9uGfDT9g==", 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2024-08-17T02:47:03.803 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC4DsBmQGZOHBAAGJfje6uIKi+s18vWnBwUFg==", 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC4DsBmE9u4EhAAnLpJu3rbH+j/4MRz7IcpOw==", 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.804 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC4DsBmIsDWJRAA0/H8/wdkzVWO0YQdxRP6Aw==", 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.805 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC6DsBmNdkwFxAAY2sxwcscxR+693f36biudQ==", 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:47:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC9DsBm94fdGxAArxvOmrVN2iDV5ezP9a9csw==", 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDADsBmTxpzIBAAUOW545GGGfz2CWl06hM5Eg==", 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2024-08-17T02:47:03.808 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDDDsBmpiMGJBAAc729WEParLg877Gi8XQoug==", 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDHDsBmA8mhNRAAyBLucpoOYminNKSe67Rv9Q==", 2024-08-17T02:47:03.809 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:03.810 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:47:03.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.810 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.810 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDKDsBm7LOeORAA2ynGp358kl6e1s22ovsscg==", 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:47:03.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDODsBmoYO8ARAA8q67190yaWJMITQ8W6bLUQ==", 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.812 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDRDsBmUBgYBRAA+ZF39JSTLaD4UQoLr2hIQg==", 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2024-08-17T02:47:03.813 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC4DsBmeaVPLhAA4c5JYYf5xIEIHiiZ4hSj4A==", 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC4DsBmoaW+OhAArHgs4dD4M7fBfhmeKrANYg==", 2024-08-17T02:47:03.814 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC4DsBmdeCDNBAAb7yShKQLCct3tplRYDlSOg==", 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.815 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC5DsBm8+QzBRAAW+HJI9Nz5NZNnGTAol4dpQ==", 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-08-17T02:47:03.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC3DsBmcMsQFhAAnSGXnOmyI6KFQ2xyK44Gbg==", 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDiDsBmODSpHBAAHe/PQMAOyvHrPIvOWEG4sw==", 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDiDsBmTj+pHBAAeVa5llLnvNLg7XTenN8PTg==", 2024-08-17T02:47:03.818 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDiDsBmzkqpHBAAPesptRKQY/7JKXJNl7MoOQ==", 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDiDsBmVVSpHBAAnLpGbwLmpQrXmPIfHq2lCQ==", 2024-08-17T02:47:03.819 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDiDsBmrlypHBAAJbB4FnnvKSoJR/mnMBnWDw==", 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.820 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQDiDsBmhWWpHBAAIGGLc+Or1NkBQsvYizOo7g==", 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC4DsBmtFXJAhAAMUs6joGZYEQfs9njc6ZP0g==", 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQC3DsBmxKXLNxAAziyp5inxsVr1mysLraQhlA==", 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-08-17T02:47:03.822 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:47:03.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb398065150 msgr2=0x7fb398067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb398065150 0x7fb398067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80c6fa0 tx=0x7fb3a4007cc0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3b80acf10 msgr2=0x7fb3b80a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3b80acf10 0x7fb3b80a44d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac005840 tx=0x7fb3ac007df0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 shutdown_connections 2024-08-17T02:47:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3b81590b0 0x7fb3b80c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb398065150 0x7fb398067600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb3b80afca0 0x7fb3b80cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 --2- 172.21.15.2:0/830764585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3b80acf10 0x7fb3b80a44d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 >> 172.21.15.2:0/830764585 conn(0x7fb3b8066e60 msgr2=0x7fb3b80caab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 shutdown_connections 2024-08-17T02:47:03.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.803+0000 7fb3bfa00640 1 -- 172.21.15.2:0/830764585 wait complete. 2024-08-17T02:47:03.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:47:03.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.976+0000 7efd8aa00640 1 Processor -- start 2024-08-17T02:47:03.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.977+0000 7efd8aa00640 1 -- start start 2024-08-17T02:47:03.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd8aa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd840ae540 0x7efd84068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd8aa00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efd84068e90 0x7efd840ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd8aa00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd840aab10 con 0x7efd840aee50 2024-08-17T02:47:03.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd8aa00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd840ac250 con 0x7efd840ae540 2024-08-17T02:47:03.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd8aa00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd840693e0 con 0x7efd84068e90 2024-08-17T02:47:03.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd89600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd840ae540 0x7efd84068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd8a000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efd840aee50 0x7efd840aafa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48012/0 (socket says 172.21.15.2:48012) 2024-08-17T02:47:03.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd8a000640 1 -- 172.21.15.2:0/2993899932 learned_addr learned my addr 172.21.15.2:0/2993899932 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:03.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd89600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd840ae540 0x7efd84068950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52670/0 (socket says 172.21.15.2:52670) 2024-08-17T02:47:03.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.978+0000 7efd88c00640 1 --2- 172.21.15.2:0/2993899932 >> v2:172.21.15.26:3300/0 conn(0x7efd84068e90 0x7efd840ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.979+0000 7efd89600640 1 -- 172.21.15.2:0/2993899932 >> v2:172.21.15.26:3300/0 conn(0x7efd84068e90 msgr2=0x7efd840ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:03.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.979+0000 7efd89600640 1 --2- 172.21.15.2:0/2993899932 >> v2:172.21.15.26:3300/0 conn(0x7efd84068e90 0x7efd840ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.979+0000 7efd89600640 1 -- 172.21.15.2:0/2993899932 >> v1:172.21.15.2:6789/0 conn(0x7efd840aee50 legacy=0x7efd840aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.979+0000 7efd83e00640 1 -- 172.21.15.2:0/2993899932 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578599666 0 0) 0x7efd840aab10 con 0x7efd840aee50 2024-08-17T02:47:03.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.979+0000 7efd89600640 1 -- 172.21.15.2:0/2993899932 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840696c0 con 0x7efd840ae540 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.980+0000 7efd89600640 1 --2- 172.21.15.2:0/2993899932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84068950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efd8406f4a0 tx=0x7efd780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5062edfbddb8b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.980+0000 7efd83e00640 1 -- 172.21.15.2:0/2993899932 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7802ad20 con 0x7efd840ae540 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.980+0000 7efd83e00640 1 -- 172.21.15.2:0/2993899932 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7802ae80 con 0x7efd840ae540 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.980+0000 7efd83e00640 1 -- 172.21.15.2:0/2993899932 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78032670 con 0x7efd840ae540 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.981+0000 7efd8aa00640 1 -- 172.21.15.2:0/2993899932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 msgr2=0x7efd84068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.981+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2993899932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84068950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efd8406f4a0 tx=0x7efd780090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.981+0000 7efd8aa00640 1 -- 172.21.15.2:0/2993899932 shutdown_connections 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.981+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2993899932 >> v2:172.21.15.26:3300/0 conn(0x7efd84068e90 0x7efd840ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.981+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2993899932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84068950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.981+0000 7efd8aa00640 1 -- 172.21.15.2:0/2993899932 >> 172.21.15.2:0/2993899932 conn(0x7efd840ce400 msgr2=0x7efd84095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.981+0000 7efd8aa00640 1 -- 172.21.15.2:0/2993899932 shutdown_connections 2024-08-17T02:47:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.981+0000 7efd8aa00640 1 -- 172.21.15.2:0/2993899932 wait complete. 2024-08-17T02:47:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.982+0000 7efd8aa00640 1 Processor -- start 2024-08-17T02:47:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.982+0000 7efd8aa00640 1 -- start start 2024-08-17T02:47:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd8aa00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd84068e90 0x7efd84146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd8aa00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd840aee50 0x7efd840b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd8aa00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84148060 con 0x7efd840ae540 2024-08-17T02:47:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd8aa00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84147180 con 0x7efd840aee50 2024-08-17T02:47:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd8aa00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd84147450 con 0x7efd84068e90 2024-08-17T02:47:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd88c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd88c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52682/0 (socket says 172.21.15.2:52682) 2024-08-17T02:47:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.983+0000 7efd88c00640 1 -- 172.21.15.2:0/2539388354 learned_addr learned my addr 172.21.15.2:0/2539388354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd89600640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd84068e90 0x7efd84146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd8a000640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd840aee50 0x7efd840b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd88c00640 1 -- 172.21.15.2:0/2539388354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd84068e90 msgr2=0x7efd84146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd88c00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd84068e90 0x7efd84146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd88c00640 1 -- 172.21.15.2:0/2539388354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd840aee50 msgr2=0x7efd840b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd88c00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd840aee50 0x7efd840b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd88c00640 1 -- 172.21.15.2:0/2539388354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009390 con 0x7efd840ae540 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd88c00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84146c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efd7000e900 tx=0x7efd700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.984+0000 7efd80c00640 1 -- 172.21.15.2:0/2539388354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000c8e0 con 0x7efd840ae540 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.985+0000 7efd80c00640 1 -- 172.21.15.2:0/2539388354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000ca40 con 0x7efd840ae540 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.985+0000 7efd80c00640 1 -- 172.21.15.2:0/2539388354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000cde0 con 0x7efd840ae540 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.985+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd84147730 con 0x7efd840ae540 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.985+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd84147cf0 con 0x7efd840ae540 2024-08-17T02:47:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.986+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd84148210 con 0x7efd840ae540 2024-08-17T02:47:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.986+0000 7efd80c00640 1 -- 172.21.15.2:0/2539388354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efd70013680 con 0x7efd840ae540 2024-08-17T02:47:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.987+0000 7efd80c00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efd64065150 0x7efd64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.987+0000 7efd80c00640 1 -- 172.21.15.2:0/2539388354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efd700822a0 con 0x7efd840ae540 2024-08-17T02:47:03.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.988+0000 7efd89600640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efd64065150 0x7efd64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:03.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.988+0000 7efd89600640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efd64065150 0x7efd64067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd78034000 tx=0x7efd78032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:03.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:03.991+0000 7efd80c00640 1 -- 172.21.15.2:0/2539388354 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efd84148210 con 0x7efd840ae540 2024-08-17T02:47:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.242+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7efd84148210 con 0x7efd840ae540 2024-08-17T02:47:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.246+0000 7efd80c00640 1 -- 172.21.15.2:0/2539388354 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7efd84148210 con 0x7efd840ae540 2024-08-17T02:47:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efd64065150 msgr2=0x7efd64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efd64065150 0x7efd64067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd78034000 tx=0x7efd78032000 comp rx=0 tx=0).stop 2024-08-17T02:47:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 msgr2=0x7efd84146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84146c40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efd7000e900 tx=0x7efd700090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 shutdown_connections 2024-08-17T02:47:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd840aee50 0x7efd840b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd840ae540 0x7efd84146c40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7efd64065150 0x7efd64067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 --2- 172.21.15.2:0/2539388354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7efd84068e90 0x7efd84146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 >> 172.21.15.2:0/2539388354 conn(0x7efd840ce400 msgr2=0x7efd8406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 shutdown_connections 2024-08-17T02:47:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.249+0000 7efd8aa00640 1 -- 172.21.15.2:0/2539388354 wait complete. 2024-08-17T02:47:04.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:47:04.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.419+0000 7ff49dc00640 1 Processor -- start 2024-08-17T02:47:04.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.419+0000 7ff49dc00640 1 -- start start 2024-08-17T02:47:04.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.420+0000 7ff49dc00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff4980afca0 0x7ff4980b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.420+0000 7ff49dc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff4980acf10 0x7ff498159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.420+0000 7ff49dc00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4981589a0 0x7ff498158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.420+0000 7ff49dc00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4980b0980 con 0x7ff4980acf10 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.420+0000 7ff49dc00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49815a4e0 con 0x7ff4980afca0 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.420+0000 7ff49dc00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980c92b0 con 0x7ff4981589a0 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.420+0000 7ff48fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff4980acf10 0x7ff498159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff48fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff4980acf10 0x7ff498159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52696/0 (socket says 172.21.15.2:52696) 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff48fe00640 1 -- 172.21.15.2:0/747366735 learned_addr learned my addr 172.21.15.2:0/747366735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff497400640 1 --2- 172.21.15.2:0/747366735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4981589a0 0x7ff498158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff496a00640 1 --2- 172.21.15.2:0/747366735 >> v2:172.21.15.26:3300/0 conn(0x7ff4980afca0 0x7ff4980b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff48fe00640 1 -- 172.21.15.2:0/747366735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4981589a0 msgr2=0x7ff498158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff48fe00640 1 --2- 172.21.15.2:0/747366735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4981589a0 0x7ff498158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff48fe00640 1 -- 172.21.15.2:0/747366735 >> v2:172.21.15.26:3300/0 conn(0x7ff4980afca0 msgr2=0x7ff4980b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff48fe00640 1 --2- 172.21.15.2:0/747366735 >> v2:172.21.15.26:3300/0 conn(0x7ff4980afca0 0x7ff4980b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.421+0000 7ff48fe00640 1 -- 172.21.15.2:0/747366735 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498159360 con 0x7ff4980acf10 2024-08-17T02:47:04.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.422+0000 7ff48fe00640 1 --2- 172.21.15.2:0/747366735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4980acf10 0x7ff498159fa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff498067e40 tx=0x7ff4800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7be9e1b882af70 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.422+0000 7ff496000640 1 -- 172.21.15.2:0/747366735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48002add0 con 0x7ff4980acf10 2024-08-17T02:47:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.422+0000 7ff496000640 1 -- 172.21.15.2:0/747366735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480032440 con 0x7ff4980acf10 2024-08-17T02:47:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.422+0000 7ff496000640 1 -- 172.21.15.2:0/747366735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480032820 con 0x7ff4980acf10 2024-08-17T02:47:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 -- 172.21.15.2:0/747366735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4980acf10 msgr2=0x7ff498159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 --2- 172.21.15.2:0/747366735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4980acf10 0x7ff498159fa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff498067e40 tx=0x7ff4800091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 -- 172.21.15.2:0/747366735 shutdown_connections 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 --2- 172.21.15.2:0/747366735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4981589a0 0x7ff498158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 --2- 172.21.15.2:0/747366735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4980acf10 0x7ff498159fa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 --2- 172.21.15.2:0/747366735 >> v2:172.21.15.26:3300/0 conn(0x7ff4980afca0 0x7ff4980b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 -- 172.21.15.2:0/747366735 >> 172.21.15.2:0/747366735 conn(0x7ff498066e60 msgr2=0x7ff498067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 -- 172.21.15.2:0/747366735 shutdown_connections 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.423+0000 7ff49dc00640 1 -- 172.21.15.2:0/747366735 wait complete. 2024-08-17T02:47:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.424+0000 7ff49dc00640 1 Processor -- start 2024-08-17T02:47:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.425+0000 7ff49dc00640 1 -- start start 2024-08-17T02:47:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.425+0000 7ff49dc00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4980acf10 0x7ff498151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.425+0000 7ff49dc00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4980afca0 0x7ff4980c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.425+0000 7ff49dc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4981589a0 0x7ff4980c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.425+0000 7ff49dc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980c09f0 con 0x7ff4981589a0 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.425+0000 7ff49dc00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980c1290 con 0x7ff4980afca0 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.425+0000 7ff49dc00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498157420 con 0x7ff4980acf10 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff497400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4981589a0 0x7ff4980c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4980afca0 0x7ff4980c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4980afca0 0x7ff4980c33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:49810/0 (socket says 172.21.15.2:49810) 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff497400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4981589a0 0x7ff4980c38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52704/0 (socket says 172.21.15.2:52704) 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 -- 172.21.15.2:0/3859193735 learned_addr learned my addr 172.21.15.2:0/3859193735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff496a00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4980acf10 0x7ff498151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 -- 172.21.15.2:0/3859193735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4980acf10 msgr2=0x7ff498151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4980acf10 0x7ff498151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 -- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4981589a0 msgr2=0x7ff4980c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4981589a0 0x7ff4980c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 -- 172.21.15.2:0/3859193735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009450 con 0x7ff4980afca0 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff497400640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4981589a0 0x7ff4980c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.426+0000 7ff48fe00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4980afca0 0x7ff4980c33a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff480009210 tx=0x7ff480032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.427+0000 7ff48e000640 1 -- 172.21.15.2:0/3859193735 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480031bb0 con 0x7ff4980afca0 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.427+0000 7ff48e000640 1 -- 172.21.15.2:0/3859193735 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480031d30 con 0x7ff4980afca0 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.427+0000 7ff48e000640 1 -- 172.21.15.2:0/3859193735 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480031ea0 con 0x7ff4980afca0 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.427+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4980c0c40 con 0x7ff4980afca0 2024-08-17T02:47:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.427+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4981523d0 con 0x7ff4980afca0 2024-08-17T02:47:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.428+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4980c1420 con 0x7ff4980afca0 2024-08-17T02:47:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.429+0000 7ff48e000640 1 -- 172.21.15.2:0/3859193735 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff480039040 con 0x7ff4980afca0 2024-08-17T02:47:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.430+0000 7ff48e000640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff474065150 0x7ff474067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.430+0000 7ff48e000640 1 -- 172.21.15.2:0/3859193735 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff4800a21c0 con 0x7ff4980afca0 2024-08-17T02:47:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.430+0000 7ff496a00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff474065150 0x7ff474067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.431+0000 7ff496a00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff474065150 0x7ff474067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff488009d20 tx=0x7ff4880090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.433+0000 7ff48e000640 1 -- 172.21.15.2:0/3859193735 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff480070660 con 0x7ff4980afca0 2024-08-17T02:47:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.688+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff498063fb0 con 0x7ff4980afca0 2024-08-17T02:47:04.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.692+0000 7ff48e000640 1 -- 172.21.15.2:0/3859193735 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff4800420a0 con 0x7ff4980afca0 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff474065150 msgr2=0x7ff474067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff474065150 0x7ff474067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff488009d20 tx=0x7ff4880090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4980afca0 msgr2=0x7ff4980c33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4980afca0 0x7ff4980c33a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff480009210 tx=0x7ff480032000 comp rx=0 tx=0).stop 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 shutdown_connections 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4981589a0 0x7ff4980c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff4980afca0 0x7ff4980c33a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff474065150 0x7ff474067600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.694+0000 7ff49dc00640 1 --2- 172.21.15.2:0/3859193735 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff4980acf10 0x7ff498151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.695+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 >> 172.21.15.2:0/3859193735 conn(0x7ff498066e60 msgr2=0x7ff4980cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.695+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 shutdown_connections 2024-08-17T02:47:04.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.695+0000 7ff49dc00640 1 -- 172.21.15.2:0/3859193735 wait complete. 2024-08-17T02:47:04.711 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:47:04.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.862+0000 7f9926400640 1 Processor -- start 2024-08-17T02:47:04.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.862+0000 7f9926400640 1 -- start start 2024-08-17T02:47:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.863+0000 7f9926400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f99200afca0 0x7f99200b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.863+0000 7f9926400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99201590b0 0x7f9920159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.863+0000 7f9926400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992015a4e0 con 0x7f99200acf10 2024-08-17T02:47:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.863+0000 7f9926400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200b0980 con 0x7f99200afca0 2024-08-17T02:47:04.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.863+0000 7f9926400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c92b0 con 0x7f99201590b0 2024-08-17T02:47:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991f400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f99200afca0 0x7f99200b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99201590b0 0x7f9920159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991f400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f99200afca0 0x7f99200b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:49826/0 (socket says 172.21.15.2:49826) 2024-08-17T02:47:04.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991f400640 1 -- 172.21.15.2:0/3373569369 learned_addr learned my addr 172.21.15.2:0/3373569369 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:04.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991f400640 1 -- 172.21.15.2:0/3373569369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99201590b0 msgr2=0x7f9920159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:04.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991f400640 1 --2- 172.21.15.2:0/3373569369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99201590b0 0x7f9920159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991f400640 1 -- 172.21.15.2:0/3373569369 >> v1:172.21.15.26:6789/0 conn(0x7f99200acf10 legacy=0x7f99201589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991f400640 1 -- 172.21.15.2:0/3373569369 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200ad480 con 0x7f99200afca0 2024-08-17T02:47:04.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991e000640 1 -- 172.21.15.2:0/3373569369 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229403824 0 0) 0x7f990c001110 con 0x7f99200acf10 2024-08-17T02:47:04.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.864+0000 7f991fe00640 1 --2- 172.21.15.2:0/3373569369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99201590b0 0x7f9920159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.865+0000 7f991f400640 1 --2- 172.21.15.2:0/3373569369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99200afca0 0x7f99200b0070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9910009910 tx=0x7f99100091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd6d178a34b9257 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f991e000640 1 -- 172.21.15.2:0/3373569369 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991002ae40 con 0x7f99200afca0 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f991e000640 1 -- 172.21.15.2:0/3373569369 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910032440 con 0x7f99200afca0 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f991e000640 1 -- 172.21.15.2:0/3373569369 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100327e0 con 0x7f99200afca0 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f9926400640 1 -- 172.21.15.2:0/3373569369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99200afca0 msgr2=0x7f99200b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f9926400640 1 --2- 172.21.15.2:0/3373569369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99200afca0 0x7f99200b0070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9910009910 tx=0x7f99100091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f9926400640 1 -- 172.21.15.2:0/3373569369 shutdown_connections 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f9926400640 1 --2- 172.21.15.2:0/3373569369 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99201590b0 0x7f9920159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f9926400640 1 --2- 172.21.15.2:0/3373569369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99200afca0 0x7f99200b0070 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f9926400640 1 -- 172.21.15.2:0/3373569369 >> 172.21.15.2:0/3373569369 conn(0x7f9920066e60 msgr2=0x7f9920067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:04.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f9926400640 1 -- 172.21.15.2:0/3373569369 shutdown_connections 2024-08-17T02:47:04.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.866+0000 7f9926400640 1 -- 172.21.15.2:0/3373569369 wait complete. 2024-08-17T02:47:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.868+0000 7f9926400640 1 Processor -- start 2024-08-17T02:47:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.868+0000 7f9926400640 1 -- start start 2024-08-17T02:47:04.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f9926400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99200acf10 0x7f992015b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f9926400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99200afca0 0x7f992015f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f9926400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99201590b0 0x7f992015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f9926400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992015a680 con 0x7f99200acf10 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f9926400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992015b470 con 0x7f99201590b0 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f9926400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992015a860 con 0x7f99200afca0 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99200acf10 0x7f992015b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99200acf10 0x7f992015b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52712/0 (socket says 172.21.15.2:52712) 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991f400640 1 -- 172.21.15.2:0/1548985724 learned_addr learned my addr 172.21.15.2:0/1548985724 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991fe00640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99201590b0 0x7f992015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991ea00640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99200afca0 0x7f992015f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991f400640 1 -- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99200afca0 msgr2=0x7f992015f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991f400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99200afca0 0x7f992015f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991f400640 1 -- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99201590b0 msgr2=0x7f992015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991f400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99201590b0 0x7f992015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991f400640 1 -- 172.21.15.2:0/1548985724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918009a20 con 0x7f99200acf10 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.869+0000 7f991fe00640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99201590b0 0x7f992015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.870+0000 7f991f400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99200acf10 0x7f992015b900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9910035040 tx=0x7f9910032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.870+0000 7f9916a00640 1 -- 172.21.15.2:0/1548985724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910031c80 con 0x7f99200acf10 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.870+0000 7f9916a00640 1 -- 172.21.15.2:0/1548985724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910031e20 con 0x7f99200acf10 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.870+0000 7f9916a00640 1 -- 172.21.15.2:0/1548985724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991003d670 con 0x7f99200acf10 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.870+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9910009450 con 0x7f99200acf10 2024-08-17T02:47:04.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.870+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992015b100 con 0x7f99200acf10 2024-08-17T02:47:04.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.871+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920063fb0 con 0x7f99200acf10 2024-08-17T02:47:04.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.872+0000 7f9916a00640 1 -- 172.21.15.2:0/1548985724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9910039040 con 0x7f99200acf10 2024-08-17T02:47:04.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.873+0000 7f9916a00640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9900065180 0x7f9900067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:04.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.874+0000 7f9916a00640 1 -- 172.21.15.2:0/1548985724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f991002ae40 con 0x7f99200acf10 2024-08-17T02:47:04.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.874+0000 7f991ea00640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9900065180 0x7f9900067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:04.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.874+0000 7f991ea00640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9900065180 0x7f9900067630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f990c007fd0 tx=0x7f990c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:04.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:04.878+0000 7f9916a00640 1 -- 172.21.15.2:0/1548985724 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9910070360 con 0x7f99200acf10 2024-08-17T02:47:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.124+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f9920067b70 con 0x7f99200acf10 2024-08-17T02:47:05.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.128+0000 7f9916a00640 1 -- 172.21.15.2:0/1548985724 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9910073980 con 0x7f99200acf10 2024-08-17T02:47:05.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9900065180 msgr2=0x7f9900067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9900065180 0x7f9900067630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f990c007fd0 tx=0x7f990c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99200acf10 msgr2=0x7f992015b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99200acf10 0x7f992015b900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9910035040 tx=0x7f9910032000 comp rx=0 tx=0).stop 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 shutdown_connections 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99201590b0 0x7f992015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9900065180 0x7f9900067630 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f99200afca0 0x7f992015f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 --2- 172.21.15.2:0/1548985724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99200acf10 0x7f992015b900 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 >> 172.21.15.2:0/1548985724 conn(0x7f9920066e60 msgr2=0x7f992006d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.130+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 shutdown_connections 2024-08-17T02:47:05.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.131+0000 7f9926400640 1 -- 172.21.15.2:0/1548985724 wait complete. 2024-08-17T02:47:05.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:47:05.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.301+0000 7fe261600640 1 Processor -- start 2024-08-17T02:47:05.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.302+0000 7fe261600640 1 -- start start 2024-08-17T02:47:05.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe261600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c0abdf0 0x7fe25c159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe261600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe25c1599b0 0x7fe25c0acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe261600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe25c0ad1a0 0x7fe25c06d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe261600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c0ad640 con 0x7fe25c1599b0 2024-08-17T02:47:05.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe261600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c0c92b0 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe261600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0c8ca0 con 0x7fe25c0abdf0 2024-08-17T02:47:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe253e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe25c1599b0 0x7fe25c0acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe253e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe25c1599b0 0x7fe25c0acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52724/0 (socket says 172.21.15.2:52724) 2024-08-17T02:47:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe253e00640 1 -- 172.21.15.2:0/579217830 learned_addr learned my addr 172.21.15.2:0/579217830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe260c00640 1 --2- 172.21.15.2:0/579217830 >> v2:172.21.15.26:3300/0 conn(0x7fe25c0ad1a0 0x7fe25c06d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.303+0000 7fe25be00640 1 --2- 172.21.15.2:0/579217830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c0abdf0 0x7fe25c159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.304+0000 7fe253e00640 1 -- 172.21.15.2:0/579217830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c0abdf0 msgr2=0x7fe25c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.304+0000 7fe253e00640 1 --2- 172.21.15.2:0/579217830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c0abdf0 0x7fe25c159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.304+0000 7fe253e00640 1 -- 172.21.15.2:0/579217830 >> v2:172.21.15.26:3300/0 conn(0x7fe25c0ad1a0 msgr2=0x7fe25c06d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.304+0000 7fe253e00640 1 --2- 172.21.15.2:0/579217830 >> v2:172.21.15.26:3300/0 conn(0x7fe25c0ad1a0 0x7fe25c06d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.304+0000 7fe253e00640 1 -- 172.21.15.2:0/579217830 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c159ec0 con 0x7fe25c1599b0 2024-08-17T02:47:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.304+0000 7fe260c00640 1 --2- 172.21.15.2:0/579217830 >> v2:172.21.15.26:3300/0 conn(0x7fe25c0ad1a0 0x7fe25c06d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.305+0000 7fe253e00640 1 --2- 172.21.15.2:0/579217830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c1599b0 0x7fe25c0acc60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe25c06d3b0 tx=0x7fe2440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7d0768e2f1abd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:05.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.305+0000 7fe25b400640 1 -- 172.21.15.2:0/579217830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24402add0 con 0x7fe25c1599b0 2024-08-17T02:47:05.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.305+0000 7fe25b400640 1 -- 172.21.15.2:0/579217830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244032440 con 0x7fe25c1599b0 2024-08-17T02:47:05.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.305+0000 7fe25b400640 1 -- 172.21.15.2:0/579217830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244032820 con 0x7fe25c1599b0 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 -- 172.21.15.2:0/579217830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c1599b0 msgr2=0x7fe25c0acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 --2- 172.21.15.2:0/579217830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c1599b0 0x7fe25c0acc60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe25c06d3b0 tx=0x7fe2440091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 -- 172.21.15.2:0/579217830 shutdown_connections 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 --2- 172.21.15.2:0/579217830 >> v2:172.21.15.26:3300/0 conn(0x7fe25c0ad1a0 0x7fe25c06d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 --2- 172.21.15.2:0/579217830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c1599b0 0x7fe25c0acc60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 --2- 172.21.15.2:0/579217830 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c0abdf0 0x7fe25c159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 -- 172.21.15.2:0/579217830 >> 172.21.15.2:0/579217830 conn(0x7fe25c066e60 msgr2=0x7fe25c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 -- 172.21.15.2:0/579217830 shutdown_connections 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.306+0000 7fe261600640 1 -- 172.21.15.2:0/579217830 wait complete. 2024-08-17T02:47:05.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.307+0000 7fe261600640 1 Processor -- start 2024-08-17T02:47:05.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.307+0000 7fe261600640 1 -- start start 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe261600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe25c0abdf0 0x7fe25c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe261600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0ad1a0 0x7fe25c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe261600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c1599b0 0x7fe25c14d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe261600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c158540 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe261600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0c9b60 con 0x7fe25c0abdf0 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe261600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0ca120 con 0x7fe25c1599b0 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe253e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0ad1a0 0x7fe25c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe253e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0ad1a0 0x7fe25c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52738/0 (socket says 172.21.15.2:52738) 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.308+0000 7fe253e00640 1 -- 172.21.15.2:0/3225960172 learned_addr learned my addr 172.21.15.2:0/3225960172 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe25be00640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe25c0abdf0 0x7fe25c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe260c00640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c1599b0 0x7fe25c14d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe253e00640 1 -- 172.21.15.2:0/3225960172 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c1599b0 msgr2=0x7fe25c14d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe253e00640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c1599b0 0x7fe25c14d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe253e00640 1 -- 172.21.15.2:0/3225960172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe25c0abdf0 msgr2=0x7fe25c15c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe253e00640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe25c0abdf0 0x7fe25c15c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe253e00640 1 -- 172.21.15.2:0/3225960172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244009450 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe253e00640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0ad1a0 0x7fe25c158000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe244035040 tx=0x7fe244032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.309+0000 7fe253400640 1 -- 172.21.15.2:0/3225960172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244031a60 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.310+0000 7fe253400640 1 -- 172.21.15.2:0/3225960172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244031c00 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.310+0000 7fe253400640 1 -- 172.21.15.2:0/3225960172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24403e450 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.310+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c158770 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.310+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c0c9db0 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.311+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c070720 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.312+0000 7fe253400640 1 -- 172.21.15.2:0/3225960172 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe24403e7c0 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.312+0000 7fe253400640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe238065150 0x7fe238067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.312+0000 7fe253400640 1 -- 172.21.15.2:0/3225960172 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe2440a22d0 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.313+0000 7fe25be00640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe238065150 0x7fe238067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.313+0000 7fe25be00640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe238065150 0x7fe238067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe24c007ba0 tx=0x7fe24c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:05.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.317+0000 7fe253400640 1 -- 172.21.15.2:0/3225960172 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2440706f0 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.567+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe25c159790 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.571+0000 7fe253400640 1 -- 172.21.15.2:0/3225960172 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe244073d10 con 0x7fe25c0ad1a0 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe238065150 msgr2=0x7fe238067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe238065150 0x7fe238067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe24c007ba0 tx=0x7fe24c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0ad1a0 msgr2=0x7fe25c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0ad1a0 0x7fe25c158000 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe244035040 tx=0x7fe244032000 comp rx=0 tx=0).stop 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 shutdown_connections 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe238065150 0x7fe238067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe25c1599b0 0x7fe25c14d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0ad1a0 0x7fe25c158000 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 --2- 172.21.15.2:0/3225960172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe25c0abdf0 0x7fe25c15c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.573+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 >> 172.21.15.2:0/3225960172 conn(0x7fe25c066e60 msgr2=0x7fe25c069580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.574+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 shutdown_connections 2024-08-17T02:47:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.574+0000 7fe261600640 1 -- 172.21.15.2:0/3225960172 wait complete. 2024-08-17T02:47:05.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:47:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.742+0000 7fc970600640 1 Processor -- start 2024-08-17T02:47:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.742+0000 7fc970600640 1 -- start start 2024-08-17T02:47:05.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.743+0000 7fc970600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9680ca050 0x7fc968156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.743+0000 7fc970600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9680add30 0x7fc96815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.743+0000 7fc970600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96815b5e0 con 0x7fc9680ad960 2024-08-17T02:47:05.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.743+0000 7fc970600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680cb160 con 0x7fc9680add30 2024-08-17T02:47:05.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.743+0000 7fc970600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680b0d10 con 0x7fc9680ca050 2024-08-17T02:47:05.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.743+0000 7fc96e600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9680add30 0x7fc96815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.743+0000 7fc96e600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9680add30 0x7fc96815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52746/0 (socket says 172.21.15.2:52746) 2024-08-17T02:47:05.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.743+0000 7fc96e600640 1 -- 172.21.15.2:0/420221822 learned_addr learned my addr 172.21.15.2:0/420221822 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:05.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.744+0000 7fc96d200640 1 --2- 172.21.15.2:0/420221822 >> v2:172.21.15.26:3300/0 conn(0x7fc9680ca050 0x7fc968156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.744+0000 7fc96e600640 1 -- 172.21.15.2:0/420221822 >> v2:172.21.15.26:3300/0 conn(0x7fc9680ca050 msgr2=0x7fc968156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:05.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.744+0000 7fc96e600640 1 --2- 172.21.15.2:0/420221822 >> v2:172.21.15.26:3300/0 conn(0x7fc9680ca050 0x7fc968156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.744+0000 7fc96e600640 1 -- 172.21.15.2:0/420221822 >> v1:172.21.15.26:6789/0 conn(0x7fc9680ad960 legacy=0x7fc968156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:05.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.744+0000 7fc96e600640 1 -- 172.21.15.2:0/420221822 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680ca550 con 0x7fc9680add30 2024-08-17T02:47:05.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.745+0000 7fc96e600640 1 --2- 172.21.15.2:0/420221822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680add30 0x7fc96815b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc968063600 tx=0x7fc960009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc52b9df6544b16 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:05.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.745+0000 7fc967e00640 1 -- 172.21.15.2:0/420221822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960033430 con 0x7fc9680add30 2024-08-17T02:47:05.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.745+0000 7fc967e00640 1 -- 172.21.15.2:0/420221822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960033590 con 0x7fc9680add30 2024-08-17T02:47:05.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.745+0000 7fc967e00640 1 -- 172.21.15.2:0/420221822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960033930 con 0x7fc9680add30 2024-08-17T02:47:05.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.746+0000 7fc970600640 1 -- 172.21.15.2:0/420221822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680add30 msgr2=0x7fc96815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.746+0000 7fc970600640 1 --2- 172.21.15.2:0/420221822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680add30 0x7fc96815b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc968063600 tx=0x7fc960009840 comp rx=0 tx=0).stop 2024-08-17T02:47:05.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.746+0000 7fc970600640 1 -- 172.21.15.2:0/420221822 shutdown_connections 2024-08-17T02:47:05.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.746+0000 7fc970600640 1 --2- 172.21.15.2:0/420221822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680add30 0x7fc96815b0a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.746+0000 7fc970600640 1 --2- 172.21.15.2:0/420221822 >> v2:172.21.15.26:3300/0 conn(0x7fc9680ca050 0x7fc968156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.746+0000 7fc970600640 1 -- 172.21.15.2:0/420221822 >> 172.21.15.2:0/420221822 conn(0x7fc968066e60 msgr2=0x7fc968067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:05.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.746+0000 7fc970600640 1 -- 172.21.15.2:0/420221822 shutdown_connections 2024-08-17T02:47:05.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.746+0000 7fc970600640 1 -- 172.21.15.2:0/420221822 wait complete. 2024-08-17T02:47:05.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.747+0000 7fc970600640 1 Processor -- start 2024-08-17T02:47:05.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.747+0000 7fc970600640 1 -- start start 2024-08-17T02:47:05.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc970600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680ad960 0x7fc96813e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc970600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680add30 0x7fc968166b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc970600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9680ca050 0x7fc968157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc970600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968168170 con 0x7fc9680ad960 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc970600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968167560 con 0x7fc9680add30 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc970600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc968167840 con 0x7fc9680ca050 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc96dc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680ad960 0x7fc96813e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc96dc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680ad960 0x7fc96813e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52762/0 (socket says 172.21.15.2:52762) 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc96dc00640 1 -- 172.21.15.2:0/2016225016 learned_addr learned my addr 172.21.15.2:0/2016225016 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.748+0000 7fc96d200640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680add30 0x7fc968166b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc96e600640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9680ca050 0x7fc968157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc96dc00640 1 -- 172.21.15.2:0/2016225016 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9680ca050 msgr2=0x7fc968157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc96dc00640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9680ca050 0x7fc968157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc96dc00640 1 -- 172.21.15.2:0/2016225016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680add30 msgr2=0x7fc968166b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:05.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc96dc00640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680add30 0x7fc968166b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:05.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc96dc00640 1 -- 172.21.15.2:0/2016225016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960009ae0 con 0x7fc9680ad960 2024-08-17T02:47:05.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc96dc00640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680ad960 0x7fc96813e200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00b4f0 tx=0x7fc95c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:05.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc964c00640 1 -- 172.21.15.2:0/2016225016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00f510 con 0x7fc9680ad960 2024-08-17T02:47:05.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc964c00640 1 -- 172.21.15.2:0/2016225016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00f670 con 0x7fc9680ad960 2024-08-17T02:47:05.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc968167b20 con 0x7fc9680ad960 2024-08-17T02:47:05.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.749+0000 7fc964c00640 1 -- 172.21.15.2:0/2016225016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00fa70 con 0x7fc9680ad960 2024-08-17T02:47:05.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.750+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96813e740 con 0x7fc9680ad960 2024-08-17T02:47:05.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.750+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc968063fb0 con 0x7fc9680ad960 2024-08-17T02:47:05.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.751+0000 7fc964c00640 1 -- 172.21.15.2:0/2016225016 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc95c01a400 con 0x7fc9680ad960 2024-08-17T02:47:05.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.752+0000 7fc964c00640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc948065150 0x7fc948067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:05.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.752+0000 7fc964c00640 1 -- 172.21.15.2:0/2016225016 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc95c081b20 con 0x7fc9680ad960 2024-08-17T02:47:05.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.752+0000 7fc96d200640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc948065150 0x7fc948067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:05.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.753+0000 7fc96d200640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc948065150 0x7fc948067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc968155530 tx=0x7fc954008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:05.756+0000 7fc964c00640 1 -- 172.21.15.2:0/2016225016 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc95c04ffc0 con 0x7fc9680ad960 2024-08-17T02:47:06.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.005+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc96806e810 con 0x7fc9680ad960 2024-08-17T02:47:06.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.009+0000 7fc964c00640 1 -- 172.21.15.2:0/2016225016 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc95c0535e0 con 0x7fc9680ad960 2024-08-17T02:47:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc948065150 msgr2=0x7fc948067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc948065150 0x7fc948067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc968155530 tx=0x7fc954008040 comp rx=0 tx=0).stop 2024-08-17T02:47:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680ad960 msgr2=0x7fc96813e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680ad960 0x7fc96813e200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00b4f0 tx=0x7fc95c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 shutdown_connections 2024-08-17T02:47:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc948065150 0x7fc948067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc9680ca050 0x7fc968157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9680add30 0x7fc968166b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 --2- 172.21.15.2:0/2016225016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9680ad960 0x7fc96813e200 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 >> 172.21.15.2:0/2016225016 conn(0x7fc968066e60 msgr2=0x7fc968151db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:06.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 shutdown_connections 2024-08-17T02:47:06.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.011+0000 7fc970600640 1 -- 172.21.15.2:0/2016225016 wait complete. 2024-08-17T02:47:06.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:47:06.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.178+0000 7f8461e00640 1 Processor -- start 2024-08-17T02:47:06.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.178+0000 7f8461e00640 1 -- start start 2024-08-17T02:47:06.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f8461e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f845c0ad960 0x7f845c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f8461e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f845c0ca050 0x7f845c156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f8461e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f8461e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c15b5e0 con 0x7f845c0ad960 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f8461e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c0cb160 con 0x7f845c0ca050 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f8461e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0b0d10 con 0x7f845c0add30 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845aa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f845c0ad960 0x7f845c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845aa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f845c0ad960 0x7f845c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52770/0 (socket says 172.21.15.2:52770) 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845aa00640 1 -- 172.21.15.2:0/4100916509 learned_addr learned my addr 172.21.15.2:0/4100916509 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f8453e00640 1 --2- 172.21.15.2:0/4100916509 >> v2:172.21.15.26:3300/0 conn(0x7f845c0ca050 0x7f845c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845b400640 1 --2- 172.21.15.2:0/4100916509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845aa00640 1 -- 172.21.15.2:0/4100916509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 msgr2=0x7f845c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:06.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845aa00640 1 --2- 172.21.15.2:0/4100916509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845aa00640 1 -- 172.21.15.2:0/4100916509 >> v2:172.21.15.26:3300/0 conn(0x7f845c0ca050 msgr2=0x7f845c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:06.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845aa00640 1 --2- 172.21.15.2:0/4100916509 >> v2:172.21.15.26:3300/0 conn(0x7f845c0ca050 0x7f845c156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.180+0000 7f845aa00640 1 -- 172.21.15.2:0/4100916509 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0ca550 con 0x7f845c0ad960 2024-08-17T02:47:06.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.181+0000 7f845aa00640 1 --2- 172.21.15.2:0/4100916509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ad960 0x7f845c15b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f845c063600 tx=0x7f844c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51321dca9dbc95eb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f845a000640 1 -- 172.21.15.2:0/4100916509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c02ae60 con 0x7f845c0ad960 2024-08-17T02:47:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f845a000640 1 -- 172.21.15.2:0/4100916509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c032440 con 0x7f845c0ad960 2024-08-17T02:47:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f845a000640 1 -- 172.21.15.2:0/4100916509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0327e0 con 0x7f845c0ad960 2024-08-17T02:47:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 -- 172.21.15.2:0/4100916509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ad960 msgr2=0x7f845c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 --2- 172.21.15.2:0/4100916509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ad960 0x7f845c15b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f845c063600 tx=0x7f844c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 -- 172.21.15.2:0/4100916509 shutdown_connections 2024-08-17T02:47:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 --2- 172.21.15.2:0/4100916509 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 --2- 172.21.15.2:0/4100916509 >> v2:172.21.15.26:3300/0 conn(0x7f845c0ca050 0x7f845c156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 --2- 172.21.15.2:0/4100916509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ad960 0x7f845c15b0a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 -- 172.21.15.2:0/4100916509 >> 172.21.15.2:0/4100916509 conn(0x7f845c066e60 msgr2=0x7f845c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 -- 172.21.15.2:0/4100916509 shutdown_connections 2024-08-17T02:47:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.182+0000 7f8461e00640 1 -- 172.21.15.2:0/4100916509 wait complete. 2024-08-17T02:47:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.184+0000 7f8461e00640 1 Processor -- start 2024-08-17T02:47:06.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.184+0000 7f8461e00640 1 -- start start 2024-08-17T02:47:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f8461e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f845c0ad960 0x7f845c158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f8461e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c166c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f8461e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ca050 0x7f845c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f8461e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c158c10 con 0x7f845c0ca050 2024-08-17T02:47:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f8461e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c158ef0 con 0x7f845c0ad960 2024-08-17T02:47:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f8461e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c1591d0 con 0x7f845c0add30 2024-08-17T02:47:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ca050 0x7f845c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ca050 0x7f845c157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52784/0 (socket says 172.21.15.2:52784) 2024-08-17T02:47:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845b400640 1 -- 172.21.15.2:0/1645439200 learned_addr learned my addr 172.21.15.2:0/1645439200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f8453e00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845aa00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f845c0ad960 0x7f845c158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845b400640 1 -- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 msgr2=0x7f845c166c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845b400640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c166c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845b400640 1 -- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f845c0ad960 msgr2=0x7f845c158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845b400640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f845c0ad960 0x7f845c158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845b400640 1 -- 172.21.15.2:0/1645439200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c009450 con 0x7f845c0ca050 2024-08-17T02:47:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f845aa00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f845c0ad960 0x7f845c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.185+0000 7f8453e00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.186+0000 7f845b400640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ca050 0x7f845c157cb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8454007f20 tx=0x7f8454009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.186+0000 7f8452000640 1 -- 172.21.15.2:0/1645439200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400ee30 con 0x7f845c0ca050 2024-08-17T02:47:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.186+0000 7f8452000640 1 -- 172.21.15.2:0/1645439200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8454014420 con 0x7f845c0ca050 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.186+0000 7f8452000640 1 -- 172.21.15.2:0/1645439200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84540147e0 con 0x7f845c0ca050 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.186+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c1594b0 con 0x7f845c0ca050 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.186+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c167160 con 0x7f845c0ca050 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.187+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c063fb0 con 0x7f845c0ca050 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.188+0000 7f8452000640 1 -- 172.21.15.2:0/1645439200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8454014b50 con 0x7f845c0ca050 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.189+0000 7f8452000640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8438065150 0x7f8438067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.189+0000 7f8452000640 1 -- 172.21.15.2:0/1645439200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f84540828d0 con 0x7f845c0ca050 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.189+0000 7f845aa00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8438065150 0x7f8438067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.189+0000 7f845aa00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8438065150 0x7f8438067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f844c034000 tx=0x7f844c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:06.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.193+0000 7f8452000640 1 -- 172.21.15.2:0/1645439200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8454050c40 con 0x7f845c0ca050 2024-08-17T02:47:06.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.441+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f845c06aa10 con 0x7f845c0ca050 2024-08-17T02:47:06.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.445+0000 7f8452000640 1 -- 172.21.15.2:0/1645439200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8454054260 con 0x7f845c0ca050 2024-08-17T02:47:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8438065150 msgr2=0x7f8438067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8438065150 0x7f8438067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f844c034000 tx=0x7f844c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ca050 msgr2=0x7f845c157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ca050 0x7f845c157cb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8454007f20 tx=0x7f8454009860 comp rx=0 tx=0).stop 2024-08-17T02:47:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 shutdown_connections 2024-08-17T02:47:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f845c0ca050 0x7f845c157cb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8438065150 0x7f8438067600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f845c0add30 0x7f845c166c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 --2- 172.21.15.2:0/1645439200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f845c0ad960 0x7f845c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 >> 172.21.15.2:0/1645439200 conn(0x7f845c066e60 msgr2=0x7f845c1554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:06.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 shutdown_connections 2024-08-17T02:47:06.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.447+0000 7f8461e00640 1 -- 172.21.15.2:0/1645439200 wait complete. 2024-08-17T02:47:06.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:06.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.614+0000 7ffaae400640 1 Processor -- start 2024-08-17T02:47:06.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.614+0000 7ffaae400640 1 -- start start 2024-08-17T02:47:06.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.615+0000 7ffaae400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa80b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.615+0000 7ffaae400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa806d7c0 con 0x7ffaa815a590 2024-08-17T02:47:06.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.615+0000 7ffaae400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa815ab30 con 0x7ffaa8156f90 2024-08-17T02:47:06.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.615+0000 7ffaae400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa815ae10 con 0x7ffaa80b0e30 2024-08-17T02:47:06.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.615+0000 7ffaada00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffaa815a590 0x7ffaa813fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48026/0 (socket says 172.21.15.2:48026) 2024-08-17T02:47:06.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.615+0000 7ffaada00640 1 -- 172.21.15.2:0/3261692841 learned_addr learned my addr 172.21.15.2:0/3261692841 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:06.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.615+0000 7ffaad000640 1 --2- 172.21.15.2:0/3261692841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa80b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.616+0000 7ffaa7400640 1 -- 172.21.15.2:0/3261692841 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77084991 0 0) 0x7ffaa806d7c0 con 0x7ffaa815a590 2024-08-17T02:47:06.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.616+0000 7ffaa7400640 1 -- 172.21.15.2:0/3261692841 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa900034e0 con 0x7ffaa815a590 2024-08-17T02:47:06.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.616+0000 7ffaa7400640 1 -- 172.21.15.2:0/3261692841 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926721801 0 0) 0x7ffaa815ab30 con 0x7ffaa8156f90 2024-08-17T02:47:06.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.616+0000 7ffaa7400640 1 -- 172.21.15.2:0/3261692841 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa806d7c0 con 0x7ffaa8156f90 2024-08-17T02:47:06.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.616+0000 7ffaad000640 1 -- 172.21.15.2:0/3261692841 >> v1:172.21.15.26:6789/0 conn(0x7ffaa8156f90 legacy=0x7ffaa80cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.616+0000 7ffaad000640 1 -- 172.21.15.2:0/3261692841 >> v1:172.21.15.2:6789/0 conn(0x7ffaa815a590 legacy=0x7ffaa813fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.616+0000 7ffaad000640 1 -- 172.21.15.2:0/3261692841 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa815b0f0 con 0x7ffaa80b0e30 2024-08-17T02:47:06.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.617+0000 7ffaad000640 1 --2- 172.21.15.2:0/3261692841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa80b1200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009880 tx=0x7ffa9c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=902b4ad0d3cef2d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:06.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaa7400640 1 -- 172.21.15.2:0/3261692841 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c02ae20 con 0x7ffaa80b0e30 2024-08-17T02:47:06.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaa7400640 1 -- 172.21.15.2:0/3261692841 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c032440 con 0x7ffaa80b0e30 2024-08-17T02:47:06.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaa7400640 1 -- 172.21.15.2:0/3261692841 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0327c0 con 0x7ffaa80b0e30 2024-08-17T02:47:06.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaae400640 1 -- 172.21.15.2:0/3261692841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 msgr2=0x7ffaa80b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaae400640 1 --2- 172.21.15.2:0/3261692841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa80b1200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009880 tx=0x7ffa9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaae400640 1 -- 172.21.15.2:0/3261692841 shutdown_connections 2024-08-17T02:47:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaae400640 1 --2- 172.21.15.2:0/3261692841 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa80b1200 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaae400640 1 -- 172.21.15.2:0/3261692841 >> 172.21.15.2:0/3261692841 conn(0x7ffaa8062af0 msgr2=0x7ffaa8062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaae400640 1 -- 172.21.15.2:0/3261692841 shutdown_connections 2024-08-17T02:47:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.618+0000 7ffaae400640 1 -- 172.21.15.2:0/3261692841 wait complete. 2024-08-17T02:47:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.620+0000 7ffaae400640 1 Processor -- start 2024-08-17T02:47:06.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.620+0000 7ffaae400640 1 -- start start 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaae400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa81561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaae400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa8156f90 0x7ffaa80c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaae400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa815a590 0x7ffaa80c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaae400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80c65e0 con 0x7ffaa8156f90 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaae400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80aecb0 con 0x7ffaa815a590 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaae400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80c57f0 con 0x7ffaa80b0e30 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaa7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa8156f90 0x7ffaa80c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaa7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa8156f90 0x7ffaa80c4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52794/0 (socket says 172.21.15.2:52794) 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaa7e00640 1 -- 172.21.15.2:0/1628270035 learned_addr learned my addr 172.21.15.2:0/1628270035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:06.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaada00640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa815a590 0x7ffaa80c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaad000640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa81561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaa7e00640 1 -- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 msgr2=0x7ffaa81561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaa7e00640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa81561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaa7e00640 1 -- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa815a590 msgr2=0x7ffaa80c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaa7e00640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa815a590 0x7ffaa80c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaa7e00640 1 -- 172.21.15.2:0/1628270035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c009390 con 0x7ffaa8156f90 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.621+0000 7ffaada00640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa815a590 0x7ffaa80c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.622+0000 7ffaa7e00640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa8156f90 0x7ffaa80c4c80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400c560 tx=0x7ffa94007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.622+0000 7ffa9be00640 1 -- 172.21.15.2:0/1628270035 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011590 con 0x7ffaa8156f90 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.622+0000 7ffa9be00640 1 -- 172.21.15.2:0/1628270035 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94011710 con 0x7ffaa8156f90 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.622+0000 7ffa9be00640 1 -- 172.21.15.2:0/1628270035 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011ad0 con 0x7ffaa8156f90 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.622+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa80c5ad0 con 0x7ffaa8156f90 2024-08-17T02:47:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.622+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa81566e0 con 0x7ffaa8156f90 2024-08-17T02:47:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.623+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa80c6790 con 0x7ffaa8156f90 2024-08-17T02:47:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.624+0000 7ffa9be00640 1 -- 172.21.15.2:0/1628270035 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa9401c460 con 0x7ffaa8156f90 2024-08-17T02:47:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.625+0000 7ffa9be00640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ffa88065150 0x7ffa88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.625+0000 7ffa9be00640 1 -- 172.21.15.2:0/1628270035 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffa94081e70 con 0x7ffaa8156f90 2024-08-17T02:47:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.625+0000 7ffaad000640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ffa88065150 0x7ffa88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.626+0000 7ffaad000640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ffa88065150 0x7ffa88067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c034000 tx=0x7ffa9c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.628+0000 7ffa9be00640 1 -- 172.21.15.2:0/1628270035 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffaa80c6790 con 0x7ffaa8156f90 2024-08-17T02:47:06.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.815+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaa80c6790 con 0x7ffaa8156f90 2024-08-17T02:47:06.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.816+0000 7ffa9be00640 1 -- 172.21.15.2:0/1628270035 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12038 (secure 0 0 0) 0x7ffaa80c6790 con 0x7ffaa8156f90 2024-08-17T02:47:06.817 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:06.818 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:47:03.355177+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.818+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ffa88065150 msgr2=0x7ffa88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.818+0000 7ffaae400640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ffa88065150 0x7ffa88067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c034000 tx=0x7ffa9c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.818+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa8156f90 msgr2=0x7ffaa80c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.818+0000 7ffaae400640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa8156f90 0x7ffaa80c4c80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400c560 tx=0x7ffa94007d30 comp rx=0 tx=0).stop 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.819+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 shutdown_connections 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.819+0000 7ffaae400640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffaa815a590 0x7ffaa80c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.819+0000 7ffaae400640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffaa8156f90 0x7ffaa80c4c80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.819+0000 7ffaae400640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ffa88065150 0x7ffa88067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.819+0000 7ffaae400640 1 --2- 172.21.15.2:0/1628270035 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ffaa80b0e30 0x7ffaa81561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.819+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 >> 172.21.15.2:0/1628270035 conn(0x7ffaa8062af0 msgr2=0x7ffaa8159280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:06.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.819+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 shutdown_connections 2024-08-17T02:47:06.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.819+0000 7ffaae400640 1 -- 172.21.15.2:0/1628270035 wait complete. 2024-08-17T02:47:06.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:47:06.835 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:47:06.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-08-17T02:47:06.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.988+0000 7f80a6800640 1 Processor -- start 2024-08-17T02:47:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.988+0000 7f80a6800640 1 -- start start 2024-08-17T02:47:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.989+0000 7f80a6800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80a0158e60 0x7f80a00add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.989+0000 7f80a6800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f80a00b0ac0 0x7f80a00ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.989+0000 7f80a6800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00ad8a0 con 0x7f80a00ae860 2024-08-17T02:47:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.989+0000 7f80a6800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a006edf0 con 0x7f80a0158e60 2024-08-17T02:47:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.989+0000 7f80a6800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00acc90 con 0x7f80a00b0ac0 2024-08-17T02:47:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f809f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80a0158e60 0x7f80a00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f8097e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f80a00ae860 0x7f80a00b03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48032/0 (socket says 172.21.15.2:48032) 2024-08-17T02:47:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f8097e00640 1 -- 172.21.15.2:0/3914786079 learned_addr learned my addr 172.21.15.2:0/3914786079 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f809fe00640 1 --2- 172.21.15.2:0/3914786079 >> v2:172.21.15.26:3300/0 conn(0x7f80a00b0ac0 0x7f80a00ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f809f400640 1 -- 172.21.15.2:0/3914786079 >> v2:172.21.15.26:3300/0 conn(0x7f80a00b0ac0 msgr2=0x7f80a00ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f809f400640 1 --2- 172.21.15.2:0/3914786079 >> v2:172.21.15.26:3300/0 conn(0x7f80a00b0ac0 0x7f80a00ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f809f400640 1 -- 172.21.15.2:0/3914786079 >> v1:172.21.15.2:6789/0 conn(0x7f80a00ae860 legacy=0x7f80a00b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f809f400640 1 -- 172.21.15.2:0/3914786079 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00acf70 con 0x7f80a0158e60 2024-08-17T02:47:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.990+0000 7f809ea00640 1 -- 172.21.15.2:0/3914786079 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895336715 0 0) 0x7f80a00ad8a0 con 0x7f80a00ae860 2024-08-17T02:47:06.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.991+0000 7f809f400640 1 --2- 172.21.15.2:0/3914786079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a0158e60 0x7f80a00add30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f80a00c80c0 tx=0x7f80900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80584392444c123 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:06.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f809ea00640 1 -- 172.21.15.2:0/3914786079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809002adb0 con 0x7f80a0158e60 2024-08-17T02:47:06.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f809ea00640 1 -- 172.21.15.2:0/3914786079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090032440 con 0x7f80a0158e60 2024-08-17T02:47:06.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f809ea00640 1 -- 172.21.15.2:0/3914786079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80900327e0 con 0x7f80a0158e60 2024-08-17T02:47:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f80a6800640 1 -- 172.21.15.2:0/3914786079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a0158e60 msgr2=0x7f80a00add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f80a6800640 1 --2- 172.21.15.2:0/3914786079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a0158e60 0x7f80a00add30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f80a00c80c0 tx=0x7f80900090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f80a6800640 1 -- 172.21.15.2:0/3914786079 shutdown_connections 2024-08-17T02:47:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f80a6800640 1 --2- 172.21.15.2:0/3914786079 >> v2:172.21.15.26:3300/0 conn(0x7f80a00b0ac0 0x7f80a00ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f80a6800640 1 --2- 172.21.15.2:0/3914786079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a0158e60 0x7f80a00add30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f80a6800640 1 -- 172.21.15.2:0/3914786079 >> 172.21.15.2:0/3914786079 conn(0x7f80a00cc390 msgr2=0x7f80a0066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f80a6800640 1 -- 172.21.15.2:0/3914786079 shutdown_connections 2024-08-17T02:47:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.992+0000 7f80a6800640 1 -- 172.21.15.2:0/3914786079 wait complete. 2024-08-17T02:47:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.994+0000 7f80a6800640 1 Processor -- start 2024-08-17T02:47:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.994+0000 7f80a6800640 1 -- start start 2024-08-17T02:47:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f80a6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a00ae860 0x7f80a00aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f80a6800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80a00b0ac0 0x7f80a0155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f80a6800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80a0158e60 0x7f80a014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f80a6800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00aa690 con 0x7f80a00ae860 2024-08-17T02:47:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f80a6800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01559c0 con 0x7f80a0158e60 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f80a6800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00c8ee0 con 0x7f80a00b0ac0 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a00ae860 0x7f80a00aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a00ae860 0x7f80a00aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52820/0 (socket says 172.21.15.2:52820) 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809f400640 1 -- 172.21.15.2:0/1079289266 learned_addr learned my addr 172.21.15.2:0/1079289266 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f8097e00640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80a00b0ac0 0x7f80a0155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809fe00640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80a0158e60 0x7f80a014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809f400640 1 -- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80a00b0ac0 msgr2=0x7f80a0155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809f400640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80a00b0ac0 0x7f80a0155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809f400640 1 -- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80a0158e60 msgr2=0x7f80a014e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809f400640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80a0158e60 0x7f80a014e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809f400640 1 -- 172.21.15.2:0/1079289266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090009390 con 0x7f80a00ae860 2024-08-17T02:47:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.995+0000 7f809fe00640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80a0158e60 0x7f80a014e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.996+0000 7f809f400640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a00ae860 0x7f80a00aa150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8090009360 tx=0x7f8090032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.996+0000 7f8096a00640 1 -- 172.21.15.2:0/1079289266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090000d10 con 0x7f80a00ae860 2024-08-17T02:47:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.996+0000 7f8096a00640 1 -- 172.21.15.2:0/1079289266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090031e00 con 0x7f80a00ae860 2024-08-17T02:47:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.996+0000 7f8096a00640 1 -- 172.21.15.2:0/1079289266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809003d670 con 0x7f80a00ae860 2024-08-17T02:47:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.996+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a0155bf0 con 0x7f80a00ae860 2024-08-17T02:47:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.996+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0156230 con 0x7f80a00ae860 2024-08-17T02:47:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.997+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a0063fb0 con 0x7f80a00ae860 2024-08-17T02:47:06.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.998+0000 7f8096a00640 1 -- 172.21.15.2:0/1079289266 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8090039040 con 0x7f80a00ae860 2024-08-17T02:47:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.999+0000 7f8096a00640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f807c065150 0x7f807c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.999+0000 7f8096a00640 1 -- 172.21.15.2:0/1079289266 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f80900a20f0 con 0x7f80a00ae860 2024-08-17T02:47:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:06.999+0000 7f8097e00640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f807c065150 0x7f807c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.000+0000 7f8097e00640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f807c065150 0x7f807c067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f80a00cadc0 tx=0x7f8088009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.003+0000 7f8096a00640 1 -- 172.21.15.2:0/1079289266 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8090070500 con 0x7f80a00ae860 2024-08-17T02:47:07.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.189+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80a006b610 con 0x7f80a00ae860 2024-08-17T02:47:07.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.190+0000 7f8096a00640 1 -- 172.21.15.2:0/1079289266 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8090073b20 con 0x7f80a00ae860 2024-08-17T02:47:07.191 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:47:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f807c065150 msgr2=0x7f807c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f807c065150 0x7f807c067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f80a00cadc0 tx=0x7f8088009040 comp rx=0 tx=0).stop 2024-08-17T02:47:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a00ae860 msgr2=0x7f80a00aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a00ae860 0x7f80a00aa150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8090009360 tx=0x7f8090032000 comp rx=0 tx=0).stop 2024-08-17T02:47:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 shutdown_connections 2024-08-17T02:47:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80a0158e60 0x7f80a014e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f807c065150 0x7f807c067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80a00b0ac0 0x7f80a0155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 --2- 172.21.15.2:0/1079289266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80a00ae860 0x7f80a00aa150 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 >> 172.21.15.2:0/1079289266 conn(0x7f80a00cc390 msgr2=0x7f80a014f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 shutdown_connections 2024-08-17T02:47:07.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.192+0000 7f80a6800640 1 -- 172.21.15.2:0/1079289266 wait complete. 2024-08-17T02:47:07.209 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:47:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.359+0000 7f157f800640 1 Processor -- start 2024-08-17T02:47:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.359+0000 7f157f800640 1 -- start start 2024-08-17T02:47:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f157f800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f15780afca0 0x7f15780b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f157f800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780acf10 0x7f1578159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f157f800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157815a4e0 con 0x7f15781589a0 2024-08-17T02:47:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f157f800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15780b0980 con 0x7f15780afca0 2024-08-17T02:47:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f157f800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15780c92b0 con 0x7f15780acf10 2024-08-17T02:47:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f157d800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f15781589a0 0x7f157806d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48034/0 (socket says 172.21.15.2:48034) 2024-08-17T02:47:07.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f157d800640 1 -- 172.21.15.2:0/390135889 learned_addr learned my addr 172.21.15.2:0/390135889 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f157ce00640 1 --2- 172.21.15.2:0/390135889 >> v2:172.21.15.26:3300/0 conn(0x7f15780afca0 0x7f15780b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.360+0000 7f1577e00640 1 --2- 172.21.15.2:0/390135889 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780acf10 0x7f1578159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.361+0000 7f1577400640 1 -- 172.21.15.2:0/390135889 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891579324 0 0) 0x7f1570001490 con 0x7f15781589a0 2024-08-17T02:47:07.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.361+0000 7f1577400640 1 -- 172.21.15.2:0/390135889 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15600034e0 con 0x7f15781589a0 2024-08-17T02:47:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.361+0000 7f1577e00640 1 -- 172.21.15.2:0/390135889 >> v2:172.21.15.26:3300/0 conn(0x7f15780afca0 msgr2=0x7f15780b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.361+0000 7f1577e00640 1 --2- 172.21.15.2:0/390135889 >> v2:172.21.15.26:3300/0 conn(0x7f15780afca0 0x7f15780b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.361+0000 7f1577e00640 1 -- 172.21.15.2:0/390135889 >> v1:172.21.15.2:6789/0 conn(0x7f15781589a0 legacy=0x7f157806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.361+0000 7f1577e00640 1 -- 172.21.15.2:0/390135889 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780ad480 con 0x7f15780acf10 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.362+0000 7f1577e00640 1 --2- 172.21.15.2:0/390135889 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780acf10 0x7f1578159fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1564009880 tx=0x7f15640090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17a3a46c927166c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.362+0000 7f1577400640 1 -- 172.21.15.2:0/390135889 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156402ad70 con 0x7f15780acf10 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.362+0000 7f1577400640 1 -- 172.21.15.2:0/390135889 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564032440 con 0x7f15780acf10 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.362+0000 7f1577400640 1 -- 172.21.15.2:0/390135889 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564032820 con 0x7f15780acf10 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.363+0000 7f157f800640 1 -- 172.21.15.2:0/390135889 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780acf10 msgr2=0x7f1578159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.363+0000 7f157f800640 1 --2- 172.21.15.2:0/390135889 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780acf10 0x7f1578159fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1564009880 tx=0x7f15640090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.363+0000 7f157f800640 1 -- 172.21.15.2:0/390135889 shutdown_connections 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.363+0000 7f157f800640 1 --2- 172.21.15.2:0/390135889 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780acf10 0x7f1578159fa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.363+0000 7f157f800640 1 --2- 172.21.15.2:0/390135889 >> v2:172.21.15.26:3300/0 conn(0x7f15780afca0 0x7f15780b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.363+0000 7f157f800640 1 -- 172.21.15.2:0/390135889 >> 172.21.15.2:0/390135889 conn(0x7f1578066e60 msgr2=0x7f1578067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.363+0000 7f157f800640 1 -- 172.21.15.2:0/390135889 shutdown_connections 2024-08-17T02:47:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.363+0000 7f157f800640 1 -- 172.21.15.2:0/390135889 wait complete. 2024-08-17T02:47:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.364+0000 7f157f800640 1 Processor -- start 2024-08-17T02:47:07.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.365+0000 7f157f800640 1 -- start start 2024-08-17T02:47:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.365+0000 7f157f800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15780acf10 0x7f1578140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157f800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780afca0 0x7f1578169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157f800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15781589a0 0x7f1578149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157f800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157806b370 con 0x7f15781589a0 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157f800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157816a010 con 0x7f15780acf10 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157f800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157813f4f0 con 0x7f15780afca0 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15781589a0 0x7f1578149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15781589a0 0x7f1578149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52828/0 (socket says 172.21.15.2:52828) 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157d800640 1 -- 172.21.15.2:0/659798933 learned_addr learned my addr 172.21.15.2:0/659798933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157ce00640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15780acf10 0x7f1578140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f1577e00640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780afca0 0x7f1578169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157d800640 1 -- 172.21.15.2:0/659798933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780afca0 msgr2=0x7f1578169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157d800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780afca0 0x7f1578169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157d800640 1 -- 172.21.15.2:0/659798933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15780acf10 msgr2=0x7f1578140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157d800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15780acf10 0x7f1578140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.366+0000 7f157d800640 1 -- 172.21.15.2:0/659798933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009390 con 0x7f15781589a0 2024-08-17T02:47:07.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.367+0000 7f157d800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15781589a0 0x7f1578149ea0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f157000cc70 tx=0x7f1570001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.367+0000 7f156be00640 1 -- 172.21.15.2:0/659798933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157000ce30 con 0x7f15781589a0 2024-08-17T02:47:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.367+0000 7f156be00640 1 -- 172.21.15.2:0/659798933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157000a850 con 0x7f15781589a0 2024-08-17T02:47:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.367+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157806a7f0 con 0x7f15781589a0 2024-08-17T02:47:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.367+0000 7f156be00640 1 -- 172.21.15.2:0/659798933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157000abd0 con 0x7f15781589a0 2024-08-17T02:47:07.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.367+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157806adb0 con 0x7f15781589a0 2024-08-17T02:47:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.368+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1578063fb0 con 0x7f15781589a0 2024-08-17T02:47:07.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.369+0000 7f156be00640 1 -- 172.21.15.2:0/659798933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f15700070f0 con 0x7f15781589a0 2024-08-17T02:47:07.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.370+0000 7f156be00640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1558065150 0x7f1558067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.370+0000 7f156be00640 1 -- 172.21.15.2:0/659798933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1570082c40 con 0x7f15781589a0 2024-08-17T02:47:07.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.370+0000 7f157ce00640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1558065150 0x7f1558067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.371+0000 7f157ce00640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1558065150 0x7f1558067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f15781422a0 tx=0x7f156c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.373+0000 7f156be00640 1 -- 172.21.15.2:0/659798933 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1570051170 con 0x7f15781589a0 2024-08-17T02:47:07.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.557+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f157815a4e0 con 0x7f15781589a0 2024-08-17T02:47:07.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.558+0000 7f156be00640 1 -- 172.21.15.2:0/659798933 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f157815a4e0 con 0x7f15781589a0 2024-08-17T02:47:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:07.559 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-17T02:47:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:07.559 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-08-17T02:47:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-08-17T02:47:07.560 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:07.560 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-17T02:47:07.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1558065150 msgr2=0x7f1558067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1558065150 0x7f1558067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f15781422a0 tx=0x7f156c008040 comp rx=0 tx=0).stop 2024-08-17T02:47:07.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15781589a0 msgr2=0x7f1578149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15781589a0 0x7f1578149ea0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f157000cc70 tx=0x7f1570001a30 comp rx=0 tx=0).stop 2024-08-17T02:47:07.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 shutdown_connections 2024-08-17T02:47:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15781589a0 0x7f1578149ea0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1558065150 0x7f1558067600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f15780afca0 0x7f1578169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 --2- 172.21.15.2:0/659798933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15780acf10 0x7f1578140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 >> 172.21.15.2:0/659798933 conn(0x7f1578066e60 msgr2=0x7f15780caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 shutdown_connections 2024-08-17T02:47:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.560+0000 7f157f800640 1 -- 172.21.15.2:0/659798933 wait complete. 2024-08-17T02:47:07.576 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:47:07.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:47:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.729+0000 7f288e400640 1 Processor -- start 2024-08-17T02:47:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.729+0000 7f288e400640 1 -- start start 2024-08-17T02:47:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.730+0000 7f288e400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2888158bb0 0x7f28880cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.730+0000 7f288e400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158f80 0x7f28880cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.730+0000 7f288e400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f28880cb600 0x7f28880b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.730+0000 7f288e400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880cc9e0 con 0x7f28880cb600 2024-08-17T02:47:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.730+0000 7f288e400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880cbdd0 con 0x7f2888158bb0 2024-08-17T02:47:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.730+0000 7f288e400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880cc0b0 con 0x7f2888158f80 2024-08-17T02:47:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.730+0000 7f2887e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f28880cb600 0x7f28880b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f28880cb600 0x7f28880b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52832/0 (socket says 172.21.15.2:52832) 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887e00640 1 -- 172.21.15.2:0/1108338309 learned_addr learned my addr 172.21.15.2:0/1108338309 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887400640 1 --2- 172.21.15.2:0/1108338309 >> v2:172.21.15.26:3300/0 conn(0x7f2888158bb0 0x7f28880cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2886a00640 1 --2- 172.21.15.2:0/1108338309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158f80 0x7f28880cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887e00640 1 -- 172.21.15.2:0/1108338309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158f80 msgr2=0x7f28880cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887e00640 1 --2- 172.21.15.2:0/1108338309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158f80 0x7f28880cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887e00640 1 -- 172.21.15.2:0/1108338309 >> v2:172.21.15.26:3300/0 conn(0x7f2888158bb0 msgr2=0x7f28880cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887e00640 1 --2- 172.21.15.2:0/1108338309 >> v2:172.21.15.26:3300/0 conn(0x7f2888158bb0 0x7f28880cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887e00640 1 -- 172.21.15.2:0/1108338309 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880cc390 con 0x7f28880cb600 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2887400640 1 --2- 172.21.15.2:0/1108338309 >> v2:172.21.15.26:3300/0 conn(0x7f2888158bb0 0x7f28880cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.731+0000 7f2886a00640 1 --2- 172.21.15.2:0/1108338309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158f80 0x7f28880cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:07.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.732+0000 7f2887e00640 1 --2- 172.21.15.2:0/1108338309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f28880b1a70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2888066e80 tx=0x7f2880009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd61248173c6a7f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.732+0000 7f2886000640 1 -- 172.21.15.2:0/1108338309 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880031400 con 0x7f28880cb600 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.732+0000 7f2886000640 1 -- 172.21.15.2:0/1108338309 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288002d050 con 0x7f28880cb600 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.732+0000 7f2886000640 1 -- 172.21.15.2:0/1108338309 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800317d0 con 0x7f28880cb600 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 -- 172.21.15.2:0/1108338309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 msgr2=0x7f28880b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 --2- 172.21.15.2:0/1108338309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f28880b1a70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2888066e80 tx=0x7f2880009840 comp rx=0 tx=0).stop 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 -- 172.21.15.2:0/1108338309 shutdown_connections 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 --2- 172.21.15.2:0/1108338309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f28880b1a70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 --2- 172.21.15.2:0/1108338309 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158f80 0x7f28880cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 --2- 172.21.15.2:0/1108338309 >> v2:172.21.15.26:3300/0 conn(0x7f2888158bb0 0x7f28880cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 -- 172.21.15.2:0/1108338309 >> 172.21.15.2:0/1108338309 conn(0x7f288806e590 msgr2=0x7f288806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:07.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 -- 172.21.15.2:0/1108338309 shutdown_connections 2024-08-17T02:47:07.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.733+0000 7f288e400640 1 -- 172.21.15.2:0/1108338309 wait complete. 2024-08-17T02:47:07.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.734+0000 7f288e400640 1 Processor -- start 2024-08-17T02:47:07.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.735+0000 7f288e400640 1 -- start start 2024-08-17T02:47:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.735+0000 7f288e400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f2888159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f288e400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158bb0 0x7f2888144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f288e400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2888158f80 0x7f28880c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f288e400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888145100 con 0x7f28880cb600 2024-08-17T02:47:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f288e400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888142130 con 0x7f2888158f80 2024-08-17T02:47:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f288e400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880c4f50 con 0x7f2888158bb0 2024-08-17T02:47:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f2888159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f2888159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52834/0 (socket says 172.21.15.2:52834) 2024-08-17T02:47:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 -- 172.21.15.2:0/2737256770 learned_addr learned my addr 172.21.15.2:0/2737256770 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:07.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 -- 172.21.15.2:0/2737256770 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158bb0 msgr2=0x7f2888144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158bb0 0x7f2888144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 -- 172.21.15.2:0/2737256770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2888158f80 msgr2=0x7f28880c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2888158f80 0x7f28880c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 -- 172.21.15.2:0/2737256770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2880009ae0 con 0x7f28880cb600 2024-08-17T02:47:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.736+0000 7f2887400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f2888159850 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f287800c880 tx=0x7f2878008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.737+0000 7f287ea00640 1 -- 172.21.15.2:0/2737256770 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28780076b0 con 0x7f28880cb600 2024-08-17T02:47:07.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.737+0000 7f287ea00640 1 -- 172.21.15.2:0/2737256770 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878007810 con 0x7f28880cb600 2024-08-17T02:47:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.737+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28880c4340 con 0x7f28880cb600 2024-08-17T02:47:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.737+0000 7f287ea00640 1 -- 172.21.15.2:0/2737256770 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878007b90 con 0x7f28880cb600 2024-08-17T02:47:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.737+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28880c46d0 con 0x7f28880cb600 2024-08-17T02:47:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.738+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28880c4cd0 con 0x7f28880cb600 2024-08-17T02:47:07.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.739+0000 7f287ea00640 1 -- 172.21.15.2:0/2737256770 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f28780113f0 con 0x7f28880cb600 2024-08-17T02:47:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.739+0000 7f287ea00640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2868065150 0x7f2868067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.740+0000 7f287ea00640 1 -- 172.21.15.2:0/2737256770 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2878082140 con 0x7f28880cb600 2024-08-17T02:47:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.740+0000 7f2886a00640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2868065150 0x7f2868067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:07.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.740+0000 7f2886a00640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2868065150 0x7f2868067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f28881487a0 tx=0x7f2874008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:07.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.743+0000 7f287ea00640 1 -- 172.21.15.2:0/2737256770 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2878050550 con 0x7f28880cb600 2024-08-17T02:47:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:07.925+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2888063fb0 con 0x7f28880cb600 2024-08-17T02:47:08.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.453+0000 7f287ea00640 1 -- 172.21.15.2:0/2737256770 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2878053b70 con 0x7f28880cb600 2024-08-17T02:47:08.454 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-08-17T02:47:08.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.456+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2868065150 msgr2=0x7f2868067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.456+0000 7f288e400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2868065150 0x7f2868067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f28881487a0 tx=0x7f2874008040 comp rx=0 tx=0).stop 2024-08-17T02:47:08.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.456+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 msgr2=0x7f2888159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.456+0000 7f288e400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f2888159850 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f287800c880 tx=0x7f2878008040 comp rx=0 tx=0).stop 2024-08-17T02:47:08.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.457+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 shutdown_connections 2024-08-17T02:47:08.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.457+0000 7f288e400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2888158f80 0x7f28880c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.457+0000 7f288e400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2868065150 0x7f2868067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.457+0000 7f288e400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2888158bb0 0x7f2888144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.457+0000 7f288e400640 1 --2- 172.21.15.2:0/2737256770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28880cb600 0x7f2888159850 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.457+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 >> 172.21.15.2:0/2737256770 conn(0x7f288806e590 msgr2=0x7f28880b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.457+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 shutdown_connections 2024-08-17T02:47:08.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.457+0000 7f288e400640 1 -- 172.21.15.2:0/2737256770 wait complete. 2024-08-17T02:47:08.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:47:08.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.637+0000 7f7d96800640 1 Processor -- start 2024-08-17T02:47:08.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.637+0000 7f7d96800640 1 -- start start 2024-08-17T02:47:08.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.638+0000 7f7d96800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 0x7f7d9015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.638+0000 7f7d96800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d900ca050 0x7f7d90156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.638+0000 7f7d96800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9015b5e0 con 0x7f7d900add30 2024-08-17T02:47:08.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.638+0000 7f7d96800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d900cb160 con 0x7f7d900ca050 2024-08-17T02:47:08.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.638+0000 7f7d96800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900b0d10 con 0x7f7d900ad960 2024-08-17T02:47:08.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8fe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7d900add30 0x7f7d90156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48038/0 (socket says 172.21.15.2:48038) 2024-08-17T02:47:08.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8fe00640 1 -- 172.21.15.2:0/4133409756 learned_addr learned my addr 172.21.15.2:0/4133409756 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:08.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8f400640 1 --2- 172.21.15.2:0/4133409756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 0x7f7d9015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8ea00640 1 --2- 172.21.15.2:0/4133409756 >> v2:172.21.15.26:3300/0 conn(0x7f7d900ca050 0x7f7d90156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8e000640 1 -- 172.21.15.2:0/4133409756 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104140970 0 0) 0x7f7d88001490 con 0x7f7d900add30 2024-08-17T02:47:08.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8e000640 1 -- 172.21.15.2:0/4133409756 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d740034e0 con 0x7f7d900add30 2024-08-17T02:47:08.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8ea00640 1 -- 172.21.15.2:0/4133409756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 msgr2=0x7f7d9015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:08.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8ea00640 1 --2- 172.21.15.2:0/4133409756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 0x7f7d9015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8ea00640 1 -- 172.21.15.2:0/4133409756 >> v1:172.21.15.2:6789/0 conn(0x7f7d900add30 legacy=0x7f7d90156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.639+0000 7f7d8ea00640 1 -- 172.21.15.2:0/4133409756 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900ca550 con 0x7f7d900ca050 2024-08-17T02:47:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.640+0000 7f7d8ea00640 1 --2- 172.21.15.2:0/4133409756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 0x7f7d90156420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009850 tx=0x7f7d7c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc522a66fb76cbba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d8e000640 1 -- 172.21.15.2:0/4133409756 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c02ae10 con 0x7f7d900ca050 2024-08-17T02:47:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d8e000640 1 -- 172.21.15.2:0/4133409756 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c032440 con 0x7f7d900ca050 2024-08-17T02:47:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d8e000640 1 -- 172.21.15.2:0/4133409756 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c032800 con 0x7f7d900ca050 2024-08-17T02:47:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d96800640 1 -- 172.21.15.2:0/4133409756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 msgr2=0x7f7d90156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d96800640 1 --2- 172.21.15.2:0/4133409756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 0x7f7d90156420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009850 tx=0x7f7d7c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d96800640 1 -- 172.21.15.2:0/4133409756 shutdown_connections 2024-08-17T02:47:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d96800640 1 --2- 172.21.15.2:0/4133409756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 0x7f7d90156420 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d96800640 1 --2- 172.21.15.2:0/4133409756 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 0x7f7d9015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d96800640 1 -- 172.21.15.2:0/4133409756 >> 172.21.15.2:0/4133409756 conn(0x7f7d90066e60 msgr2=0x7f7d90067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d96800640 1 -- 172.21.15.2:0/4133409756 shutdown_connections 2024-08-17T02:47:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.641+0000 7f7d96800640 1 -- 172.21.15.2:0/4133409756 wait complete. 2024-08-17T02:47:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.643+0000 7f7d96800640 1 Processor -- start 2024-08-17T02:47:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.643+0000 7f7d96800640 1 -- start start 2024-08-17T02:47:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d96800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 0x7f7d9015b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d96800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900add30 0x7f7d9014b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d96800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 0x7f7d9014b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d96800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900aac90 con 0x7f7d900add30 2024-08-17T02:47:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d96800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9014ba90 con 0x7f7d900ca050 2024-08-17T02:47:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d96800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d900aa360 con 0x7f7d900ad960 2024-08-17T02:47:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d8ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900add30 0x7f7d9014b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d8ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900add30 0x7f7d9014b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52850/0 (socket says 172.21.15.2:52850) 2024-08-17T02:47:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d8f400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 0x7f7d9015b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d8ea00640 1 -- 172.21.15.2:0/289513300 learned_addr learned my addr 172.21.15.2:0/289513300 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.644+0000 7f7d8fe00640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 0x7f7d9014b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d8ea00640 1 -- 172.21.15.2:0/289513300 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 msgr2=0x7f7d9015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d8ea00640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 0x7f7d9015b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d8ea00640 1 -- 172.21.15.2:0/289513300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 msgr2=0x7f7d9014b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d8ea00640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 0x7f7d9014b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d8ea00640 1 -- 172.21.15.2:0/289513300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c009390 con 0x7f7d900add30 2024-08-17T02:47:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d8ea00640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900add30 0x7f7d9014b010 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009130 tx=0x7f7d7c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d86a00640 1 -- 172.21.15.2:0/289513300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c031830 con 0x7f7d900add30 2024-08-17T02:47:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d86a00640 1 -- 172.21.15.2:0/289513300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0319b0 con 0x7f7d900add30 2024-08-17T02:47:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d86a00640 1 -- 172.21.15.2:0/289513300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c031d70 con 0x7f7d900add30 2024-08-17T02:47:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d900aa640 con 0x7f7d900add30 2024-08-17T02:47:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.645+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d900aa010 con 0x7f7d900add30 2024-08-17T02:47:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.646+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d900aae40 con 0x7f7d900add30 2024-08-17T02:47:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.648+0000 7f7d86a00640 1 -- 172.21.15.2:0/289513300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7d7c039050 con 0x7f7d900add30 2024-08-17T02:47:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.648+0000 7f7d86a00640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d70065150 0x7f7d70067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.648+0000 7f7d86a00640 1 -- 172.21.15.2:0/289513300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f7d7c0a2d20 con 0x7f7d900add30 2024-08-17T02:47:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.649+0000 7f7d8f400640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d70065150 0x7f7d70067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.649+0000 7f7d8f400640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d70065150 0x7f7d70067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009d20 tx=0x7f7d800090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.652+0000 7f7d86a00640 1 -- 172.21.15.2:0/289513300 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7d7c071050 con 0x7f7d900add30 2024-08-17T02:47:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:08.840+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7d90063fb0 con 0x7f7d900add30 2024-08-17T02:47:09.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:09.164 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.461+0000 7f7d86a00640 1 -- 172.21.15.2:0/289513300 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7d7c074670 con 0x7f7d900add30 2024-08-17T02:47:09.462 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-08-17T02:47:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d70065150 msgr2=0x7f7d70067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d70065150 0x7f7d70067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009d20 tx=0x7f7d800090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900add30 msgr2=0x7f7d9014b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900add30 0x7f7d9014b010 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009130 tx=0x7f7d7c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 shutdown_connections 2024-08-17T02:47:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d900ca050 0x7f7d9014b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d900add30 0x7f7d9014b010 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7d70065150 0x7f7d70067600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 --2- 172.21.15.2:0/289513300 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7d900ad960 0x7f7d9015b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.466+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 >> 172.21.15.2:0/289513300 conn(0x7f7d90066e60 msgr2=0x7f7d90152170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.467+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 shutdown_connections 2024-08-17T02:47:09.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.467+0000 7f7d96800640 1 -- 172.21.15.2:0/289513300 wait complete. 2024-08-17T02:47:09.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:47:09.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.647+0000 7f0911600640 1 Processor -- start 2024-08-17T02:47:09.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.648+0000 7f0911600640 1 -- start start 2024-08-17T02:47:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f0911600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090c158b80 0x7f090c06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f0911600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f090c0af040 0x7f090c06b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f0911600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c06b6e0 con 0x7f090c158f50 2024-08-17T02:47:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f0911600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c0b00c0 con 0x7f090c158b80 2024-08-17T02:47:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f0911600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c0af7d0 con 0x7f090c0af040 2024-08-17T02:47:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f090be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f090c158b80 0x7f090c06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f0903e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f090c158f50 0x7f090c0ae930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48048/0 (socket says 172.21.15.2:48048) 2024-08-17T02:47:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f0903e00640 1 -- 172.21.15.2:0/3211901251 learned_addr learned my addr 172.21.15.2:0/3211901251 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f0910c00640 1 --2- 172.21.15.2:0/3211901251 >> v2:172.21.15.26:3300/0 conn(0x7f090c0af040 0x7f090c06b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.649+0000 7f090b400640 1 -- 172.21.15.2:0/3211901251 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645466530 0 0) 0x7f090c06b6e0 con 0x7f090c158f50 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.650+0000 7f090b400640 1 -- 172.21.15.2:0/3211901251 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08f00034e0 con 0x7f090c158f50 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.650+0000 7f090be00640 1 -- 172.21.15.2:0/3211901251 >> v2:172.21.15.26:3300/0 conn(0x7f090c0af040 msgr2=0x7f090c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.650+0000 7f090be00640 1 --2- 172.21.15.2:0/3211901251 >> v2:172.21.15.26:3300/0 conn(0x7f090c0af040 0x7f090c06b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.650+0000 7f090be00640 1 -- 172.21.15.2:0/3211901251 >> v1:172.21.15.2:6789/0 conn(0x7f090c158f50 legacy=0x7f090c0ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.650+0000 7f090be00640 1 -- 172.21.15.2:0/3211901251 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c0afa70 con 0x7f090c158b80 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.651+0000 7f090be00640 1 --2- 172.21.15.2:0/3211901251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c158b80 0x7f090c06c400 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f090c0ca2b0 tx=0x7f08fc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f05fe242901c59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.651+0000 7f090b400640 1 -- 172.21.15.2:0/3211901251 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc02ad20 con 0x7f090c158b80 2024-08-17T02:47:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.651+0000 7f090b400640 1 -- 172.21.15.2:0/3211901251 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc02ae80 con 0x7f090c158b80 2024-08-17T02:47:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.651+0000 7f090b400640 1 -- 172.21.15.2:0/3211901251 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc032670 con 0x7f090c158b80 2024-08-17T02:47:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.651+0000 7f0911600640 1 -- 172.21.15.2:0/3211901251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c158b80 msgr2=0x7f090c06c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.651+0000 7f0911600640 1 --2- 172.21.15.2:0/3211901251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c158b80 0x7f090c06c400 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f090c0ca2b0 tx=0x7f08fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.652+0000 7f0911600640 1 -- 172.21.15.2:0/3211901251 shutdown_connections 2024-08-17T02:47:09.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.652+0000 7f0911600640 1 --2- 172.21.15.2:0/3211901251 >> v2:172.21.15.26:3300/0 conn(0x7f090c0af040 0x7f090c06b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.652+0000 7f0911600640 1 --2- 172.21.15.2:0/3211901251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c158b80 0x7f090c06c400 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.652+0000 7f0911600640 1 -- 172.21.15.2:0/3211901251 >> 172.21.15.2:0/3211901251 conn(0x7f090c095a70 msgr2=0x7f090c095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:09.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.652+0000 7f0911600640 1 -- 172.21.15.2:0/3211901251 shutdown_connections 2024-08-17T02:47:09.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.652+0000 7f0911600640 1 -- 172.21.15.2:0/3211901251 wait complete. 2024-08-17T02:47:09.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.653+0000 7f0911600640 1 Processor -- start 2024-08-17T02:47:09.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.653+0000 7f0911600640 1 -- start start 2024-08-17T02:47:09.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f0911600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0af040 0x7f090c168ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f0911600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090c158b80 0x7f090c0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f0911600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c158f50 0x7f090c0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f0911600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0abfa0 con 0x7f090c0af040 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f0911600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0ae280 con 0x7f090c158f50 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f0911600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0ae4b0 con 0x7f090c158b80 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f090be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0af040 0x7f090c168ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f090be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0af040 0x7f090c168ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52868/0 (socket says 172.21.15.2:52868) 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.654+0000 7f090be00640 1 -- 172.21.15.2:0/3335517619 learned_addr learned my addr 172.21.15.2:0/3335517619 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f0910c00640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c158f50 0x7f090c0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f0903e00640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090c158b80 0x7f090c0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f090be00640 1 -- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090c158b80 msgr2=0x7f090c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f090be00640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090c158b80 0x7f090c0ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f090be00640 1 -- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c158f50 msgr2=0x7f090c0add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f090be00640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c158f50 0x7f090c0add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f090be00640 1 -- 172.21.15.2:0/3335517619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc009390 con 0x7f090c0af040 2024-08-17T02:47:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f0910c00640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c158f50 0x7f090c0add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.655+0000 7f090be00640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0af040 0x7f090c168ec0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f08fc035040 tx=0x7f08fc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.656+0000 7f0903400640 1 -- 172.21.15.2:0/3335517619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc031700 con 0x7f090c0af040 2024-08-17T02:47:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.656+0000 7f0903400640 1 -- 172.21.15.2:0/3335517619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc031880 con 0x7f090c0af040 2024-08-17T02:47:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.656+0000 7f0903400640 1 -- 172.21.15.2:0/3335517619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc031c40 con 0x7f090c0af040 2024-08-17T02:47:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.656+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c0ae790 con 0x7f090c0af040 2024-08-17T02:47:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.656+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c0abbc0 con 0x7f090c0af040 2024-08-17T02:47:09.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.657+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c070720 con 0x7f090c0af040 2024-08-17T02:47:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.658+0000 7f0903400640 1 -- 172.21.15.2:0/3335517619 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08fc043030 con 0x7f090c0af040 2024-08-17T02:47:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.658+0000 7f0903400640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f08e8065150 0x7f08e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.658+0000 7f0903400640 1 -- 172.21.15.2:0/3335517619 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f08fc041070 con 0x7f090c0af040 2024-08-17T02:47:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.659+0000 7f0903e00640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f08e8065150 0x7f08e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:09.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.659+0000 7f0903e00640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f08e8065150 0x7f08e8067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f090c0cc220 tx=0x7f08f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:09.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.663+0000 7f0903400640 1 -- 172.21.15.2:0/3335517619 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f08fc0709f0 con 0x7f090c0af040 2024-08-17T02:47:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:09.886+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f090c15c360 con 0x7f090c0af040 2024-08-17T02:47:10.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.463+0000 7f0903400640 1 -- 172.21.15.2:0/3335517619 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f08fc0370c0 con 0x7f090c0af040 2024-08-17T02:47:10.466 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:47:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.467+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f08e8065150 msgr2=0x7f08e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.467+0000 7f0911600640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f08e8065150 0x7f08e8067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f090c0cc220 tx=0x7f08f4009040 comp rx=0 tx=0).stop 2024-08-17T02:47:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.467+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0af040 msgr2=0x7f090c168ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.467+0000 7f0911600640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0af040 0x7f090c168ec0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f08fc035040 tx=0x7f08fc032000 comp rx=0 tx=0).stop 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.469+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 shutdown_connections 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.469+0000 7f0911600640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f090c158f50 0x7f090c0add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.469+0000 7f0911600640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f08e8065150 0x7f08e8067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.469+0000 7f0911600640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f090c158b80 0x7f090c0ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.469+0000 7f0911600640 1 --2- 172.21.15.2:0/3335517619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f090c0af040 0x7f090c168ec0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.469+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 >> 172.21.15.2:0/3335517619 conn(0x7f090c095a70 msgr2=0x7f090c0cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:10.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.475+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 shutdown_connections 2024-08-17T02:47:10.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.475+0000 7f0911600640 1 -- 172.21.15.2:0/3335517619 wait complete. 2024-08-17T02:47:10.506 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:10.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.657+0000 7fd2a6000640 1 Processor -- start 2024-08-17T02:47:10.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.657+0000 7fd2a6000640 1 -- start start 2024-08-17T02:47:10.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.658+0000 7fd2a6000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2a00ca050 0x7fd2a0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.658+0000 7fd2a6000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00add30 0x7fd2a015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.658+0000 7fd2a6000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a015b5e0 con 0x7fd2a00ad960 2024-08-17T02:47:10.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.658+0000 7fd2a6000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00cb160 con 0x7fd2a00ca050 2024-08-17T02:47:10.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.658+0000 7fd2a6000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00b0d10 con 0x7fd2a00add30 2024-08-17T02:47:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.659+0000 7fd29fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00add30 0x7fd2a015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.659+0000 7fd29ea00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2a00ca050 0x7fd2a0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.659+0000 7fd29f400640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2a00ad960 0x7fd2a0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:46372/0 (socket says 172.21.15.2:46372) 2024-08-17T02:47:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.659+0000 7fd29f400640 1 -- 172.21.15.2:0/1951510963 learned_addr learned my addr 172.21.15.2:0/1951510963 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.659+0000 7fd29ea00640 1 -- 172.21.15.2:0/1951510963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00add30 msgr2=0x7fd2a015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:10.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.659+0000 7fd29ea00640 1 --2- 172.21.15.2:0/1951510963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00add30 0x7fd2a015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.659+0000 7fd29ea00640 1 -- 172.21.15.2:0/1951510963 >> v1:172.21.15.26:6789/0 conn(0x7fd2a00ad960 legacy=0x7fd2a0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.659+0000 7fd29ea00640 1 -- 172.21.15.2:0/1951510963 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00ca550 con 0x7fd2a00ca050 2024-08-17T02:47:10.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.660+0000 7fd29ea00640 1 --2- 172.21.15.2:0/1951510963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 0x7fd2a0156b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009850 tx=0x7fd28c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f3fc9874c925207 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd29e000640 1 -- 172.21.15.2:0/1951510963 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c02ae20 con 0x7fd2a00ca050 2024-08-17T02:47:10.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd29e000640 1 -- 172.21.15.2:0/1951510963 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c032440 con 0x7fd2a00ca050 2024-08-17T02:47:10.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd29e000640 1 -- 172.21.15.2:0/1951510963 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c032820 con 0x7fd2a00ca050 2024-08-17T02:47:10.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd2a6000640 1 -- 172.21.15.2:0/1951510963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 msgr2=0x7fd2a0156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd2a6000640 1 --2- 172.21.15.2:0/1951510963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 0x7fd2a0156b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009850 tx=0x7fd28c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd2a6000640 1 -- 172.21.15.2:0/1951510963 shutdown_connections 2024-08-17T02:47:10.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd2a6000640 1 --2- 172.21.15.2:0/1951510963 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00add30 0x7fd2a015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd2a6000640 1 --2- 172.21.15.2:0/1951510963 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 0x7fd2a0156b30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd2a6000640 1 -- 172.21.15.2:0/1951510963 >> 172.21.15.2:0/1951510963 conn(0x7fd2a0066e60 msgr2=0x7fd2a0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:10.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd2a6000640 1 -- 172.21.15.2:0/1951510963 shutdown_connections 2024-08-17T02:47:10.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.661+0000 7fd2a6000640 1 -- 172.21.15.2:0/1951510963 wait complete. 2024-08-17T02:47:10.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.663+0000 7fd2a6000640 1 Processor -- start 2024-08-17T02:47:10.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.663+0000 7fd2a6000640 1 -- start start 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd2a6000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00ad960 0x7fd2a01531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd2a6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a00add30 0x7fd2a01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd2a6000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 0x7fd2a0170fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd2a6000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0170b50 con 0x7fd2a00add30 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd2a6000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0140610 con 0x7fd2a00ca050 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd2a6000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a01584e0 con 0x7fd2a00ad960 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd29ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a00add30 0x7fd2a01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd29ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a00add30 0x7fd2a01536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52876/0 (socket says 172.21.15.2:52876) 2024-08-17T02:47:10.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd29ea00640 1 -- 172.21.15.2:0/925828819 learned_addr learned my addr 172.21.15.2:0/925828819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:10.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd29fe00640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 0x7fd2a0170fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.664+0000 7fd29f400640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00ad960 0x7fd2a01531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd29ea00640 1 -- 172.21.15.2:0/925828819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00ad960 msgr2=0x7fd2a01531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd29ea00640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00ad960 0x7fd2a01531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd29ea00640 1 -- 172.21.15.2:0/925828819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 msgr2=0x7fd2a0170fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd29ea00640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 0x7fd2a0170fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd29ea00640 1 -- 172.21.15.2:0/925828819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c009390 con 0x7fd2a00add30 2024-08-17T02:47:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd29ea00640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a00add30 0x7fd2a01536f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009850 tx=0x7fd28c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd296a00640 1 -- 172.21.15.2:0/925828819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c000d10 con 0x7fd2a00add30 2024-08-17T02:47:10.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd296a00640 1 -- 172.21.15.2:0/925828819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c031e00 con 0x7fd2a00add30 2024-08-17T02:47:10.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd296a00640 1 -- 172.21.15.2:0/925828819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c03e6a0 con 0x7fd2a00add30 2024-08-17T02:47:10.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a016da10 con 0x7fd2a00add30 2024-08-17T02:47:10.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.665+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a016dfd0 con 0x7fd2a00add30 2024-08-17T02:47:10.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.666+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a0170cc0 con 0x7fd2a00add30 2024-08-17T02:47:10.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.667+0000 7fd296a00640 1 -- 172.21.15.2:0/925828819 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd28c03c400 con 0x7fd2a00add30 2024-08-17T02:47:10.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.668+0000 7fd296a00640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd280065150 0x7fd280067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:10.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.668+0000 7fd296a00640 1 -- 172.21.15.2:0/925828819 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd28c0a2880 con 0x7fd2a00add30 2024-08-17T02:47:10.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.668+0000 7fd29f400640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd280065150 0x7fd280067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:10.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.669+0000 7fd29f400640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd280065150 0x7fd280067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd2a006d080 tx=0x7fd290007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:10.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.672+0000 7fd296a00640 1 -- 172.21.15.2:0/925828819 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd2a0170cc0 con 0x7fd2a00add30 2024-08-17T02:47:10.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.855+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2a0170c90 con 0x7fd2a00add30 2024-08-17T02:47:10.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.856+0000 7fd296a00640 1 -- 172.21.15.2:0/925828819 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15267 (secure 0 0 0) 0x7fd28c043090 con 0x7fd2a00add30 2024-08-17T02:47:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:10.857 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:47:09.888284+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:07.966246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:08.880865+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:10.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd280065150 msgr2=0x7fd280067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd280065150 0x7fd280067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd2a006d080 tx=0x7fd290007e20 comp rx=0 tx=0).stop 2024-08-17T02:47:10.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a00add30 msgr2=0x7fd2a01536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:10.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a00add30 0x7fd2a01536f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009850 tx=0x7fd28c032000 comp rx=0 tx=0).stop 2024-08-17T02:47:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 shutdown_connections 2024-08-17T02:47:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2a00ca050 0x7fd2a0170fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2a00add30 0x7fd2a01536f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd280065150 0x7fd280067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 --2- 172.21.15.2:0/925828819 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd2a00ad960 0x7fd2a01531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 >> 172.21.15.2:0/925828819 conn(0x7fd2a0066e60 msgr2=0x7fd2a0155250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 shutdown_connections 2024-08-17T02:47:10.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:10.858+0000 7fd2a6000640 1 -- 172.21.15.2:0/925828819 wait complete. 2024-08-17T02:47:10.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:11.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.024+0000 7f339c400640 1 Processor -- start 2024-08-17T02:47:11.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.024+0000 7f339c400640 1 -- start start 2024-08-17T02:47:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f339c400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940afca0 0x7f33940b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f339c400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940c92b0 con 0x7f33940acf10 2024-08-17T02:47:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f339c400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940ad480 con 0x7f33941590b0 2024-08-17T02:47:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f339c400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940b0980 con 0x7f33940afca0 2024-08-17T02:47:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f3399000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f33940acf10 0x7f33941589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48054/0 (socket says 172.21.15.2:48054) 2024-08-17T02:47:11.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f3399000640 1 -- 172.21.15.2:0/835457280 learned_addr learned my addr 172.21.15.2:0/835457280 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f3399a00640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940afca0 0x7f33940b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63427409 0 0) 0x7f33940c92b0 con 0x7f33940acf10 2024-08-17T02:47:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.026+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c0034e0 con 0x7f33940acf10 2024-08-17T02:47:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222808323 0 0) 0x7f33940ad480 con 0x7f33941590b0 2024-08-17T02:47:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33940c92b0 con 0x7f33941590b0 2024-08-17T02:47:11.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477742033 0 0) 0x7f337c0034e0 con 0x7f33940acf10 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940afca0 msgr2=0x7f33940b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940afca0 0x7f33940b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 >> v1:172.21.15.26:6789/0 conn(0x7f33941590b0 legacy=0x7f33940c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940ad760 con 0x7f33940acf10 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f3380001470 con 0x7f33940acf10 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 >> v1:172.21.15.2:6789/0 conn(0x7f33940acf10 legacy=0x7f33941589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940afca0 0x7f337c003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c0040f0 0x7f337c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c004cc0 0x7f337c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bae0 con 0x7f337c0040f0 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bc50 con 0x7f337c004cc0 2024-08-17T02:47:11.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00be10 con 0x7f33940afca0 2024-08-17T02:47:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3399000640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c0040f0 0x7f337c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f3399a00640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940afca0 0x7f337c003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.027+0000 7f339a400640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c004cc0 0x7f337c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.028+0000 7f3399000640 1 -- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940afca0 msgr2=0x7f337c003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.028+0000 7f3399000640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940afca0 0x7f337c003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.028+0000 7f3399000640 1 -- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c004cc0 msgr2=0x7f337c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.028+0000 7f3399000640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c004cc0 0x7f337c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.028+0000 7f3399000640 1 -- 172.21.15.2:0/835457280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0034e0 con 0x7f337c0040f0 2024-08-17T02:47:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.029+0000 7f3399000640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c0040f0 0x7f337c004780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f338000e4e0 tx=0x7f33800078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db01c70b37878f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.029+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380005890 con 0x7f337c0040f0 2024-08-17T02:47:11.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.029+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380005a30 con 0x7f337c0040f0 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.029+0000 7f3393e00640 1 -- 172.21.15.2:0/835457280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380005e30 con 0x7f337c0040f0 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.030+0000 7f339c400640 1 -- 172.21.15.2:0/835457280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c0040f0 msgr2=0x7f337c004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.030+0000 7f339c400640 1 --2- 172.21.15.2:0/835457280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f337c0040f0 0x7f337c004780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f338000e4e0 tx=0x7f33800078b0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.030+0000 7f339a400640 1 -- 172.21.15.2:0/835457280 reap_dead start 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.030+0000 7f339c400640 1 -- 172.21.15.2:0/835457280 shutdown_connections 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.030+0000 7f339c400640 1 -- 172.21.15.2:0/835457280 >> 172.21.15.2:0/835457280 conn(0x7f3394066e60 msgr2=0x7f3394067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.030+0000 7f339c400640 1 -- 172.21.15.2:0/835457280 shutdown_connections 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.030+0000 7f339c400640 1 -- 172.21.15.2:0/835457280 wait complete. 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.031+0000 7f339c400640 1 Processor -- start 2024-08-17T02:47:11.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.031+0000 7f339c400640 1 -- start start 2024-08-17T02:47:11.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f339c400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c0040f0 0x7f3394149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f339c400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339414e2f0 0x7f339414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f339c400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940c6c70 0x7f33940c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f339c400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339414ee00 con 0x7f339414e2f0 2024-08-17T02:47:11.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f339c400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3394149bd0 con 0x7f337c0040f0 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f339c400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940c7620 con 0x7f33940c6c70 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f3399000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339414e2f0 0x7f339414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f3399000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339414e2f0 0x7f339414e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52888/0 (socket says 172.21.15.2:52888) 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.032+0000 7f3399000640 1 -- 172.21.15.2:0/1408988897 learned_addr learned my addr 172.21.15.2:0/1408988897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3399a00640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c0040f0 0x7f3394149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f339a400640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940c6c70 0x7f33940c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3399000640 1 -- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940c6c70 msgr2=0x7f33940c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3399000640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940c6c70 0x7f33940c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3399000640 1 -- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c0040f0 msgr2=0x7f3394149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3399000640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c0040f0 0x7f3394149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3399000640 1 -- 172.21.15.2:0/1408988897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339414e050 con 0x7f339414e2f0 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3399a00640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c0040f0 0x7f3394149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:11.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f339a400640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940c6c70 0x7f33940c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3399000640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339414e2f0 0x7f339414e760 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f338002d370 tx=0x7f3380036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3390c00640 1 -- 172.21.15.2:0/1408988897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380007510 con 0x7f339414e2f0 2024-08-17T02:47:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3390c00640 1 -- 172.21.15.2:0/1408988897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380007670 con 0x7f339414e2f0 2024-08-17T02:47:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f3390c00640 1 -- 172.21.15.2:0/1408988897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338002da00 con 0x7f339414e2f0 2024-08-17T02:47:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.033+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339414d290 con 0x7f339414e2f0 2024-08-17T02:47:11.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.034+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339414d850 con 0x7f339414e2f0 2024-08-17T02:47:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.035+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339414ee00 con 0x7f339414e2f0 2024-08-17T02:47:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.035+0000 7f3390c00640 1 -- 172.21.15.2:0/1408988897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3380033070 con 0x7f339414e2f0 2024-08-17T02:47:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.036+0000 7f3390c00640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3374065150 0x7f3374067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.036+0000 7f3390c00640 1 -- 172.21.15.2:0/1408988897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f33800a26f0 con 0x7f339414e2f0 2024-08-17T02:47:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.037+0000 7f3399a00640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3374065150 0x7f3374067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.037+0000 7f3399a00640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3374065150 0x7f3374067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3388009360 tx=0x7f3388008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.041+0000 7f3390c00640 1 -- 172.21.15.2:0/1408988897 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f33800707b0 con 0x7f339414e2f0 2024-08-17T02:47:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.226+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3394063fb0 con 0x7f339414e2f0 2024-08-17T02:47:11.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.227+0000 7f3390c00640 1 -- 172.21.15.2:0/1408988897 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15267 (secure 0 0 0) 0x7f3380073dd0 con 0x7f339414e2f0 2024-08-17T02:47:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:11.228 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:47:09.888284+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:07.966246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:08.880865+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.229+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3374065150 msgr2=0x7f3374067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.229+0000 7f339c400640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3374065150 0x7f3374067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3388009360 tx=0x7f3388008040 comp rx=0 tx=0).stop 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339414e2f0 msgr2=0x7f339414e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339414e2f0 0x7f339414e760 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f338002d370 tx=0x7f3380036000 comp rx=0 tx=0).stop 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 shutdown_connections 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f3374065150 0x7f3374067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f33940c6c70 0x7f33940c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f339414e2f0 0x7f339414e760 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 --2- 172.21.15.2:0/1408988897 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f337c0040f0 0x7f3394149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 >> 172.21.15.2:0/1408988897 conn(0x7f3394066e60 msgr2=0x7f3394069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:11.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 shutdown_connections 2024-08-17T02:47:11.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.230+0000 7f339c400640 1 -- 172.21.15.2:0/1408988897 wait complete. 2024-08-17T02:47:11.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:47:11.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.400+0000 7ff05d400640 1 Processor -- start 2024-08-17T02:47:11.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.400+0000 7ff05d400640 1 -- start start 2024-08-17T02:47:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.401+0000 7ff05d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff058158a20 0x7ff0580a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.401+0000 7ff05d400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0580ae860 0x7ff05806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.401+0000 7ff05d400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff058158df0 0x7ff05806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.401+0000 7ff05d400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0580aed90 con 0x7ff058158a20 2024-08-17T02:47:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.401+0000 7ff05d400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0580af070 con 0x7ff058158df0 2024-08-17T02:47:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.401+0000 7ff05d400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580af350 con 0x7ff0580ae860 2024-08-17T02:47:11.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.401+0000 7ff056800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff058158a20 0x7ff0580a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.401+0000 7ff056800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff058158a20 0x7ff0580a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52892/0 (socket says 172.21.15.2:52892) 2024-08-17T02:47:11.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff056800640 1 -- 172.21.15.2:0/3190776986 learned_addr learned my addr 172.21.15.2:0/3190776986 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:11.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff057200640 1 --2- 172.21.15.2:0/3190776986 >> v2:172.21.15.26:3300/0 conn(0x7ff058158df0 0x7ff05806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff04fe00640 1 --2- 172.21.15.2:0/3190776986 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0580ae860 0x7ff05806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff056800640 1 -- 172.21.15.2:0/3190776986 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0580ae860 msgr2=0x7ff05806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:11.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff056800640 1 --2- 172.21.15.2:0/3190776986 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0580ae860 0x7ff05806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff056800640 1 -- 172.21.15.2:0/3190776986 >> v2:172.21.15.26:3300/0 conn(0x7ff058158df0 msgr2=0x7ff05806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff056800640 1 --2- 172.21.15.2:0/3190776986 >> v2:172.21.15.26:3300/0 conn(0x7ff058158df0 0x7ff05806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff056800640 1 -- 172.21.15.2:0/3190776986 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580af630 con 0x7ff058158a20 2024-08-17T02:47:11.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.402+0000 7ff04fe00640 1 --2- 172.21.15.2:0/3190776986 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0580ae860 0x7ff05806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.403+0000 7ff056800640 1 --2- 172.21.15.2:0/3190776986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff058158a20 0x7ff0580a89c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff058067d20 tx=0x7ff0480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d4a33eb5027f5c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.403+0000 7ff055e00640 1 -- 172.21.15.2:0/3190776986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04802add0 con 0x7ff058158a20 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.403+0000 7ff055e00640 1 -- 172.21.15.2:0/3190776986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff048032440 con 0x7ff058158a20 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.403+0000 7ff055e00640 1 -- 172.21.15.2:0/3190776986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048032820 con 0x7ff058158a20 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 -- 172.21.15.2:0/3190776986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff058158a20 msgr2=0x7ff0580a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 --2- 172.21.15.2:0/3190776986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff058158a20 0x7ff0580a89c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff058067d20 tx=0x7ff0480091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 -- 172.21.15.2:0/3190776986 shutdown_connections 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 --2- 172.21.15.2:0/3190776986 >> v2:172.21.15.26:3300/0 conn(0x7ff058158df0 0x7ff05806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 --2- 172.21.15.2:0/3190776986 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff0580ae860 0x7ff05806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 --2- 172.21.15.2:0/3190776986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff058158a20 0x7ff0580a89c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 -- 172.21.15.2:0/3190776986 >> 172.21.15.2:0/3190776986 conn(0x7ff058066e60 msgr2=0x7ff058067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 -- 172.21.15.2:0/3190776986 shutdown_connections 2024-08-17T02:47:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.404+0000 7ff05d400640 1 -- 172.21.15.2:0/3190776986 wait complete. 2024-08-17T02:47:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.405+0000 7ff05d400640 1 Processor -- start 2024-08-17T02:47:11.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.406+0000 7ff05d400640 1 -- start start 2024-08-17T02:47:11.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.406+0000 7ff05d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0580ae860 0x7ff0581544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.406+0000 7ff05d400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff058158a20 0x7ff058140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.406+0000 7ff05d400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff058158df0 0x7ff058140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.406+0000 7ff05d400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058154dc0 con 0x7ff0580ae860 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.406+0000 7ff05d400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0581550a0 con 0x7ff058158df0 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.406+0000 7ff05d400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff058155380 con 0x7ff058158a20 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0580ae860 0x7ff0581544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0580ae860 0x7ff0581544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52896/0 (socket says 172.21.15.2:52896) 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 -- 172.21.15.2:0/3073577466 learned_addr learned my addr 172.21.15.2:0/3073577466 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff057200640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff058158df0 0x7ff058140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff04fe00640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff058158a20 0x7ff058140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 -- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff058158a20 msgr2=0x7ff058140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff058158a20 0x7ff058140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 -- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff058158df0 msgr2=0x7ff058140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff058158df0 0x7ff058140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 -- 172.21.15.2:0/3073577466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048009450 con 0x7ff0580ae860 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff057200640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff058158df0 0x7ff058140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.407+0000 7ff056800640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0580ae860 0x7ff0581544e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff048035040 tx=0x7ff048032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.408+0000 7ff04e000640 1 -- 172.21.15.2:0/3073577466 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048000c40 con 0x7ff0580ae860 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.408+0000 7ff04e000640 1 -- 172.21.15.2:0/3073577466 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff048031a60 con 0x7ff0580ae860 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.408+0000 7ff04e000640 1 -- 172.21.15.2:0/3073577466 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048031e60 con 0x7ff0580ae860 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.408+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05816a3a0 con 0x7ff0580ae860 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.408+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff058154a20 con 0x7ff0580ae860 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.409+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05816a8a0 con 0x7ff0580ae860 2024-08-17T02:47:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.410+0000 7ff04e000640 1 -- 172.21.15.2:0/3073577466 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff048039040 con 0x7ff0580ae860 2024-08-17T02:47:11.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.410+0000 7ff04e000640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff034065150 0x7ff034067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:11.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.410+0000 7ff04e000640 1 -- 172.21.15.2:0/3073577466 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0480a1f80 con 0x7ff0580ae860 2024-08-17T02:47:11.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.411+0000 7ff04fe00640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff034065150 0x7ff034067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:11.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.411+0000 7ff04fe00640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff034065150 0x7ff034067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff0580ad0e0 tx=0x7ff040008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:11.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.414+0000 7ff04e000640 1 -- 172.21.15.2:0/3073577466 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff0480d3e40 con 0x7ff0580ae860 2024-08-17T02:47:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:11.642+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff058063fb0 con 0x7ff0580ae860 2024-08-17T02:47:12.353 INFO:tasks.ceph.mds.a.smithi002.stderr:2024-08-17T02:47:12.353+0000 7fbef1c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:47:12.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.482+0000 7ff04e000640 1 -- 172.21.15.2:0/3073577466 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff0480370b0 con 0x7ff0580ae860 2024-08-17T02:47:12.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff034065150 msgr2=0x7ff034067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff034065150 0x7ff034067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff0580ad0e0 tx=0x7ff040008040 comp rx=0 tx=0).stop 2024-08-17T02:47:12.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0580ae860 msgr2=0x7ff0581544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0580ae860 0x7ff0581544e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff048035040 tx=0x7ff048032000 comp rx=0 tx=0).stop 2024-08-17T02:47:12.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 shutdown_connections 2024-08-17T02:47:12.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff058158df0 0x7ff058140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff034065150 0x7ff034067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff058158a20 0x7ff058140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 --2- 172.21.15.2:0/3073577466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0580ae860 0x7ff0581544e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 >> 172.21.15.2:0/3073577466 conn(0x7ff058066e60 msgr2=0x7ff0580afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 shutdown_connections 2024-08-17T02:47:12.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.485+0000 7ff05d400640 1 -- 172.21.15.2:0/3073577466 wait complete. 2024-08-17T02:47:12.505 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:47:12.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.666+0000 7fc7fa800640 1 Processor -- start 2024-08-17T02:47:12.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.666+0000 7fc7fa800640 1 -- start start 2024-08-17T02:47:12.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.667+0000 7fc7fa800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7f41589e0 0x7fc7f4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.667+0000 7fc7fa800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc7f40ca9c0 0x7fc7f40cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.667+0000 7fc7fa800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40cda30 0x7fc7f40cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.667+0000 7fc7fa800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40af810 con 0x7fc7f41589e0 2024-08-17T02:47:12.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.667+0000 7fc7fa800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40af9a0 con 0x7fc7f40ca9c0 2024-08-17T02:47:12.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.667+0000 7fc7fa800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40cb340 con 0x7fc7f40cda30 2024-08-17T02:47:12.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7f41589e0 0x7fc7f4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7f41589e0 0x7fc7f4158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52910/0 (socket says 172.21.15.2:52910) 2024-08-17T02:47:12.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3400640 1 -- 172.21.15.2:0/3208316779 learned_addr learned my addr 172.21.15.2:0/3208316779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:12.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3e00640 1 --2- 172.21.15.2:0/3208316779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40cda30 0x7fc7f40cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f2a00640 1 --2- 172.21.15.2:0/3208316779 >> v2:172.21.15.26:3300/0 conn(0x7fc7f40ca9c0 0x7fc7f40cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3400640 1 -- 172.21.15.2:0/3208316779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40cda30 msgr2=0x7fc7f40cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3400640 1 --2- 172.21.15.2:0/3208316779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40cda30 0x7fc7f40cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3400640 1 -- 172.21.15.2:0/3208316779 >> v2:172.21.15.26:3300/0 conn(0x7fc7f40ca9c0 msgr2=0x7fc7f40cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:12.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3400640 1 --2- 172.21.15.2:0/3208316779 >> v2:172.21.15.26:3300/0 conn(0x7fc7f40ca9c0 0x7fc7f40cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.668+0000 7fc7f3400640 1 -- 172.21.15.2:0/3208316779 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40ce740 con 0x7fc7f41589e0 2024-08-17T02:47:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.669+0000 7fc7f3400640 1 --2- 172.21.15.2:0/3208316779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4158db0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc7f41592f0 tx=0x7fc7e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2a6b40b928640e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.669+0000 7fc7f2000640 1 -- 172.21.15.2:0/3208316779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e402add0 con 0x7fc7f41589e0 2024-08-17T02:47:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.669+0000 7fc7f2000640 1 -- 172.21.15.2:0/3208316779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4032440 con 0x7fc7f41589e0 2024-08-17T02:47:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7f2000640 1 -- 172.21.15.2:0/3208316779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4032820 con 0x7fc7f41589e0 2024-08-17T02:47:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 -- 172.21.15.2:0/3208316779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 msgr2=0x7fc7f4158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 --2- 172.21.15.2:0/3208316779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4158db0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc7f41592f0 tx=0x7fc7e40091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 -- 172.21.15.2:0/3208316779 shutdown_connections 2024-08-17T02:47:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 --2- 172.21.15.2:0/3208316779 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40cda30 0x7fc7f40cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 --2- 172.21.15.2:0/3208316779 >> v2:172.21.15.26:3300/0 conn(0x7fc7f40ca9c0 0x7fc7f40cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 --2- 172.21.15.2:0/3208316779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4158db0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 -- 172.21.15.2:0/3208316779 >> 172.21.15.2:0/3208316779 conn(0x7fc7f406e590 msgr2=0x7fc7f406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 -- 172.21.15.2:0/3208316779 shutdown_connections 2024-08-17T02:47:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.670+0000 7fc7fa800640 1 -- 172.21.15.2:0/3208316779 wait complete. 2024-08-17T02:47:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.672+0000 7fc7fa800640 1 Processor -- start 2024-08-17T02:47:12.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.672+0000 7fc7fa800640 1 -- start start 2024-08-17T02:47:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7fa800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40ca9c0 0x7fc7f4151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7fa800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7f40cda30 0x7fc7f41552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7fa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7fa800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f416cf10 con 0x7fc7f41589e0 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7fa800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f416d3a0 con 0x7fc7f40cda30 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7fa800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f415a5f0 con 0x7fc7f40ca9c0 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52926/0 (socket says 172.21.15.2:52926) 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7f3e00640 1 -- 172.21.15.2:0/881200725 learned_addr learned my addr 172.21.15.2:0/881200725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7f3400640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40ca9c0 0x7fc7f4151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.673+0000 7fc7f2a00640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7f40cda30 0x7fc7f41552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7f3e00640 1 -- 172.21.15.2:0/881200725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40ca9c0 msgr2=0x7fc7f4151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7f3e00640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40ca9c0 0x7fc7f4151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7f3e00640 1 -- 172.21.15.2:0/881200725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7f40cda30 msgr2=0x7fc7f41552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7f3e00640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7f40cda30 0x7fc7f41552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7f3e00640 1 -- 172.21.15.2:0/881200725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4009450 con 0x7fc7f41589e0 2024-08-17T02:47:12.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7f3e00640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4155830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009e90 tx=0x7fc7ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7eaa00640 1 -- 172.21.15.2:0/881200725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00ce10 con 0x7fc7f41589e0 2024-08-17T02:47:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7eaa00640 1 -- 172.21.15.2:0/881200725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec00f040 con 0x7fc7f41589e0 2024-08-17T02:47:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7eaa00640 1 -- 172.21.15.2:0/881200725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec0146d0 con 0x7fc7f41589e0 2024-08-17T02:47:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.674+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f4159b70 con 0x7fc7f41589e0 2024-08-17T02:47:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.675+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f416c8c0 con 0x7fc7f41589e0 2024-08-17T02:47:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.676+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f4063fb0 con 0x7fc7f41589e0 2024-08-17T02:47:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.676+0000 7fc7eaa00640 1 -- 172.21.15.2:0/881200725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc7ec014a80 con 0x7fc7f41589e0 2024-08-17T02:47:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.677+0000 7fc7eaa00640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc7d4065150 0x7fc7d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.677+0000 7fc7eaa00640 1 -- 172.21.15.2:0/881200725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7ec082fb0 con 0x7fc7f41589e0 2024-08-17T02:47:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.677+0000 7fc7f3400640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc7d4065150 0x7fc7d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.678+0000 7fc7f3400640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc7d4065150 0x7fc7d4067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4034000 tx=0x7fc7e4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:12.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.681+0000 7fc7eaa00640 1 -- 172.21.15.2:0/881200725 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc7ec054b10 con 0x7fc7f41589e0 2024-08-17T02:47:12.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:12.903+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc7f415cb00 con 0x7fc7f41589e0 2024-08-17T02:47:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.488+0000 7fc7eaa00640 1 -- 172.21.15.2:0/881200725 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7ec0180c0 con 0x7fc7f41589e0 2024-08-17T02:47:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc7d4065150 msgr2=0x7fc7d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc7d4065150 0x7fc7d4067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4034000 tx=0x7fc7e4032000 comp rx=0 tx=0).stop 2024-08-17T02:47:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 msgr2=0x7fc7f4155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4155830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009e90 tx=0x7fc7ec00b040 comp rx=0 tx=0).stop 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 shutdown_connections 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f41589e0 0x7fc7f4155830 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc7f40cda30 0x7fc7f41552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc7d4065150 0x7fc7d4067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 --2- 172.21.15.2:0/881200725 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc7f40ca9c0 0x7fc7f4151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 >> 172.21.15.2:0/881200725 conn(0x7fc7f406e590 msgr2=0x7fc7f4156860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 shutdown_connections 2024-08-17T02:47:13.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.490+0000 7fc7fa800640 1 -- 172.21.15.2:0/881200725 wait complete. 2024-08-17T02:47:13.506 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.661+0000 7fbe7ea00640 1 Processor -- start 2024-08-17T02:47:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.661+0000 7fbe7ea00640 1 -- start start 2024-08-17T02:47:13.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.662+0000 7fbe7ea00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe780ad960 0x7fbe7815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.662+0000 7fbe7ea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe780ca050 0x7fbe78156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.662+0000 7fbe7ea00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7815b5e0 con 0x7fbe780add30 2024-08-17T02:47:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.662+0000 7fbe7ea00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe780cb160 con 0x7fbe780ca050 2024-08-17T02:47:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.662+0000 7fbe7ea00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe780b0d10 con 0x7fbe780ad960 2024-08-17T02:47:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.662+0000 7fbe6fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe780ca050 0x7fbe78156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.662+0000 7fbe6fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe780ca050 0x7fbe78156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47764/0 (socket says 172.21.15.2:47764) 2024-08-17T02:47:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.662+0000 7fbe6fe00640 1 -- 172.21.15.2:0/526115613 learned_addr learned my addr 172.21.15.2:0/526115613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.663+0000 7fbe77e00640 1 --2- 172.21.15.2:0/526115613 >> v2:172.21.15.26:3300/0 conn(0x7fbe780ad960 0x7fbe7815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.663+0000 7fbe6fe00640 1 -- 172.21.15.2:0/526115613 >> v2:172.21.15.26:3300/0 conn(0x7fbe780ad960 msgr2=0x7fbe7815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.663+0000 7fbe6fe00640 1 --2- 172.21.15.2:0/526115613 >> v2:172.21.15.26:3300/0 conn(0x7fbe780ad960 0x7fbe7815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.663+0000 7fbe6fe00640 1 -- 172.21.15.2:0/526115613 >> v1:172.21.15.2:6789/0 conn(0x7fbe780add30 legacy=0x7fbe78156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.663+0000 7fbe6fe00640 1 -- 172.21.15.2:0/526115613 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780ca550 con 0x7fbe780ca050 2024-08-17T02:47:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.663+0000 7fbe77400640 1 -- 172.21.15.2:0/526115613 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280963772 0 0) 0x7fbe70001490 con 0x7fbe780add30 2024-08-17T02:47:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.664+0000 7fbe6fe00640 1 --2- 172.21.15.2:0/526115613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ca050 0x7fbe78156420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbe780cc910 tx=0x7fbe600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a736b74b561bb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.664+0000 7fbe77400640 1 -- 172.21.15.2:0/526115613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60032440 con 0x7fbe780ca050 2024-08-17T02:47:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.664+0000 7fbe77400640 1 -- 172.21.15.2:0/526115613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe600325a0 con 0x7fbe780ca050 2024-08-17T02:47:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.664+0000 7fbe77400640 1 -- 172.21.15.2:0/526115613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60032940 con 0x7fbe780ca050 2024-08-17T02:47:13.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.665+0000 7fbe7ea00640 1 -- 172.21.15.2:0/526115613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ca050 msgr2=0x7fbe78156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.665+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/526115613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ca050 0x7fbe78156420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbe780cc910 tx=0x7fbe600091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.665+0000 7fbe7ea00640 1 -- 172.21.15.2:0/526115613 shutdown_connections 2024-08-17T02:47:13.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.665+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/526115613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780ca050 0x7fbe78156420 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.665+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/526115613 >> v2:172.21.15.26:3300/0 conn(0x7fbe780ad960 0x7fbe7815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.665+0000 7fbe7ea00640 1 -- 172.21.15.2:0/526115613 >> 172.21.15.2:0/526115613 conn(0x7fbe78066e60 msgr2=0x7fbe78067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.665+0000 7fbe7ea00640 1 -- 172.21.15.2:0/526115613 shutdown_connections 2024-08-17T02:47:13.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.665+0000 7fbe7ea00640 1 -- 172.21.15.2:0/526115613 wait complete. 2024-08-17T02:47:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.666+0000 7fbe7ea00640 1 Processor -- start 2024-08-17T02:47:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.667+0000 7fbe7ea00640 1 -- start start 2024-08-17T02:47:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.667+0000 7fbe7ea00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe780ad960 0x7fbe780a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.667+0000 7fbe7ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780add30 0x7fbe780a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.667+0000 7fbe7ea00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe780ca050 0x7fbe780aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe7ea00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780a9610 con 0x7fbe780add30 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe7ea00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780ace40 con 0x7fbe780ad960 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe7ea00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780a8ce0 con 0x7fbe780ca050 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe6fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780add30 0x7fbe780a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe6fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780add30 0x7fbe780a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47768/0 (socket says 172.21.15.2:47768) 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe6fe00640 1 -- 172.21.15.2:0/3944885230 learned_addr learned my addr 172.21.15.2:0/3944885230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe77e00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe780ad960 0x7fbe780a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe7ca00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe780ca050 0x7fbe780aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe6fe00640 1 -- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe780ca050 msgr2=0x7fbe780aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe6fe00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe780ca050 0x7fbe780aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe6fe00640 1 -- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe780ad960 msgr2=0x7fbe780a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe6fe00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe780ad960 0x7fbe780a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe6fe00640 1 -- 172.21.15.2:0/3944885230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe60009450 con 0x7fbe780add30 2024-08-17T02:47:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.668+0000 7fbe7ca00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe780ca050 0x7fbe780aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.669+0000 7fbe6fe00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780add30 0x7fbe780a9fe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002a8f0 tx=0x7fbe60032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.669+0000 7fbe6f400640 1 -- 172.21.15.2:0/3944885230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60032710 con 0x7fbe780add30 2024-08-17T02:47:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.669+0000 7fbe6f400640 1 -- 172.21.15.2:0/3944885230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe60032870 con 0x7fbe780add30 2024-08-17T02:47:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.669+0000 7fbe6f400640 1 -- 172.21.15.2:0/3944885230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6003e6a0 con 0x7fbe780add30 2024-08-17T02:47:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.669+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe780a8fc0 con 0x7fbe780add30 2024-08-17T02:47:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.669+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe78147890 con 0x7fbe780add30 2024-08-17T02:47:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.670+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe780a97c0 con 0x7fbe780add30 2024-08-17T02:47:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.671+0000 7fbe6f400640 1 -- 172.21.15.2:0/3944885230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbe6003c400 con 0x7fbe780add30 2024-08-17T02:47:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.672+0000 7fbe6f400640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbe54065150 0x7fbe54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.672+0000 7fbe6f400640 1 -- 172.21.15.2:0/3944885230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe600a2c80 con 0x7fbe780add30 2024-08-17T02:47:13.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.672+0000 7fbe77e00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbe54065150 0x7fbe54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:13.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.672+0000 7fbe77e00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbe54065150 0x7fbe54067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009c80 tx=0x7fbe680090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:13.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.679+0000 7fbe6f400640 1 -- 172.21.15.2:0/3944885230 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbe780a97c0 con 0x7fbe780add30 2024-08-17T02:47:13.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.917+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe78063fb0 con 0x7fbe780add30 2024-08-17T02:47:13.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.918+0000 7fbe6f400640 1 -- 172.21.15.2:0/3944885230 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fbe60070d50 con 0x7fbe780add30 2024-08-17T02:47:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:13.920 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4953,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:09.888633+0000","modified":"2024-08-17T02:47:13.482114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.2:6837/1889487336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1889487336},{"type":"v1","addr":"172.21.15.2:6837","nonce":1889487336}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:47:13.920 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-08-17T02:47:13.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbe54065150 msgr2=0x7fbe54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbe54065150 0x7fbe54067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009c80 tx=0x7fbe680090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780add30 msgr2=0x7fbe780a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780add30 0x7fbe780a9fe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002a8f0 tx=0x7fbe60032000 comp rx=0 tx=0).stop 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 shutdown_connections 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbe54065150 0x7fbe54067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbe780ca050 0x7fbe780aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe780add30 0x7fbe780a9fe0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 --2- 172.21.15.2:0/3944885230 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe780ad960 0x7fbe780a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.920+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 >> 172.21.15.2:0/3944885230 conn(0x7fbe78066e60 msgr2=0x7fbe780b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.921+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 shutdown_connections 2024-08-17T02:47:13.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:13.921+0000 7fbe7ea00640 1 -- 172.21.15.2:0/3944885230 wait complete. 2024-08-17T02:47:13.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:47:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.089+0000 7faa7a400640 1 Processor -- start 2024-08-17T02:47:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.090+0000 7faa7a400640 1 -- start start 2024-08-17T02:47:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa7a400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa74154ae0 0x7faa740b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa7a400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa740adc70 0x7faa740af460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa7a400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa74159700 con 0x7faa740b10e0 2024-08-17T02:47:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa7a400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa74158af0 con 0x7faa740adc70 2024-08-17T02:47:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa7a400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa74158dd0 con 0x7faa74154ae0 2024-08-17T02:47:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa79a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa740adc70 0x7faa740af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa79000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa74154ae0 0x7faa740b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa79a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa740adc70 0x7faa740af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:50998/0 (socket says 172.21.15.2:50998) 2024-08-17T02:47:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.091+0000 7faa79a00640 1 -- 172.21.15.2:0/2927181094 learned_addr learned my addr 172.21.15.2:0/2927181094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.092+0000 7faa79a00640 1 -- 172.21.15.2:0/2927181094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa74154ae0 msgr2=0x7faa740b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.092+0000 7faa79a00640 1 --2- 172.21.15.2:0/2927181094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa74154ae0 0x7faa740b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.092+0000 7faa79a00640 1 -- 172.21.15.2:0/2927181094 >> v1:172.21.15.26:6789/0 conn(0x7faa740b10e0 legacy=0x7faa740ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.092+0000 7faa79a00640 1 -- 172.21.15.2:0/2927181094 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa741590b0 con 0x7faa740adc70 2024-08-17T02:47:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.093+0000 7faa79a00640 1 --2- 172.21.15.2:0/2927181094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa740adc70 0x7faa740af460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00d1a0 tx=0x7faa6c00ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e947eb483c339c3c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.093+0000 7faa73400640 1 -- 172.21.15.2:0/2927181094 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c033650 con 0x7faa740adc70 2024-08-17T02:47:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.093+0000 7faa73400640 1 -- 172.21.15.2:0/2927181094 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c0337b0 con 0x7faa740adc70 2024-08-17T02:47:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.093+0000 7faa73400640 1 -- 172.21.15.2:0/2927181094 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c033b90 con 0x7faa740adc70 2024-08-17T02:47:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.094+0000 7faa7a400640 1 -- 172.21.15.2:0/2927181094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa740adc70 msgr2=0x7faa740af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.094+0000 7faa7a400640 1 --2- 172.21.15.2:0/2927181094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa740adc70 0x7faa740af460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00d1a0 tx=0x7faa6c00ba50 comp rx=0 tx=0).stop 2024-08-17T02:47:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.094+0000 7faa7a400640 1 -- 172.21.15.2:0/2927181094 shutdown_connections 2024-08-17T02:47:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.094+0000 7faa7a400640 1 --2- 172.21.15.2:0/2927181094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa740adc70 0x7faa740af460 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.094+0000 7faa7a400640 1 --2- 172.21.15.2:0/2927181094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa74154ae0 0x7faa740b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.094+0000 7faa7a400640 1 -- 172.21.15.2:0/2927181094 >> 172.21.15.2:0/2927181094 conn(0x7faa74062af0 msgr2=0x7faa74062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.094+0000 7faa7a400640 1 -- 172.21.15.2:0/2927181094 shutdown_connections 2024-08-17T02:47:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.094+0000 7faa7a400640 1 -- 172.21.15.2:0/2927181094 wait complete. 2024-08-17T02:47:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.095+0000 7faa7a400640 1 Processor -- start 2024-08-17T02:47:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.095+0000 7faa7a400640 1 -- start start 2024-08-17T02:47:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.096+0000 7faa7a400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa740adc70 0x7faa741428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.096+0000 7faa7a400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa740b10e0 0x7faa74144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.096+0000 7faa7a400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa74154ae0 0x7faa74144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.096+0000 7faa7a400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa74145c00 con 0x7faa740b10e0 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.096+0000 7faa7a400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa74146090 con 0x7faa74154ae0 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.096+0000 7faa7a400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa74144ff0 con 0x7faa740adc70 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa740adc70 0x7faa741428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa73e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa740b10e0 0x7faa74144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa740adc70 0x7faa741428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:47674/0 (socket says 172.21.15.2:47674) 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79000640 1 -- 172.21.15.2:0/3140274747 learned_addr learned my addr 172.21.15.2:0/3140274747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79a00640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa74154ae0 0x7faa74144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79000640 1 -- 172.21.15.2:0/3140274747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa74154ae0 msgr2=0x7faa74144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79000640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa74154ae0 0x7faa74144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79000640 1 -- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa740b10e0 msgr2=0x7faa74144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79000640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa740b10e0 0x7faa74144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.097+0000 7faa79000640 1 -- 172.21.15.2:0/3140274747 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c00bcf0 con 0x7faa740adc70 2024-08-17T02:47:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.098+0000 7faa79000640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa740adc70 0x7faa741428f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa6800e900 tx=0x7faa680090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.098+0000 7faa67e00640 1 -- 172.21.15.2:0/3140274747 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800c8e0 con 0x7faa740adc70 2024-08-17T02:47:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.098+0000 7faa67e00640 1 -- 172.21.15.2:0/3140274747 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6800ca40 con 0x7faa740adc70 2024-08-17T02:47:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.098+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa741452d0 con 0x7faa740adc70 2024-08-17T02:47:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.098+0000 7faa67e00640 1 -- 172.21.15.2:0/3140274747 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800cde0 con 0x7faa740adc70 2024-08-17T02:47:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.098+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa74145890 con 0x7faa740adc70 2024-08-17T02:47:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.099+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa74070720 con 0x7faa740adc70 2024-08-17T02:47:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.100+0000 7faa67e00640 1 -- 172.21.15.2:0/3140274747 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faa68013680 con 0x7faa740adc70 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.100+0000 7faa67e00640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa54065180 0x7faa54067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.101+0000 7faa67e00640 1 -- 172.21.15.2:0/3140274747 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa68082580 con 0x7faa740adc70 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.101+0000 7faa73e00640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa54065180 0x7faa54067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.101+0000 7faa73e00640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa54065180 0x7faa54067630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faa740aa6b0 tx=0x7faa60007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.105+0000 7faa67e00640 1 -- 172.21.15.2:0/3140274747 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faa68050650 con 0x7faa740adc70 2024-08-17T02:47:14.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.288+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa740c80e0 con 0x7faa740adc70 2024-08-17T02:47:14.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.290+0000 7faa67e00640 1 -- 172.21.15.2:0/3140274747 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15254 (secure 0 0 0) 0x7faa68053c70 con 0x7faa740adc70 2024-08-17T02:47:14.291 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:14.291 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:47:11.469730+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:07.966246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:08.880865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:47:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa54065180 msgr2=0x7faa54067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa54065180 0x7faa54067630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faa740aa6b0 tx=0x7faa60007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa740adc70 msgr2=0x7faa741428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa740adc70 0x7faa741428f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa6800e900 tx=0x7faa680090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 shutdown_connections 2024-08-17T02:47:14.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa74154ae0 0x7faa74144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa740b10e0 0x7faa74144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa54065180 0x7faa54067630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 --2- 172.21.15.2:0/3140274747 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa740adc70 0x7faa741428f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 >> 172.21.15.2:0/3140274747 conn(0x7faa74062af0 msgr2=0x7faa740ab530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 shutdown_connections 2024-08-17T02:47:14.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.292+0000 7faa7a400640 1 -- 172.21.15.2:0/3140274747 wait complete. 2024-08-17T02:47:14.308 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:47:14.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.459+0000 7f6c95e00640 1 Processor -- start 2024-08-17T02:47:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.459+0000 7f6c95e00640 1 -- start start 2024-08-17T02:47:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.460+0000 7f6c95e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c90158d50 0x7f6c900ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.460+0000 7f6c95e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c900ac000 0x7f6c900aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.460+0000 7f6c95e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c900a96c0 con 0x7f6c90159120 2024-08-17T02:47:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.460+0000 7f6c95e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c900acf00 con 0x7f6c90158d50 2024-08-17T02:47:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.460+0000 7f6c95e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c900af7d0 con 0x7f6c900ac000 2024-08-17T02:47:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.460+0000 7f6c8ea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c90158d50 0x7f6c900ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.461+0000 7f6c8e000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c90159120 0x7f6c900ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57624/0 (socket says 172.21.15.2:57624) 2024-08-17T02:47:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.461+0000 7f6c8e000640 1 -- 172.21.15.2:0/3780734796 learned_addr learned my addr 172.21.15.2:0/3780734796 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.461+0000 7f6c8f400640 1 --2- 172.21.15.2:0/3780734796 >> v2:172.21.15.26:3300/0 conn(0x7f6c900ac000 0x7f6c900aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.461+0000 7f6c8ea00640 1 -- 172.21.15.2:0/3780734796 >> v2:172.21.15.26:3300/0 conn(0x7f6c900ac000 msgr2=0x7f6c900aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.461+0000 7f6c8ea00640 1 --2- 172.21.15.2:0/3780734796 >> v2:172.21.15.26:3300/0 conn(0x7f6c900ac000 0x7f6c900aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.461+0000 7f6c8ea00640 1 -- 172.21.15.2:0/3780734796 >> v1:172.21.15.2:6789/0 conn(0x7f6c90159120 legacy=0x7f6c900ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.461+0000 7f6c8d600640 1 -- 172.21.15.2:0/3780734796 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761279982 0 0) 0x7f6c900a96c0 con 0x7f6c90159120 2024-08-17T02:47:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.461+0000 7f6c8ea00640 1 -- 172.21.15.2:0/3780734796 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c900a98f0 con 0x7f6c90158d50 2024-08-17T02:47:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.462+0000 7f6c8ea00640 1 --2- 172.21.15.2:0/3780734796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c900ac4a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c9015c9b0 tx=0x7f6c800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8c8bcbc22adf6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.462+0000 7f6c8d600640 1 -- 172.21.15.2:0/3780734796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8002ad20 con 0x7f6c90158d50 2024-08-17T02:47:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.462+0000 7f6c8d600640 1 -- 172.21.15.2:0/3780734796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8002ae80 con 0x7f6c90158d50 2024-08-17T02:47:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.462+0000 7f6c8d600640 1 -- 172.21.15.2:0/3780734796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80032670 con 0x7f6c90158d50 2024-08-17T02:47:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.463+0000 7f6c95e00640 1 -- 172.21.15.2:0/3780734796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 msgr2=0x7f6c900ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.463+0000 7f6c95e00640 1 --2- 172.21.15.2:0/3780734796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c900ac4a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c9015c9b0 tx=0x7f6c800090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.463+0000 7f6c95e00640 1 -- 172.21.15.2:0/3780734796 shutdown_connections 2024-08-17T02:47:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.463+0000 7f6c95e00640 1 --2- 172.21.15.2:0/3780734796 >> v2:172.21.15.26:3300/0 conn(0x7f6c900ac000 0x7f6c900aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.463+0000 7f6c95e00640 1 --2- 172.21.15.2:0/3780734796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c900ac4a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.463+0000 7f6c95e00640 1 -- 172.21.15.2:0/3780734796 >> 172.21.15.2:0/3780734796 conn(0x7f6c90095a70 msgr2=0x7f6c90095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.463+0000 7f6c95e00640 1 -- 172.21.15.2:0/3780734796 shutdown_connections 2024-08-17T02:47:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.463+0000 7f6c95e00640 1 -- 172.21.15.2:0/3780734796 wait complete. 2024-08-17T02:47:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.464+0000 7f6c95e00640 1 Processor -- start 2024-08-17T02:47:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.465+0000 7f6c95e00640 1 -- start start 2024-08-17T02:47:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.465+0000 7f6c95e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c900ac000 0x7f6c90159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.465+0000 7f6c95e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c90169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.465+0000 7f6c95e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c90159120 0x7f6c90169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.465+0000 7f6c95e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9015aaa0 con 0x7f6c90158d50 2024-08-17T02:47:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.465+0000 7f6c95e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90159e90 con 0x7f6c900ac000 2024-08-17T02:47:14.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.465+0000 7f6c95e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9015a170 con 0x7f6c90159120 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c90169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c90169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47792/0 (socket says 172.21.15.2:47792) 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8e000640 1 -- 172.21.15.2:0/711833692 learned_addr learned my addr 172.21.15.2:0/711833692 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8ea00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c900ac000 0x7f6c90159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8f400640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c90159120 0x7f6c90169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8e000640 1 -- 172.21.15.2:0/711833692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c90159120 msgr2=0x7f6c90169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8e000640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c90159120 0x7f6c90169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8e000640 1 -- 172.21.15.2:0/711833692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c900ac000 msgr2=0x7f6c90159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8e000640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c900ac000 0x7f6c90159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.466+0000 7f6c8e000640 1 -- 172.21.15.2:0/711833692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009390 con 0x7f6c90158d50 2024-08-17T02:47:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.467+0000 7f6c8e000640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c90169ab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c510 tx=0x7f6c7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.467+0000 7f6c86000640 1 -- 172.21.15.2:0/711833692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c005aa0 con 0x7f6c90158d50 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.467+0000 7f6c86000640 1 -- 172.21.15.2:0/711833692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c005c00 con 0x7f6c90158d50 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.467+0000 7f6c86000640 1 -- 172.21.15.2:0/711833692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0070d0 con 0x7f6c90158d50 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.467+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9015a450 con 0x7f6c90158d50 2024-08-17T02:47:14.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.467+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c90159a60 con 0x7f6c90158d50 2024-08-17T02:47:14.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.468+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c90063fb0 con 0x7f6c90158d50 2024-08-17T02:47:14.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.469+0000 7f6c86000640 1 -- 172.21.15.2:0/711833692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6c7c007500 con 0x7f6c90158d50 2024-08-17T02:47:14.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.469+0000 7f6c86000640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c70065180 0x7f6c70067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.470+0000 7f6c86000640 1 -- 172.21.15.2:0/711833692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c7c081980 con 0x7f6c90158d50 2024-08-17T02:47:14.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.470+0000 7f6c8ea00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c70065180 0x7f6c70067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.470+0000 7f6c8ea00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c70065180 0x7f6c70067630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c80034000 tx=0x7f6c80032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.474+0000 7f6c86000640 1 -- 172.21.15.2:0/711833692 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6c7c04fa50 con 0x7f6c90158d50 2024-08-17T02:47:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.657+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c90159c80 con 0x7f6c70065180 2024-08-17T02:47:14.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.666+0000 7f6c86000640 1 -- 172.21.15.2:0/711833692 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286308 (secure 0 0 0) 0x7f6c90159c80 con 0x7f6c70065180 2024-08-17T02:47:14.671 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:14.673 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:47:14.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c70065180 msgr2=0x7f6c70067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c70065180 0x7f6c70067630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c80034000 tx=0x7f6c80032000 comp rx=0 tx=0).stop 2024-08-17T02:47:14.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 msgr2=0x7f6c90169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c90169ab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c510 tx=0x7f6c7c00c910 comp rx=0 tx=0).stop 2024-08-17T02:47:14.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 shutdown_connections 2024-08-17T02:47:14.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c70065180 0x7f6c70067630 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c90159120 0x7f6c90169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c90158d50 0x7f6c90169ab0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 --2- 172.21.15.2:0/711833692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c900ac000 0x7f6c90159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 >> 172.21.15.2:0/711833692 conn(0x7f6c90095a70 msgr2=0x7f6c900b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 shutdown_connections 2024-08-17T02:47:14.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.670+0000 7f6c95e00640 1 -- 172.21.15.2:0/711833692 wait complete. 2024-08-17T02:47:14.686 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-08-17T02:47:13.025582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2416152,"kb_used_data":4000,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752558568,"statfs":{"total":773094113280,"available":770619973632,"internally_reserved":0,"allocated":4096000,"data_stored":2270282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.572363"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.491782+0000","last_change":"2024-08-17T02:47:10.491782+0000","last_active":"2024-08-17T02:47:10.491782+0000","last_peered":"2024-08-17T02:47:10.491782+0000","last_clean":"2024-08-17T02:47:10.491782+0000","last_became_active":"2024-08-17T02:47:10.491245+0000","last_became_peered":"2024-08-17T02:47:10.491245+0000","last_unstale":"2024-08-17T02:47:10.491782+0000","last_undegraded":"2024-08-17T02:47:10.491782+0000","last_fullsized":"2024-08-17T02:47:10.491782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:11.218121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488455+0000","last_change":"2024-08-17T02:47:10.488455+0000","last_active":"2024-08-17T02:47:10.488455+0000","last_peered":"2024-08-17T02:47:10.488455+0000","last_clean":"2024-08-17T02:47:10.488455+0000","last_became_active":"2024-08-17T02:47:10.484614+0000","last_became_peered":"2024-08-17T02:47:10.484614+0000","last_unstale":"2024-08-17T02:47:10.488455+0000","last_undegraded":"2024-08-17T02:47:10.488455+0000","last_fullsized":"2024-08-17T02:47:10.488455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:52.545739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484906+0000","last_change":"2024-08-17T02:47:10.484906+0000","last_active":"2024-08-17T02:47:10.484906+0000","last_peered":"2024-08-17T02:47:10.484906+0000","last_clean":"2024-08-17T02:47:10.484906+0000","last_became_active":"2024-08-17T02:47:10.483409+0000","last_became_peered":"2024-08-17T02:47:10.483409+0000","last_unstale":"2024-08-17T02:47:10.484906+0000","last_undegraded":"2024-08-17T02:47:10.484906+0000","last_fullsized":"2024-08-17T02:47:10.484906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:02.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.481318+0000","last_change":"2024-08-17T02:47:10.481318+0000","last_active":"2024-08-17T02:47:10.481318+0000","last_peered":"2024-08-17T02:47:10.481318+0000","last_clean":"2024-08-17T02:47:10.481318+0000","last_became_active":"2024-08-17T02:47:10.480925+0000","last_became_peered":"2024-08-17T02:47:10.480925+0000","last_unstale":"2024-08-17T02:47:10.481318+0000","last_undegraded":"2024-08-17T02:47:10.481318+0000","last_fullsized":"2024-08-17T02:47:10.481318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:32.595137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484369+0000","last_change":"2024-08-17T02:47:10.484369+0000","last_active":"2024-08-17T02:47:10.484369+0000","last_peered":"2024-08-17T02:47:10.484369+0000","last_clean":"2024-08-17T02:47:10.484369+0000","last_became_active":"2024-08-17T02:47:10.483927+0000","last_became_peered":"2024-08-17T02:47:10.483927+0000","last_unstale":"2024-08-17T02:47:10.484369+0000","last_undegraded":"2024-08-17T02:47:10.484369+0000","last_fullsized":"2024-08-17T02:47:10.484369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:00.220976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.487057+0000","last_change":"2024-08-17T02:47:10.487057+0000","last_active":"2024-08-17T02:47:10.487057+0000","last_peered":"2024-08-17T02:47:10.487057+0000","last_clean":"2024-08-17T02:47:10.487057+0000","last_became_active":"2024-08-17T02:47:10.486778+0000","last_became_peered":"2024-08-17T02:47:10.486778+0000","last_unstale":"2024-08-17T02:47:10.487057+0000","last_undegraded":"2024-08-17T02:47:10.487057+0000","last_fullsized":"2024-08-17T02:47:10.487057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:16.928151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.495003+0000","last_change":"2024-08-17T02:47:10.495003+0000","last_active":"2024-08-17T02:47:10.495003+0000","last_peered":"2024-08-17T02:47:10.495003+0000","last_clean":"2024-08-17T02:47:10.495003+0000","last_became_active":"2024-08-17T02:47:10.493132+0000","last_became_peered":"2024-08-17T02:47:10.493132+0000","last_unstale":"2024-08-17T02:47:10.495003+0000","last_undegraded":"2024-08-17T02:47:10.495003+0000","last_fullsized":"2024-08-17T02:47:10.495003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:09.752059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488152+0000","last_change":"2024-08-17T02:47:10.488152+0000","last_active":"2024-08-17T02:47:10.488152+0000","last_peered":"2024-08-17T02:47:10.488152+0000","last_clean":"2024-08-17T02:47:10.488152+0000","last_became_active":"2024-08-17T02:47:10.487879+0000","last_became_peered":"2024-08-17T02:47:10.487879+0000","last_unstale":"2024-08-17T02:47:10.488152+0000","last_undegraded":"2024-08-17T02:47:10.488152+0000","last_fullsized":"2024-08-17T02:47:10.488152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:14.372316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.500719+0000","last_change":"2024-08-17T02:47:10.500719+0000","last_active":"2024-08-17T02:47:10.500719+0000","last_peered":"2024-08-17T02:47:10.500719+0000","last_clean":"2024-08-17T02:47:10.500719+0000","last_became_active":"2024-08-17T02:47:10.500423+0000","last_became_peered":"2024-08-17T02:47:10.500423+0000","last_unstale":"2024-08-17T02:47:10.500719+0000","last_undegraded":"2024-08-17T02:47:10.500719+0000","last_fullsized":"2024-08-17T02:47:10.500719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:07.781936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.506471+0000","last_change":"2024-08-17T02:47:10.506471+0000","last_active":"2024-08-17T02:47:10.506471+0000","last_peered":"2024-08-17T02:47:10.506471+0000","last_clean":"2024-08-17T02:47:10.506471+0000","last_became_active":"2024-08-17T02:47:10.503110+0000","last_became_peered":"2024-08-17T02:47:10.503110+0000","last_unstale":"2024-08-17T02:47:10.506471+0000","last_undegraded":"2024-08-17T02:47:10.506471+0000","last_fullsized":"2024-08-17T02:47:10.506471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:16.317027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.493593+0000","last_change":"2024-08-17T02:47:10.493593+0000","last_active":"2024-08-17T02:47:10.493593+0000","last_peered":"2024-08-17T02:47:10.493593+0000","last_clean":"2024-08-17T02:47:10.493593+0000","last_became_active":"2024-08-17T02:47:10.492733+0000","last_became_peered":"2024-08-17T02:47:10.492733+0000","last_unstale":"2024-08-17T02:47:10.493593+0000","last_undegraded":"2024-08-17T02:47:10.493593+0000","last_fullsized":"2024-08-17T02:47:10.493593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:57.744071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.489943+0000","last_change":"2024-08-17T02:47:10.489943+0000","last_active":"2024-08-17T02:47:10.489943+0000","last_peered":"2024-08-17T02:47:10.489943+0000","last_clean":"2024-08-17T02:47:10.489943+0000","last_became_active":"2024-08-17T02:47:10.489645+0000","last_became_peered":"2024-08-17T02:47:10.489645+0000","last_unstale":"2024-08-17T02:47:10.489943+0000","last_undegraded":"2024-08-17T02:47:10.489943+0000","last_fullsized":"2024-08-17T02:47:10.489943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:05:34.308613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484391+0000","last_change":"2024-08-17T02:47:10.484391+0000","last_active":"2024-08-17T02:47:10.484391+0000","last_peered":"2024-08-17T02:47:10.484391+0000","last_clean":"2024-08-17T02:47:10.484391+0000","last_became_active":"2024-08-17T02:47:10.484093+0000","last_became_peered":"2024-08-17T02:47:10.484093+0000","last_unstale":"2024-08-17T02:47:10.484391+0000","last_undegraded":"2024-08-17T02:47:10.484391+0000","last_fullsized":"2024-08-17T02:47:10.484391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:54.781955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.481833+0000","last_change":"2024-08-17T02:47:10.481833+0000","last_active":"2024-08-17T02:47:10.481833+0000","last_peered":"2024-08-17T02:47:10.481833+0000","last_clean":"2024-08-17T02:47:10.481833+0000","last_became_active":"2024-08-17T02:47:10.481521+0000","last_became_peered":"2024-08-17T02:47:10.481521+0000","last_unstale":"2024-08-17T02:47:10.481833+0000","last_undegraded":"2024-08-17T02:47:10.481833+0000","last_fullsized":"2024-08-17T02:47:10.481833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:22.845857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.487517+0000","last_change":"2024-08-17T02:47:10.487517+0000","last_active":"2024-08-17T02:47:10.487517+0000","last_peered":"2024-08-17T02:47:10.487517+0000","last_clean":"2024-08-17T02:47:10.487517+0000","last_became_active":"2024-08-17T02:47:10.485748+0000","last_became_peered":"2024-08-17T02:47:10.485748+0000","last_unstale":"2024-08-17T02:47:10.487517+0000","last_undegraded":"2024-08-17T02:47:10.487517+0000","last_fullsized":"2024-08-17T02:47:10.487517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:53.624019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.499419+0000","last_change":"2024-08-17T02:47:10.499419+0000","last_active":"2024-08-17T02:47:10.499419+0000","last_peered":"2024-08-17T02:47:10.499419+0000","last_clean":"2024-08-17T02:47:10.499419+0000","last_became_active":"2024-08-17T02:47:10.499146+0000","last_became_peered":"2024-08-17T02:47:10.499146+0000","last_unstale":"2024-08-17T02:47:10.499419+0000","last_undegraded":"2024-08-17T02:47:10.499419+0000","last_fullsized":"2024-08-17T02:47:10.499419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:52.545739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.485764+0000","last_change":"2024-08-17T02:47:10.485764+0000","last_active":"2024-08-17T02:47:10.485764+0000","last_peered":"2024-08-17T02:47:10.485764+0000","last_clean":"2024-08-17T02:47:10.485764+0000","last_became_active":"2024-08-17T02:47:10.485408+0000","last_became_peered":"2024-08-17T02:47:10.485408+0000","last_unstale":"2024-08-17T02:47:10.485764+0000","last_undegraded":"2024-08-17T02:47:10.485764+0000","last_fullsized":"2024-08-17T02:47:10.485764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:22.845857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.492792+0000","last_change":"2024-08-17T02:47:10.492792+0000","last_active":"2024-08-17T02:47:10.492792+0000","last_peered":"2024-08-17T02:47:10.492792+0000","last_clean":"2024-08-17T02:47:10.492792+0000","last_became_active":"2024-08-17T02:47:10.492483+0000","last_became_peered":"2024-08-17T02:47:10.492483+0000","last_unstale":"2024-08-17T02:47:10.492792+0000","last_undegraded":"2024-08-17T02:47:10.492792+0000","last_fullsized":"2024-08-17T02:47:10.492792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:53.624019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.494248+0000","last_change":"2024-08-17T02:47:10.494248+0000","last_active":"2024-08-17T02:47:10.494248+0000","last_peered":"2024-08-17T02:47:10.494248+0000","last_clean":"2024-08-17T02:47:10.494248+0000","last_became_active":"2024-08-17T02:47:10.493975+0000","last_became_peered":"2024-08-17T02:47:10.493975+0000","last_unstale":"2024-08-17T02:47:10.494248+0000","last_undegraded":"2024-08-17T02:47:10.494248+0000","last_fullsized":"2024-08-17T02:47:10.494248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:57.744071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488215+0000","last_change":"2024-08-17T02:47:10.488215+0000","last_active":"2024-08-17T02:47:10.488215+0000","last_peered":"2024-08-17T02:47:10.488215+0000","last_clean":"2024-08-17T02:47:10.488215+0000","last_became_active":"2024-08-17T02:47:10.487065+0000","last_became_peered":"2024-08-17T02:47:10.487065+0000","last_unstale":"2024-08-17T02:47:10.488215+0000","last_undegraded":"2024-08-17T02:47:10.488215+0000","last_fullsized":"2024-08-17T02:47:10.488215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:15:50.269168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.504107+0000","last_change":"2024-08-17T02:47:10.504107+0000","last_active":"2024-08-17T02:47:10.504107+0000","last_peered":"2024-08-17T02:47:10.504107+0000","last_clean":"2024-08-17T02:47:10.504107+0000","last_became_active":"2024-08-17T02:47:10.501470+0000","last_became_peered":"2024-08-17T02:47:10.501470+0000","last_unstale":"2024-08-17T02:47:10.504107+0000","last_undegraded":"2024-08-17T02:47:10.504107+0000","last_fullsized":"2024-08-17T02:47:10.504107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:11.218121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.481938+0000","last_change":"2024-08-17T02:47:10.481938+0000","last_active":"2024-08-17T02:47:10.481938+0000","last_peered":"2024-08-17T02:47:10.481938+0000","last_clean":"2024-08-17T02:47:10.481938+0000","last_became_active":"2024-08-17T02:47:10.481564+0000","last_became_peered":"2024-08-17T02:47:10.481564+0000","last_unstale":"2024-08-17T02:47:10.481938+0000","last_undegraded":"2024-08-17T02:47:10.481938+0000","last_fullsized":"2024-08-17T02:47:10.481938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:06.185346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.486724+0000","last_change":"2024-08-17T02:47:10.486724+0000","last_active":"2024-08-17T02:47:10.486724+0000","last_peered":"2024-08-17T02:47:10.486724+0000","last_clean":"2024-08-17T02:47:10.486724+0000","last_became_active":"2024-08-17T02:47:10.486478+0000","last_became_peered":"2024-08-17T02:47:10.486478+0000","last_unstale":"2024-08-17T02:47:10.486724+0000","last_undegraded":"2024-08-17T02:47:10.486724+0000","last_fullsized":"2024-08-17T02:47:10.486724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:28.780515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.482891+0000","last_change":"2024-08-17T02:47:10.482891+0000","last_active":"2024-08-17T02:47:10.482891+0000","last_peered":"2024-08-17T02:47:10.482891+0000","last_clean":"2024-08-17T02:47:10.482891+0000","last_became_active":"2024-08-17T02:47:10.481957+0000","last_became_peered":"2024-08-17T02:47:10.481957+0000","last_unstale":"2024-08-17T02:47:10.482891+0000","last_undegraded":"2024-08-17T02:47:10.482891+0000","last_fullsized":"2024-08-17T02:47:10.482891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:14.372316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.492656+0000","last_change":"2024-08-17T02:47:10.492656+0000","last_active":"2024-08-17T02:47:10.492656+0000","last_peered":"2024-08-17T02:47:10.492656+0000","last_clean":"2024-08-17T02:47:10.492656+0000","last_became_active":"2024-08-17T02:47:10.492355+0000","last_became_peered":"2024-08-17T02:47:10.492355+0000","last_unstale":"2024-08-17T02:47:10.492656+0000","last_undegraded":"2024-08-17T02:47:10.492656+0000","last_fullsized":"2024-08-17T02:47:10.492656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:08.538645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488968+0000","last_change":"2024-08-17T02:47:10.488968+0000","last_active":"2024-08-17T02:47:10.488968+0000","last_peered":"2024-08-17T02:47:10.488968+0000","last_clean":"2024-08-17T02:47:10.488968+0000","last_became_active":"2024-08-17T02:47:10.488734+0000","last_became_peered":"2024-08-17T02:47:10.488734+0000","last_unstale":"2024-08-17T02:47:10.488968+0000","last_undegraded":"2024-08-17T02:47:10.488968+0000","last_fullsized":"2024-08-17T02:47:10.488968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:05:34.308613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.480024+0000","last_change":"2024-08-17T02:47:10.480024+0000","last_active":"2024-08-17T02:47:10.480024+0000","last_peered":"2024-08-17T02:47:10.480024+0000","last_clean":"2024-08-17T02:47:10.480024+0000","last_became_active":"2024-08-17T02:47:10.479171+0000","last_became_peered":"2024-08-17T02:47:10.479171+0000","last_unstale":"2024-08-17T02:47:10.480024+0000","last_undegraded":"2024-08-17T02:47:10.480024+0000","last_fullsized":"2024-08-17T02:47:10.480024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:09.752059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484932+0000","last_change":"2024-08-17T02:47:10.484932+0000","last_active":"2024-08-17T02:47:10.484932+0000","last_peered":"2024-08-17T02:47:10.484932+0000","last_clean":"2024-08-17T02:47:10.484932+0000","last_became_active":"2024-08-17T02:47:10.479544+0000","last_became_peered":"2024-08-17T02:47:10.479544+0000","last_unstale":"2024-08-17T02:47:10.484932+0000","last_undegraded":"2024-08-17T02:47:10.484932+0000","last_fullsized":"2024-08-17T02:47:10.484932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:08.538645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.504246+0000","last_change":"2024-08-17T02:47:10.504246+0000","last_active":"2024-08-17T02:47:10.504246+0000","last_peered":"2024-08-17T02:47:10.504246+0000","last_clean":"2024-08-17T02:47:10.504246+0000","last_became_active":"2024-08-17T02:47:10.501937+0000","last_became_peered":"2024-08-17T02:47:10.501937+0000","last_unstale":"2024-08-17T02:47:10.504246+0000","last_undegraded":"2024-08-17T02:47:10.504246+0000","last_fullsized":"2024-08-17T02:47:10.504246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:28.780515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.490321+0000","last_change":"2024-08-17T02:47:10.490321+0000","last_active":"2024-08-17T02:47:10.490321+0000","last_peered":"2024-08-17T02:47:10.490321+0000","last_clean":"2024-08-17T02:47:10.490321+0000","last_became_active":"2024-08-17T02:47:10.490069+0000","last_became_peered":"2024-08-17T02:47:10.490069+0000","last_unstale":"2024-08-17T02:47:10.490321+0000","last_undegraded":"2024-08-17T02:47:10.490321+0000","last_fullsized":"2024-08-17T02:47:10.490321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:02.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.477068+0000","last_change":"2024-08-17T02:47:10.477068+0000","last_active":"2024-08-17T02:47:10.477068+0000","last_peered":"2024-08-17T02:47:10.477068+0000","last_clean":"2024-08-17T02:47:10.477068+0000","last_became_active":"2024-08-17T02:47:10.476710+0000","last_became_peered":"2024-08-17T02:47:10.476710+0000","last_unstale":"2024-08-17T02:47:10.477068+0000","last_undegraded":"2024-08-17T02:47:10.477068+0000","last_fullsized":"2024-08-17T02:47:10.477068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:02.441874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502081+0000","last_change":"2024-08-17T02:47:10.502081+0000","last_active":"2024-08-17T02:47:10.502081+0000","last_peered":"2024-08-17T02:47:10.502081+0000","last_clean":"2024-08-17T02:47:10.502081+0000","last_became_active":"2024-08-17T02:47:10.501093+0000","last_became_peered":"2024-08-17T02:47:10.501093+0000","last_unstale":"2024-08-17T02:47:10.502081+0000","last_undegraded":"2024-08-17T02:47:10.502081+0000","last_fullsized":"2024-08-17T02:47:10.502081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:16.928151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.490545+0000","last_change":"2024-08-17T02:47:10.490545+0000","last_active":"2024-08-17T02:47:10.490545+0000","last_peered":"2024-08-17T02:47:10.490545+0000","last_clean":"2024-08-17T02:47:10.490545+0000","last_became_active":"2024-08-17T02:47:10.489622+0000","last_became_peered":"2024-08-17T02:47:10.489622+0000","last_unstale":"2024-08-17T02:47:10.490545+0000","last_undegraded":"2024-08-17T02:47:10.490545+0000","last_fullsized":"2024-08-17T02:47:10.490545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:32.610381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.498470+0000","last_change":"2024-08-17T02:47:09.478752+0000","last_active":"2024-08-17T02:47:10.498470+0000","last_peered":"2024-08-17T02:47:10.498470+0000","last_clean":"2024-08-17T02:47:10.498470+0000","last_became_active":"2024-08-17T02:47:09.478035+0000","last_became_peered":"2024-08-17T02:47:09.478035+0000","last_unstale":"2024-08-17T02:47:10.498470+0000","last_undegraded":"2024-08-17T02:47:10.498470+0000","last_fullsized":"2024-08-17T02:47:10.498470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:53.775592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502797+0000","last_change":"2024-08-17T02:47:10.502797+0000","last_active":"2024-08-17T02:47:10.502797+0000","last_peered":"2024-08-17T02:47:10.502797+0000","last_clean":"2024-08-17T02:47:10.502797+0000","last_became_active":"2024-08-17T02:47:10.502471+0000","last_became_peered":"2024-08-17T02:47:10.502471+0000","last_unstale":"2024-08-17T02:47:10.502797+0000","last_undegraded":"2024-08-17T02:47:10.502797+0000","last_fullsized":"2024-08-17T02:47:10.502797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:54.914854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.470748+0000","last_change":"2024-08-17T02:47:09.486443+0000","last_active":"2024-08-17T02:47:10.470748+0000","last_peered":"2024-08-17T02:47:10.470748+0000","last_clean":"2024-08-17T02:47:10.470748+0000","last_became_active":"2024-08-17T02:47:09.486177+0000","last_became_peered":"2024-08-17T02:47:09.486177+0000","last_unstale":"2024-08-17T02:47:10.470748+0000","last_undegraded":"2024-08-17T02:47:10.470748+0000","last_fullsized":"2024-08-17T02:47:10.470748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:20.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.504488+0000","last_change":"2024-08-17T02:47:10.504488+0000","last_active":"2024-08-17T02:47:10.504488+0000","last_peered":"2024-08-17T02:47:10.504488+0000","last_clean":"2024-08-17T02:47:10.504488+0000","last_became_active":"2024-08-17T02:47:10.501688+0000","last_became_peered":"2024-08-17T02:47:10.501688+0000","last_unstale":"2024-08-17T02:47:10.504488+0000","last_undegraded":"2024-08-17T02:47:10.504488+0000","last_fullsized":"2024-08-17T02:47:10.504488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:32.610381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.506750+0000","last_change":"2024-08-17T02:47:09.483885+0000","last_active":"2024-08-17T02:47:10.506750+0000","last_peered":"2024-08-17T02:47:10.506750+0000","last_clean":"2024-08-17T02:47:10.506750+0000","last_became_active":"2024-08-17T02:47:09.483639+0000","last_became_peered":"2024-08-17T02:47:09.483639+0000","last_unstale":"2024-08-17T02:47:10.506750+0000","last_undegraded":"2024-08-17T02:47:10.506750+0000","last_fullsized":"2024-08-17T02:47:10.506750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:20.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.485184+0000","last_change":"2024-08-17T02:47:10.485184+0000","last_active":"2024-08-17T02:47:10.485184+0000","last_peered":"2024-08-17T02:47:10.485184+0000","last_clean":"2024-08-17T02:47:10.485184+0000","last_became_active":"2024-08-17T02:47:10.482363+0000","last_became_peered":"2024-08-17T02:47:10.482363+0000","last_unstale":"2024-08-17T02:47:10.485184+0000","last_undegraded":"2024-08-17T02:47:10.485184+0000","last_fullsized":"2024-08-17T02:47:10.485184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:05.734743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.499001+0000","last_change":"2024-08-17T02:47:09.473562+0000","last_active":"2024-08-17T02:47:10.499001+0000","last_peered":"2024-08-17T02:47:10.499001+0000","last_clean":"2024-08-17T02:47:10.499001+0000","last_became_active":"2024-08-17T02:47:09.473336+0000","last_became_peered":"2024-08-17T02:47:09.473336+0000","last_unstale":"2024-08-17T02:47:10.499001+0000","last_undegraded":"2024-08-17T02:47:10.499001+0000","last_fullsized":"2024-08-17T02:47:10.499001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:55.411370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502057+0000","last_change":"2024-08-17T02:47:10.502057+0000","last_active":"2024-08-17T02:47:10.502057+0000","last_peered":"2024-08-17T02:47:10.502057+0000","last_clean":"2024-08-17T02:47:10.502057+0000","last_became_active":"2024-08-17T02:47:10.501086+0000","last_became_peered":"2024-08-17T02:47:10.501086+0000","last_unstale":"2024-08-17T02:47:10.502057+0000","last_undegraded":"2024-08-17T02:47:10.502057+0000","last_fullsized":"2024-08-17T02:47:10.502057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:08.538645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.487466+0000","last_change":"2024-08-17T02:47:09.484371+0000","last_active":"2024-08-17T02:47:10.487466+0000","last_peered":"2024-08-17T02:47:10.487466+0000","last_clean":"2024-08-17T02:47:10.487466+0000","last_became_active":"2024-08-17T02:47:09.484072+0000","last_became_peered":"2024-08-17T02:47:09.484072+0000","last_unstale":"2024-08-17T02:47:10.487466+0000","last_undegraded":"2024-08-17T02:47:10.487466+0000","last_fullsized":"2024-08-17T02:47:10.487466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:58.796344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.491107+0000","last_change":"2024-08-17T02:47:10.491107+0000","last_active":"2024-08-17T02:47:10.491107+0000","last_peered":"2024-08-17T02:47:10.491107+0000","last_clean":"2024-08-17T02:47:10.491107+0000","last_became_active":"2024-08-17T02:47:10.478032+0000","last_became_peered":"2024-08-17T02:47:10.478032+0000","last_unstale":"2024-08-17T02:47:10.491107+0000","last_undegraded":"2024-08-17T02:47:10.491107+0000","last_fullsized":"2024-08-17T02:47:10.491107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:57.744071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.482114+0000","last_change":"2024-08-17T02:47:09.486387+0000","last_active":"2024-08-17T02:47:10.482114+0000","last_peered":"2024-08-17T02:47:10.482114+0000","last_clean":"2024-08-17T02:47:10.482114+0000","last_became_active":"2024-08-17T02:47:09.486156+0000","last_became_peered":"2024-08-17T02:47:09.486156+0000","last_unstale":"2024-08-17T02:47:10.482114+0000","last_undegraded":"2024-08-17T02:47:10.482114+0000","last_fullsized":"2024-08-17T02:47:10.482114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:53.775592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.477794+0000","last_change":"2024-08-17T02:47:10.477794+0000","last_active":"2024-08-17T02:47:10.477794+0000","last_peered":"2024-08-17T02:47:10.477794+0000","last_clean":"2024-08-17T02:47:10.477794+0000","last_became_active":"2024-08-17T02:47:10.477452+0000","last_became_peered":"2024-08-17T02:47:10.477452+0000","last_unstale":"2024-08-17T02:47:10.477794+0000","last_undegraded":"2024-08-17T02:47:10.477794+0000","last_fullsized":"2024-08-17T02:47:10.477794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:26.311547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.484809+0000","last_change":"2024-08-17T02:47:09.480911+0000","last_active":"2024-08-17T02:47:09.484809+0000","last_peered":"2024-08-17T02:47:09.484809+0000","last_clean":"2024-08-17T02:47:09.484809+0000","last_became_active":"2024-08-17T02:47:09.480592+0000","last_became_peered":"2024-08-17T02:47:09.480592+0000","last_unstale":"2024-08-17T02:47:09.484809+0000","last_undegraded":"2024-08-17T02:47:09.484809+0000","last_fullsized":"2024-08-17T02:47:09.484809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:22.735572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.493330+0000","last_change":"2024-08-17T02:47:10.493330+0000","last_active":"2024-08-17T02:47:10.493330+0000","last_peered":"2024-08-17T02:47:10.493330+0000","last_clean":"2024-08-17T02:47:10.493330+0000","last_became_active":"2024-08-17T02:47:10.493045+0000","last_became_peered":"2024-08-17T02:47:10.493045+0000","last_unstale":"2024-08-17T02:47:10.493330+0000","last_undegraded":"2024-08-17T02:47:10.493330+0000","last_fullsized":"2024-08-17T02:47:10.493330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:06.185346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.480474+0000","last_change":"2024-08-17T02:47:09.477030+0000","last_active":"2024-08-17T02:47:09.480474+0000","last_peered":"2024-08-17T02:47:09.480474+0000","last_clean":"2024-08-17T02:47:09.480474+0000","last_became_active":"2024-08-17T02:47:09.476727+0000","last_became_peered":"2024-08-17T02:47:09.476727+0000","last_unstale":"2024-08-17T02:47:09.480474+0000","last_undegraded":"2024-08-17T02:47:09.480474+0000","last_fullsized":"2024-08-17T02:47:09.480474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:44.390373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502589+0000","last_change":"2024-08-17T02:47:10.502589+0000","last_active":"2024-08-17T02:47:10.502589+0000","last_peered":"2024-08-17T02:47:10.502589+0000","last_clean":"2024-08-17T02:47:10.502589+0000","last_became_active":"2024-08-17T02:47:10.502316+0000","last_became_peered":"2024-08-17T02:47:10.502316+0000","last_unstale":"2024-08-17T02:47:10.502589+0000","last_undegraded":"2024-08-17T02:47:10.502589+0000","last_fullsized":"2024-08-17T02:47:10.502589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:22.845857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.488808+0000","last_change":"2024-08-17T02:47:09.487448+0000","last_active":"2024-08-17T02:47:09.488808+0000","last_peered":"2024-08-17T02:47:09.488808+0000","last_clean":"2024-08-17T02:47:09.488808+0000","last_became_active":"2024-08-17T02:47:09.487113+0000","last_became_peered":"2024-08-17T02:47:09.487113+0000","last_unstale":"2024-08-17T02:47:09.488808+0000","last_undegraded":"2024-08-17T02:47:09.488808+0000","last_fullsized":"2024-08-17T02:47:09.488808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:53.908491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502280+0000","last_change":"2024-08-17T02:47:10.502280+0000","last_active":"2024-08-17T02:47:10.502280+0000","last_peered":"2024-08-17T02:47:10.502280+0000","last_clean":"2024-08-17T02:47:10.502280+0000","last_became_active":"2024-08-17T02:47:10.501943+0000","last_became_peered":"2024-08-17T02:47:10.501943+0000","last_unstale":"2024-08-17T02:47:10.502280+0000","last_undegraded":"2024-08-17T02:47:10.502280+0000","last_fullsized":"2024-08-17T02:47:10.502280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:14.372316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.486670+0000","last_change":"2024-08-17T02:47:09.484685+0000","last_active":"2024-08-17T02:47:09.486670+0000","last_peered":"2024-08-17T02:47:09.486670+0000","last_clean":"2024-08-17T02:47:09.486670+0000","last_became_active":"2024-08-17T02:47:09.484272+0000","last_became_peered":"2024-08-17T02:47:09.484272+0000","last_unstale":"2024-08-17T02:47:09.486670+0000","last_undegraded":"2024-08-17T02:47:09.486670+0000","last_fullsized":"2024-08-17T02:47:09.486670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:51.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.489632+0000","last_change":"2024-08-17T02:47:10.489632+0000","last_active":"2024-08-17T02:47:10.489632+0000","last_peered":"2024-08-17T02:47:10.489632+0000","last_clean":"2024-08-17T02:47:10.489632+0000","last_became_active":"2024-08-17T02:47:10.489380+0000","last_became_peered":"2024-08-17T02:47:10.489380+0000","last_unstale":"2024-08-17T02:47:10.489632+0000","last_undegraded":"2024-08-17T02:47:10.489632+0000","last_fullsized":"2024-08-17T02:47:10.489632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:59:48.511799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.493034+0000","last_change":"2024-08-17T02:47:09.483150+0000","last_active":"2024-08-17T02:47:10.493034+0000","last_peered":"2024-08-17T02:47:10.493034+0000","last_clean":"2024-08-17T02:47:10.493034+0000","last_became_active":"2024-08-17T02:47:09.482614+0000","last_became_peered":"2024-08-17T02:47:09.482614+0000","last_unstale":"2024-08-17T02:47:10.493034+0000","last_undegraded":"2024-08-17T02:47:10.493034+0000","last_fullsized":"2024-08-17T02:47:10.493034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:10.211758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488214+0000","last_change":"2024-08-17T02:47:10.488214+0000","last_active":"2024-08-17T02:47:10.488214+0000","last_peered":"2024-08-17T02:47:10.488214+0000","last_clean":"2024-08-17T02:47:10.488214+0000","last_became_active":"2024-08-17T02:47:10.487918+0000","last_became_peered":"2024-08-17T02:47:10.487918+0000","last_unstale":"2024-08-17T02:47:10.488214+0000","last_undegraded":"2024-08-17T02:47:10.488214+0000","last_fullsized":"2024-08-17T02:47:10.488214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:29.043609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.508045+0000","last_change":"2024-08-17T02:47:09.479454+0000","last_active":"2024-08-17T02:47:10.508045+0000","last_peered":"2024-08-17T02:47:10.508045+0000","last_clean":"2024-08-17T02:47:10.508045+0000","last_became_active":"2024-08-17T02:47:09.479209+0000","last_became_peered":"2024-08-17T02:47:09.479209+0000","last_unstale":"2024-08-17T02:47:10.508045+0000","last_undegraded":"2024-08-17T02:47:10.508045+0000","last_fullsized":"2024-08-17T02:47:10.508045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:06.775573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.475319+0000","last_change":"2024-08-17T02:47:10.475319+0000","last_active":"2024-08-17T02:47:10.475319+0000","last_peered":"2024-08-17T02:47:10.475319+0000","last_clean":"2024-08-17T02:47:10.475319+0000","last_became_active":"2024-08-17T02:47:10.473269+0000","last_became_peered":"2024-08-17T02:47:10.473269+0000","last_unstale":"2024-08-17T02:47:10.475319+0000","last_undegraded":"2024-08-17T02:47:10.475319+0000","last_fullsized":"2024-08-17T02:47:10.475319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:06.382253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.505363+0000","last_change":"2024-08-17T02:47:09.481275+0000","last_active":"2024-08-17T02:47:10.505363+0000","last_peered":"2024-08-17T02:47:10.505363+0000","last_clean":"2024-08-17T02:47:10.505363+0000","last_became_active":"2024-08-17T02:47:09.481003+0000","last_became_peered":"2024-08-17T02:47:09.481003+0000","last_unstale":"2024-08-17T02:47:10.505363+0000","last_undegraded":"2024-08-17T02:47:10.505363+0000","last_fullsized":"2024-08-17T02:47:10.505363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:04.260871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.483951+0000","last_change":"2024-08-17T02:47:10.483951+0000","last_active":"2024-08-17T02:47:10.483951+0000","last_peered":"2024-08-17T02:47:10.483951+0000","last_clean":"2024-08-17T02:47:10.483951+0000","last_became_active":"2024-08-17T02:47:10.481452+0000","last_became_peered":"2024-08-17T02:47:10.481452+0000","last_unstale":"2024-08-17T02:47:10.483951+0000","last_undegraded":"2024-08-17T02:47:10.483951+0000","last_fullsized":"2024-08-17T02:47:10.483951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:29.043609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.479881+0000","last_change":"2024-08-17T02:47:09.477129+0000","last_active":"2024-08-17T02:47:09.479881+0000","last_peered":"2024-08-17T02:47:09.479881+0000","last_clean":"2024-08-17T02:47:09.479881+0000","last_became_active":"2024-08-17T02:47:09.471378+0000","last_became_peered":"2024-08-17T02:47:09.471378+0000","last_unstale":"2024-08-17T02:47:09.479881+0000","last_undegraded":"2024-08-17T02:47:09.479881+0000","last_fullsized":"2024-08-17T02:47:09.479881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:06.554698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.505086+0000","last_change":"2024-08-17T02:47:10.505086+0000","last_active":"2024-08-17T02:47:10.505086+0000","last_peered":"2024-08-17T02:47:10.505086+0000","last_clean":"2024-08-17T02:47:10.505086+0000","last_became_active":"2024-08-17T02:47:10.504799+0000","last_became_peered":"2024-08-17T02:47:10.504799+0000","last_unstale":"2024-08-17T02:47:10.505086+0000","last_undegraded":"2024-08-17T02:47:10.505086+0000","last_fullsized":"2024-08-17T02:47:10.505086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:29.043609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.489070+0000","last_change":"2024-08-17T02:47:09.487983+0000","last_active":"2024-08-17T02:47:09.489070+0000","last_peered":"2024-08-17T02:47:09.489070+0000","last_clean":"2024-08-17T02:47:09.489070+0000","last_became_active":"2024-08-17T02:47:09.487427+0000","last_became_peered":"2024-08-17T02:47:09.487427+0000","last_unstale":"2024-08-17T02:47:09.489070+0000","last_undegraded":"2024-08-17T02:47:09.489070+0000","last_fullsized":"2024-08-17T02:47:09.489070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:10.211758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.482011+0000","last_change":"2024-08-17T02:47:10.482011+0000","last_active":"2024-08-17T02:47:10.482011+0000","last_peered":"2024-08-17T02:47:10.482011+0000","last_clean":"2024-08-17T02:47:10.482011+0000","last_became_active":"2024-08-17T02:47:10.481693+0000","last_became_peered":"2024-08-17T02:47:10.481693+0000","last_unstale":"2024-08-17T02:47:10.482011+0000","last_undegraded":"2024-08-17T02:47:10.482011+0000","last_fullsized":"2024-08-17T02:47:10.482011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:23.741935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.507386+0000","last_change":"2024-08-17T02:47:09.486527+0000","last_active":"2024-08-17T02:47:10.507386+0000","last_peered":"2024-08-17T02:47:10.507386+0000","last_clean":"2024-08-17T02:47:10.507386+0000","last_became_active":"2024-08-17T02:47:09.486012+0000","last_became_peered":"2024-08-17T02:47:09.486012+0000","last_unstale":"2024-08-17T02:47:10.507386+0000","last_undegraded":"2024-08-17T02:47:10.507386+0000","last_fullsized":"2024-08-17T02:47:10.507386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:25.305184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.497191+0000","last_change":"2024-08-17T02:47:10.497191+0000","last_active":"2024-08-17T02:47:10.497191+0000","last_peered":"2024-08-17T02:47:10.497191+0000","last_clean":"2024-08-17T02:47:10.497191+0000","last_became_active":"2024-08-17T02:47:10.496907+0000","last_became_peered":"2024-08-17T02:47:10.496907+0000","last_unstale":"2024-08-17T02:47:10.497191+0000","last_undegraded":"2024-08-17T02:47:10.497191+0000","last_fullsized":"2024-08-17T02:47:10.497191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:23.741935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.463725+0000","last_change":"2024-08-17T02:47:09.483175+0000","last_active":"2024-08-17T02:47:10.463725+0000","last_peered":"2024-08-17T02:47:10.463725+0000","last_clean":"2024-08-17T02:47:10.463725+0000","last_became_active":"2024-08-17T02:47:09.482906+0000","last_became_peered":"2024-08-17T02:47:09.482906+0000","last_unstale":"2024-08-17T02:47:10.463725+0000","last_undegraded":"2024-08-17T02:47:10.463725+0000","last_fullsized":"2024-08-17T02:47:10.463725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:20.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.495308+0000","last_change":"2024-08-17T02:47:10.495308+0000","last_active":"2024-08-17T02:47:10.495308+0000","last_peered":"2024-08-17T02:47:10.495308+0000","last_clean":"2024-08-17T02:47:10.495308+0000","last_became_active":"2024-08-17T02:47:10.495024+0000","last_became_peered":"2024-08-17T02:47:10.495024+0000","last_unstale":"2024-08-17T02:47:10.495308+0000","last_undegraded":"2024-08-17T02:47:10.495308+0000","last_fullsized":"2024-08-17T02:47:10.495308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:16.928151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.505390+0000","last_change":"2024-08-17T02:47:09.478473+0000","last_active":"2024-08-17T02:47:10.505390+0000","last_peered":"2024-08-17T02:47:10.505390+0000","last_clean":"2024-08-17T02:47:10.505390+0000","last_became_active":"2024-08-17T02:47:09.477559+0000","last_became_peered":"2024-08-17T02:47:09.477559+0000","last_unstale":"2024-08-17T02:47:10.505390+0000","last_undegraded":"2024-08-17T02:47:10.505390+0000","last_fullsized":"2024-08-17T02:47:10.505390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:45.753837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.481192+0000","last_change":"2024-08-17T02:47:10.481192+0000","last_active":"2024-08-17T02:47:10.481192+0000","last_peered":"2024-08-17T02:47:10.481192+0000","last_clean":"2024-08-17T02:47:10.481192+0000","last_became_active":"2024-08-17T02:47:10.479666+0000","last_became_peered":"2024-08-17T02:47:10.479666+0000","last_unstale":"2024-08-17T02:47:10.481192+0000","last_undegraded":"2024-08-17T02:47:10.481192+0000","last_fullsized":"2024-08-17T02:47:10.481192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:28:50.051083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488912+0000","last_change":"2024-08-17T02:47:09.483655+0000","last_active":"2024-08-17T02:47:10.488912+0000","last_peered":"2024-08-17T02:47:10.488912+0000","last_clean":"2024-08-17T02:47:10.488912+0000","last_became_active":"2024-08-17T02:47:09.483407+0000","last_became_peered":"2024-08-17T02:47:09.483407+0000","last_unstale":"2024-08-17T02:47:10.488912+0000","last_undegraded":"2024-08-17T02:47:10.488912+0000","last_fullsized":"2024-08-17T02:47:10.488912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:15.011853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.483140+0000","last_change":"2024-08-17T02:47:10.483140+0000","last_active":"2024-08-17T02:47:10.483140+0000","last_peered":"2024-08-17T02:47:10.483140+0000","last_clean":"2024-08-17T02:47:10.483140+0000","last_became_active":"2024-08-17T02:47:10.482876+0000","last_became_peered":"2024-08-17T02:47:10.482876+0000","last_unstale":"2024-08-17T02:47:10.483140+0000","last_undegraded":"2024-08-17T02:47:10.483140+0000","last_fullsized":"2024-08-17T02:47:10.483140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:10:29.389545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.487912+0000","last_change":"2024-08-17T02:47:09.484585+0000","last_active":"2024-08-17T02:47:09.487912+0000","last_peered":"2024-08-17T02:47:09.487912+0000","last_clean":"2024-08-17T02:47:09.487912+0000","last_became_active":"2024-08-17T02:47:09.484331+0000","last_became_peered":"2024-08-17T02:47:09.484331+0000","last_unstale":"2024-08-17T02:47:09.487912+0000","last_undegraded":"2024-08-17T02:47:09.487912+0000","last_fullsized":"2024-08-17T02:47:09.487912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:31.750997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.482306+0000","last_change":"2024-08-17T02:47:10.482306+0000","last_active":"2024-08-17T02:47:10.482306+0000","last_peered":"2024-08-17T02:47:10.482306+0000","last_clean":"2024-08-17T02:47:10.482306+0000","last_became_active":"2024-08-17T02:47:10.482026+0000","last_became_peered":"2024-08-17T02:47:10.482026+0000","last_unstale":"2024-08-17T02:47:10.482306+0000","last_undegraded":"2024-08-17T02:47:10.482306+0000","last_fullsized":"2024-08-17T02:47:10.482306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:39.753346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.499570+0000","last_change":"2024-08-17T02:47:09.481508+0000","last_active":"2024-08-17T02:47:10.499570+0000","last_peered":"2024-08-17T02:47:10.499570+0000","last_clean":"2024-08-17T02:47:10.499570+0000","last_became_active":"2024-08-17T02:47:09.481303+0000","last_became_peered":"2024-08-17T02:47:09.481303+0000","last_unstale":"2024-08-17T02:47:10.499570+0000","last_undegraded":"2024-08-17T02:47:10.499570+0000","last_fullsized":"2024-08-17T02:47:10.499570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:06.554698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484188+0000","last_change":"2024-08-17T02:47:10.484188+0000","last_active":"2024-08-17T02:47:10.484188+0000","last_peered":"2024-08-17T02:47:10.484188+0000","last_clean":"2024-08-17T02:47:10.484188+0000","last_became_active":"2024-08-17T02:47:10.483720+0000","last_became_peered":"2024-08-17T02:47:10.483720+0000","last_unstale":"2024-08-17T02:47:10.484188+0000","last_undegraded":"2024-08-17T02:47:10.484188+0000","last_fullsized":"2024-08-17T02:47:10.484188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:59.802707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.481441+0000","last_change":"2024-08-17T02:47:09.480418+0000","last_active":"2024-08-17T02:47:09.481441+0000","last_peered":"2024-08-17T02:47:09.481441+0000","last_clean":"2024-08-17T02:47:09.481441+0000","last_became_active":"2024-08-17T02:47:09.479679+0000","last_became_peered":"2024-08-17T02:47:09.479679+0000","last_unstale":"2024-08-17T02:47:09.481441+0000","last_undegraded":"2024-08-17T02:47:09.481441+0000","last_fullsized":"2024-08-17T02:47:09.481441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:15:49.262805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.483351+0000","last_change":"2024-08-17T02:47:10.483351+0000","last_active":"2024-08-17T02:47:10.483351+0000","last_peered":"2024-08-17T02:47:10.483351+0000","last_clean":"2024-08-17T02:47:10.483351+0000","last_became_active":"2024-08-17T02:47:10.481373+0000","last_became_peered":"2024-08-17T02:47:10.481373+0000","last_unstale":"2024-08-17T02:47:10.483351+0000","last_undegraded":"2024-08-17T02:47:10.483351+0000","last_fullsized":"2024-08-17T02:47:10.483351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:36.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.479539+0000","last_change":"2024-08-17T02:47:09.474751+0000","last_active":"2024-08-17T02:47:09.479539+0000","last_peered":"2024-08-17T02:47:09.479539+0000","last_clean":"2024-08-17T02:47:09.479539+0000","last_became_active":"2024-08-17T02:47:09.474488+0000","last_became_peered":"2024-08-17T02:47:09.474488+0000","last_unstale":"2024-08-17T02:47:09.479539+0000","last_undegraded":"2024-08-17T02:47:09.479539+0000","last_fullsized":"2024-08-17T02:47:09.479539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:39:28.951828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.495320+0000","last_change":"2024-08-17T02:47:10.495320+0000","last_active":"2024-08-17T02:47:10.495320+0000","last_peered":"2024-08-17T02:47:10.495320+0000","last_clean":"2024-08-17T02:47:10.495320+0000","last_became_active":"2024-08-17T02:47:10.492679+0000","last_became_peered":"2024-08-17T02:47:10.492679+0000","last_unstale":"2024-08-17T02:47:10.495320+0000","last_undegraded":"2024-08-17T02:47:10.495320+0000","last_fullsized":"2024-08-17T02:47:10.495320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:53.624019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.484846+0000","last_change":"2024-08-17T02:47:09.483345+0000","last_active":"2024-08-17T02:47:09.484846+0000","last_peered":"2024-08-17T02:47:09.484846+0000","last_clean":"2024-08-17T02:47:09.484846+0000","last_became_active":"2024-08-17T02:47:09.483047+0000","last_became_peered":"2024-08-17T02:47:09.483047+0000","last_unstale":"2024-08-17T02:47:09.484846+0000","last_undegraded":"2024-08-17T02:47:09.484846+0000","last_fullsized":"2024-08-17T02:47:09.484846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:53.908491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488165+0000","last_change":"2024-08-17T02:47:10.488165+0000","last_active":"2024-08-17T02:47:10.488165+0000","last_peered":"2024-08-17T02:47:10.488165+0000","last_clean":"2024-08-17T02:47:10.488165+0000","last_became_active":"2024-08-17T02:47:10.487889+0000","last_became_peered":"2024-08-17T02:47:10.487889+0000","last_unstale":"2024-08-17T02:47:10.488165+0000","last_undegraded":"2024-08-17T02:47:10.488165+0000","last_fullsized":"2024-08-17T02:47:10.488165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:32.757360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.501329+0000","last_change":"2024-08-17T02:47:09.475352+0000","last_active":"2024-08-17T02:47:10.501329+0000","last_peered":"2024-08-17T02:47:10.501329+0000","last_clean":"2024-08-17T02:47:10.501329+0000","last_became_active":"2024-08-17T02:47:09.472691+0000","last_became_peered":"2024-08-17T02:47:09.472691+0000","last_unstale":"2024-08-17T02:47:10.501329+0000","last_undegraded":"2024-08-17T02:47:10.501329+0000","last_fullsized":"2024-08-17T02:47:10.501329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:07:52.007878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.496206+0000","last_change":"2024-08-17T02:47:10.496206+0000","last_active":"2024-08-17T02:47:10.496206+0000","last_peered":"2024-08-17T02:47:10.496206+0000","last_clean":"2024-08-17T02:47:10.496206+0000","last_became_active":"2024-08-17T02:47:10.495917+0000","last_became_peered":"2024-08-17T02:47:10.495917+0000","last_unstale":"2024-08-17T02:47:10.496206+0000","last_undegraded":"2024-08-17T02:47:10.496206+0000","last_fullsized":"2024-08-17T02:47:10.496206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:52.545739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.480468+0000","last_change":"2024-08-17T02:47:09.474614+0000","last_active":"2024-08-17T02:47:09.480468+0000","last_peered":"2024-08-17T02:47:09.480468+0000","last_clean":"2024-08-17T02:47:09.480468+0000","last_became_active":"2024-08-17T02:47:09.474371+0000","last_became_peered":"2024-08-17T02:47:09.474371+0000","last_unstale":"2024-08-17T02:47:09.480468+0000","last_undegraded":"2024-08-17T02:47:09.480468+0000","last_fullsized":"2024-08-17T02:47:09.480468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:07:52.007878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.495845+0000","last_change":"2024-08-17T02:47:10.495845+0000","last_active":"2024-08-17T02:47:10.495845+0000","last_peered":"2024-08-17T02:47:10.495845+0000","last_clean":"2024-08-17T02:47:10.495845+0000","last_became_active":"2024-08-17T02:47:10.495537+0000","last_became_peered":"2024-08-17T02:47:10.495537+0000","last_unstale":"2024-08-17T02:47:10.495845+0000","last_undegraded":"2024-08-17T02:47:10.495845+0000","last_fullsized":"2024-08-17T02:47:10.495845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:19.220840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.482415+0000","last_change":"2024-08-17T02:47:09.479723+0000","last_active":"2024-08-17T02:47:09.482415+0000","last_peered":"2024-08-17T02:47:09.482415+0000","last_clean":"2024-08-17T02:47:09.482415+0000","last_became_active":"2024-08-17T02:47:09.479449+0000","last_became_peered":"2024-08-17T02:47:09.479449+0000","last_unstale":"2024-08-17T02:47:09.482415+0000","last_undegraded":"2024-08-17T02:47:09.482415+0000","last_fullsized":"2024-08-17T02:47:09.482415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:59.214613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.475585+0000","last_change":"2024-08-17T02:47:10.475585+0000","last_active":"2024-08-17T02:47:10.475585+0000","last_peered":"2024-08-17T02:47:10.475585+0000","last_clean":"2024-08-17T02:47:10.475585+0000","last_became_active":"2024-08-17T02:47:10.475187+0000","last_became_peered":"2024-08-17T02:47:10.475187+0000","last_unstale":"2024-08-17T02:47:10.475585+0000","last_undegraded":"2024-08-17T02:47:10.475585+0000","last_fullsized":"2024-08-17T02:47:10.475585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:26.311547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.483132+0000","last_change":"2024-08-17T02:47:09.478695+0000","last_active":"2024-08-17T02:47:09.483132+0000","last_peered":"2024-08-17T02:47:09.483132+0000","last_clean":"2024-08-17T02:47:09.483132+0000","last_became_active":"2024-08-17T02:47:09.478408+0000","last_became_peered":"2024-08-17T02:47:09.478408+0000","last_unstale":"2024-08-17T02:47:09.483132+0000","last_undegraded":"2024-08-17T02:47:09.483132+0000","last_fullsized":"2024-08-17T02:47:09.483132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:10:28.383182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.478047+0000","last_change":"2024-08-17T02:47:10.478047+0000","last_active":"2024-08-17T02:47:10.478047+0000","last_peered":"2024-08-17T02:47:10.478047+0000","last_clean":"2024-08-17T02:47:10.478047+0000","last_became_active":"2024-08-17T02:47:10.477800+0000","last_became_peered":"2024-08-17T02:47:10.477800+0000","last_unstale":"2024-08-17T02:47:10.478047+0000","last_undegraded":"2024-08-17T02:47:10.478047+0000","last_fullsized":"2024-08-17T02:47:10.478047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:54.914854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.482971+0000","last_change":"2024-08-17T02:47:09.477370+0000","last_active":"2024-08-17T02:47:09.482971+0000","last_peered":"2024-08-17T02:47:09.482971+0000","last_clean":"2024-08-17T02:47:09.482971+0000","last_became_active":"2024-08-17T02:47:09.476851+0000","last_became_peered":"2024-08-17T02:47:09.476851+0000","last_unstale":"2024-08-17T02:47:09.482971+0000","last_undegraded":"2024-08-17T02:47:09.482971+0000","last_fullsized":"2024-08-17T02:47:09.482971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:51.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.491175+0000","last_change":"2024-08-17T02:47:10.491175+0000","last_active":"2024-08-17T02:47:10.491175+0000","last_peered":"2024-08-17T02:47:10.491175+0000","last_clean":"2024-08-17T02:47:10.491175+0000","last_became_active":"2024-08-17T02:47:10.490889+0000","last_became_peered":"2024-08-17T02:47:10.490889+0000","last_unstale":"2024-08-17T02:47:10.491175+0000","last_undegraded":"2024-08-17T02:47:10.491175+0000","last_fullsized":"2024-08-17T02:47:10.491175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:02.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.487023+0000","last_change":"2024-08-17T02:47:09.481920+0000","last_active":"2024-08-17T02:47:09.487023+0000","last_peered":"2024-08-17T02:47:09.487023+0000","last_clean":"2024-08-17T02:47:09.487023+0000","last_became_active":"2024-08-17T02:47:09.481652+0000","last_became_peered":"2024-08-17T02:47:09.481652+0000","last_unstale":"2024-08-17T02:47:09.487023+0000","last_undegraded":"2024-08-17T02:47:09.487023+0000","last_fullsized":"2024-08-17T02:47:09.487023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:24.778055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.499033+0000","last_change":"2024-08-17T02:47:10.499033+0000","last_active":"2024-08-17T02:47:10.499033+0000","last_peered":"2024-08-17T02:47:10.499033+0000","last_clean":"2024-08-17T02:47:10.499033+0000","last_became_active":"2024-08-17T02:47:10.498813+0000","last_became_peered":"2024-08-17T02:47:10.498813+0000","last_unstale":"2024-08-17T02:47:10.499033+0000","last_undegraded":"2024-08-17T02:47:10.499033+0000","last_fullsized":"2024-08-17T02:47:10.499033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:19.220840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.488749+0000","last_change":"2024-08-17T02:47:09.486679+0000","last_active":"2024-08-17T02:47:09.488749+0000","last_peered":"2024-08-17T02:47:09.488749+0000","last_clean":"2024-08-17T02:47:09.488749+0000","last_became_active":"2024-08-17T02:47:09.486314+0000","last_became_peered":"2024-08-17T02:47:09.486314+0000","last_unstale":"2024-08-17T02:47:09.488749+0000","last_undegraded":"2024-08-17T02:47:09.488749+0000","last_fullsized":"2024-08-17T02:47:09.488749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:01.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.493099+0000","last_change":"2024-08-17T02:47:10.493099+0000","last_active":"2024-08-17T02:47:10.493099+0000","last_peered":"2024-08-17T02:47:10.493099+0000","last_clean":"2024-08-17T02:47:10.493099+0000","last_became_active":"2024-08-17T02:47:10.492701+0000","last_became_peered":"2024-08-17T02:47:10.492701+0000","last_unstale":"2024-08-17T02:47:10.493099+0000","last_undegraded":"2024-08-17T02:47:10.493099+0000","last_fullsized":"2024-08-17T02:47:10.493099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:16.317027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.479442+0000","last_change":"2024-08-17T02:47:09.476112+0000","last_active":"2024-08-17T02:47:09.479442+0000","last_peered":"2024-08-17T02:47:09.479442+0000","last_clean":"2024-08-17T02:47:09.479442+0000","last_became_active":"2024-08-17T02:47:09.475729+0000","last_became_peered":"2024-08-17T02:47:09.475729+0000","last_unstale":"2024-08-17T02:47:09.479442+0000","last_undegraded":"2024-08-17T02:47:09.479442+0000","last_fullsized":"2024-08-17T02:47:09.479442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:38.746983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.482553+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:47:09.482553+0000","last_peered":"2024-08-17T02:47:09.482553+0000","last_clean":"2024-08-17T02:47:09.482553+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:47:09.482553+0000","last_undegraded":"2024-08-17T02:47:09.482553+0000","last_fullsized":"2024-08-17T02:47:09.482553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":958464,"data_stored":727846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.501},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.81399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.48599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":348160,"data_stored":130625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.505},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.624},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69399999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.71299999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.746}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":368640,"data_stored":138048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71899999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.495},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.61899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":348160,"data_stored":130625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":2.8780000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":2.4470000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":2.3540000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":6.859}]},{"osd":2,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":8.3379999999999992},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":5.2969999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.7149999999999999,"5min":3.7149999999999999,"15min":3.7149999999999999},"last":2.403},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":8.2899999999999991}]},{"osd":5,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":6.0640000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":3.7629999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":5.2169999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":2.484},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":12.157999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":138962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":137458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":6.0810000000000004,"5min":6.0810000000000004,"15min":6.0810000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.61199999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.9740000000000002,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.378},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":6.1120000000000001,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":6.0499999999999998,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.75},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.3200000000000003,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.3899999999999997,"5min":6.3899999999999997,"15min":6.3899999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":6.0190000000000001,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":138962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.2789999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.501}]},{"osd":4,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.673,"5min":3.673,"15min":3.673},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.73099999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.75},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":5.3079999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":954368,"data_stored":727756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.76800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84499999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75}]},{"osd":6,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.62},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.92900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:14.694 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:47:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.877+0000 7f6752a00640 1 Processor -- start 2024-08-17T02:47:14.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.878+0000 7f6752a00640 1 -- start start 2024-08-17T02:47:14.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6752a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f674c0ad790 0x7f674c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6752a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6752a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674c0ca6b0 con 0x7f674c1552d0 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6752a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674c0cb180 con 0x7f674c0ad790 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6752a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0af530 con 0x7f674c0c9d20 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6751600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f674c0ad790 0x7f674c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6751600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f674c0ad790 0x7f674c0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47806/0 (socket says 172.21.15.2:47806) 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6751600640 1 -- 172.21.15.2:0/2149563413 learned_addr learned my addr 172.21.15.2:0/2149563413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.879+0000 7f6750c00640 1 --2- 172.21.15.2:0/2149563413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.880+0000 7f6751600640 1 -- 172.21.15.2:0/2149563413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 msgr2=0x7f674c0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.880+0000 7f6751600640 1 --2- 172.21.15.2:0/2149563413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.880+0000 7f6751600640 1 -- 172.21.15.2:0/2149563413 >> v1:172.21.15.26:6789/0 conn(0x7f674c1552d0 legacy=0x7f674c155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.880+0000 7f6751600640 1 -- 172.21.15.2:0/2149563413 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c0ca8e0 con 0x7f674c0ad790 2024-08-17T02:47:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.880+0000 7f6750c00640 1 --2- 172.21.15.2:0/2149563413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.881+0000 7f6751600640 1 --2- 172.21.15.2:0/2149563413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c0adb60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6740009910 tx=0x7f67400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd0541e5945a534 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.881+0000 7f674be00640 1 -- 172.21.15.2:0/2149563413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674002add0 con 0x7f674c0ad790 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.881+0000 7f674be00640 1 -- 172.21.15.2:0/2149563413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6740032440 con 0x7f674c0ad790 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.881+0000 7f674be00640 1 -- 172.21.15.2:0/2149563413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740032820 con 0x7f674c0ad790 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.881+0000 7f6752a00640 1 -- 172.21.15.2:0/2149563413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 msgr2=0x7f674c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.881+0000 7f6752a00640 1 --2- 172.21.15.2:0/2149563413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c0adb60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6740009910 tx=0x7f67400091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.882+0000 7f6752a00640 1 -- 172.21.15.2:0/2149563413 shutdown_connections 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.882+0000 7f6752a00640 1 --2- 172.21.15.2:0/2149563413 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.882+0000 7f6752a00640 1 --2- 172.21.15.2:0/2149563413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c0adb60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.882+0000 7f6752a00640 1 -- 172.21.15.2:0/2149563413 >> 172.21.15.2:0/2149563413 conn(0x7f674c062af0 msgr2=0x7f674c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.882+0000 7f6752a00640 1 -- 172.21.15.2:0/2149563413 shutdown_connections 2024-08-17T02:47:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.882+0000 7f6752a00640 1 -- 172.21.15.2:0/2149563413 wait complete. 2024-08-17T02:47:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.883+0000 7f6752a00640 1 Processor -- start 2024-08-17T02:47:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.883+0000 7f6752a00640 1 -- start start 2024-08-17T02:47:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6752a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6752a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6752a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f674c1552d0 0x7f674c069780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6752a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0a9990 con 0x7f674c0ad790 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6752a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c1446e0 con 0x7f674c1552d0 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6752a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c0abf80 con 0x7f674c0c9d20 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6751600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6751600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47820/0 (socket says 172.21.15.2:47820) 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6751600640 1 -- 172.21.15.2:0/981213414 learned_addr learned my addr 172.21.15.2:0/981213414 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6750c00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0a8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.884+0000 7f6752000640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f674c1552d0 0x7f674c069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6751600640 1 -- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 msgr2=0x7f674c0a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6751600640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0a8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6751600640 1 -- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f674c1552d0 msgr2=0x7f674c069780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6751600640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f674c1552d0 0x7f674c069780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6751600640 1 -- 172.21.15.2:0/981213414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740009450 con 0x7f674c0ad790 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6750c00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6752000640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f674c1552d0 0x7f674c069780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6751600640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c1441a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6740035040 tx=0x7f6740032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6748c00640 1 -- 172.21.15.2:0/981213414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740031de0 con 0x7f674c0ad790 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6748c00640 1 -- 172.21.15.2:0/981213414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674003d420 con 0x7f674c0ad790 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674c0ac260 con 0x7f674c0ad790 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.885+0000 7f6748c00640 1 -- 172.21.15.2:0/981213414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674003d7e0 con 0x7f674c0ad790 2024-08-17T02:47:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.886+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674c0ac820 con 0x7f674c0ad790 2024-08-17T02:47:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.886+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674c0aca40 con 0x7f674c0ad790 2024-08-17T02:47:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.887+0000 7f6748c00640 1 -- 172.21.15.2:0/981213414 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6740039040 con 0x7f674c0ad790 2024-08-17T02:47:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.888+0000 7f6748c00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f672c065150 0x7f672c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.888+0000 7f6748c00640 1 -- 172.21.15.2:0/981213414 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67400a27a0 con 0x7f674c0ad790 2024-08-17T02:47:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.888+0000 7f6750c00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f672c065150 0x7f672c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.889+0000 7f6750c00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f672c065150 0x7f672c067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f674c06e440 tx=0x7f6738008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:14.892+0000 7f6748c00640 1 -- 172.21.15.2:0/981213414 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6740070860 con 0x7f674c0ad790 2024-08-17T02:47:15.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.073+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f674c070720 con 0x7f672c065150 2024-08-17T02:47:15.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.080+0000 7f6748c00640 1 -- 172.21.15.2:0/981213414 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286308 (secure 0 0 0) 0x7f674c070720 con 0x7f672c065150 2024-08-17T02:47:15.084 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:15.086 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:47:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f672c065150 msgr2=0x7f672c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f672c065150 0x7f672c067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f674c06e440 tx=0x7f6738008040 comp rx=0 tx=0).stop 2024-08-17T02:47:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 msgr2=0x7f674c1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c1441a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6740035040 tx=0x7f6740032000 comp rx=0 tx=0).stop 2024-08-17T02:47:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 shutdown_connections 2024-08-17T02:47:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f674c1552d0 0x7f674c069780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f672c065150 0x7f672c067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f674c0c9d20 0x7f674c0a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 --2- 172.21.15.2:0/981213414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f674c0ad790 0x7f674c1441a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 >> 172.21.15.2:0/981213414 conn(0x7f674c062af0 msgr2=0x7f674c0aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 shutdown_connections 2024-08-17T02:47:15.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.084+0000 7f6752a00640 1 -- 172.21.15.2:0/981213414 wait complete. 2024-08-17T02:47:15.101 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-08-17T02:47:15.025837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2416152,"kb_used_data":4000,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752558568,"statfs":{"total":773094113280,"available":770619973632,"internally_reserved":0,"allocated":4096000,"data_stored":2270282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000796"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.491782+0000","last_change":"2024-08-17T02:47:10.491782+0000","last_active":"2024-08-17T02:47:10.491782+0000","last_peered":"2024-08-17T02:47:10.491782+0000","last_clean":"2024-08-17T02:47:10.491782+0000","last_became_active":"2024-08-17T02:47:10.491245+0000","last_became_peered":"2024-08-17T02:47:10.491245+0000","last_unstale":"2024-08-17T02:47:10.491782+0000","last_undegraded":"2024-08-17T02:47:10.491782+0000","last_fullsized":"2024-08-17T02:47:10.491782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:11.218121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488455+0000","last_change":"2024-08-17T02:47:10.488455+0000","last_active":"2024-08-17T02:47:10.488455+0000","last_peered":"2024-08-17T02:47:10.488455+0000","last_clean":"2024-08-17T02:47:10.488455+0000","last_became_active":"2024-08-17T02:47:10.484614+0000","last_became_peered":"2024-08-17T02:47:10.484614+0000","last_unstale":"2024-08-17T02:47:10.488455+0000","last_undegraded":"2024-08-17T02:47:10.488455+0000","last_fullsized":"2024-08-17T02:47:10.488455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:52.545739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484906+0000","last_change":"2024-08-17T02:47:10.484906+0000","last_active":"2024-08-17T02:47:10.484906+0000","last_peered":"2024-08-17T02:47:10.484906+0000","last_clean":"2024-08-17T02:47:10.484906+0000","last_became_active":"2024-08-17T02:47:10.483409+0000","last_became_peered":"2024-08-17T02:47:10.483409+0000","last_unstale":"2024-08-17T02:47:10.484906+0000","last_undegraded":"2024-08-17T02:47:10.484906+0000","last_fullsized":"2024-08-17T02:47:10.484906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:02.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.481318+0000","last_change":"2024-08-17T02:47:10.481318+0000","last_active":"2024-08-17T02:47:10.481318+0000","last_peered":"2024-08-17T02:47:10.481318+0000","last_clean":"2024-08-17T02:47:10.481318+0000","last_became_active":"2024-08-17T02:47:10.480925+0000","last_became_peered":"2024-08-17T02:47:10.480925+0000","last_unstale":"2024-08-17T02:47:10.481318+0000","last_undegraded":"2024-08-17T02:47:10.481318+0000","last_fullsized":"2024-08-17T02:47:10.481318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:32.595137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484369+0000","last_change":"2024-08-17T02:47:10.484369+0000","last_active":"2024-08-17T02:47:10.484369+0000","last_peered":"2024-08-17T02:47:10.484369+0000","last_clean":"2024-08-17T02:47:10.484369+0000","last_became_active":"2024-08-17T02:47:10.483927+0000","last_became_peered":"2024-08-17T02:47:10.483927+0000","last_unstale":"2024-08-17T02:47:10.484369+0000","last_undegraded":"2024-08-17T02:47:10.484369+0000","last_fullsized":"2024-08-17T02:47:10.484369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:00.220976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.487057+0000","last_change":"2024-08-17T02:47:10.487057+0000","last_active":"2024-08-17T02:47:10.487057+0000","last_peered":"2024-08-17T02:47:10.487057+0000","last_clean":"2024-08-17T02:47:10.487057+0000","last_became_active":"2024-08-17T02:47:10.486778+0000","last_became_peered":"2024-08-17T02:47:10.486778+0000","last_unstale":"2024-08-17T02:47:10.487057+0000","last_undegraded":"2024-08-17T02:47:10.487057+0000","last_fullsized":"2024-08-17T02:47:10.487057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:16.928151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.495003+0000","last_change":"2024-08-17T02:47:10.495003+0000","last_active":"2024-08-17T02:47:10.495003+0000","last_peered":"2024-08-17T02:47:10.495003+0000","last_clean":"2024-08-17T02:47:10.495003+0000","last_became_active":"2024-08-17T02:47:10.493132+0000","last_became_peered":"2024-08-17T02:47:10.493132+0000","last_unstale":"2024-08-17T02:47:10.495003+0000","last_undegraded":"2024-08-17T02:47:10.495003+0000","last_fullsized":"2024-08-17T02:47:10.495003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:09.752059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488152+0000","last_change":"2024-08-17T02:47:10.488152+0000","last_active":"2024-08-17T02:47:10.488152+0000","last_peered":"2024-08-17T02:47:10.488152+0000","last_clean":"2024-08-17T02:47:10.488152+0000","last_became_active":"2024-08-17T02:47:10.487879+0000","last_became_peered":"2024-08-17T02:47:10.487879+0000","last_unstale":"2024-08-17T02:47:10.488152+0000","last_undegraded":"2024-08-17T02:47:10.488152+0000","last_fullsized":"2024-08-17T02:47:10.488152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:14.372316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.500719+0000","last_change":"2024-08-17T02:47:10.500719+0000","last_active":"2024-08-17T02:47:10.500719+0000","last_peered":"2024-08-17T02:47:10.500719+0000","last_clean":"2024-08-17T02:47:10.500719+0000","last_became_active":"2024-08-17T02:47:10.500423+0000","last_became_peered":"2024-08-17T02:47:10.500423+0000","last_unstale":"2024-08-17T02:47:10.500719+0000","last_undegraded":"2024-08-17T02:47:10.500719+0000","last_fullsized":"2024-08-17T02:47:10.500719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:07.781936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.506471+0000","last_change":"2024-08-17T02:47:10.506471+0000","last_active":"2024-08-17T02:47:10.506471+0000","last_peered":"2024-08-17T02:47:10.506471+0000","last_clean":"2024-08-17T02:47:10.506471+0000","last_became_active":"2024-08-17T02:47:10.503110+0000","last_became_peered":"2024-08-17T02:47:10.503110+0000","last_unstale":"2024-08-17T02:47:10.506471+0000","last_undegraded":"2024-08-17T02:47:10.506471+0000","last_fullsized":"2024-08-17T02:47:10.506471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:16.317027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.493593+0000","last_change":"2024-08-17T02:47:10.493593+0000","last_active":"2024-08-17T02:47:10.493593+0000","last_peered":"2024-08-17T02:47:10.493593+0000","last_clean":"2024-08-17T02:47:10.493593+0000","last_became_active":"2024-08-17T02:47:10.492733+0000","last_became_peered":"2024-08-17T02:47:10.492733+0000","last_unstale":"2024-08-17T02:47:10.493593+0000","last_undegraded":"2024-08-17T02:47:10.493593+0000","last_fullsized":"2024-08-17T02:47:10.493593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:57.744071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.489943+0000","last_change":"2024-08-17T02:47:10.489943+0000","last_active":"2024-08-17T02:47:10.489943+0000","last_peered":"2024-08-17T02:47:10.489943+0000","last_clean":"2024-08-17T02:47:10.489943+0000","last_became_active":"2024-08-17T02:47:10.489645+0000","last_became_peered":"2024-08-17T02:47:10.489645+0000","last_unstale":"2024-08-17T02:47:10.489943+0000","last_undegraded":"2024-08-17T02:47:10.489943+0000","last_fullsized":"2024-08-17T02:47:10.489943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:05:34.308613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484391+0000","last_change":"2024-08-17T02:47:10.484391+0000","last_active":"2024-08-17T02:47:10.484391+0000","last_peered":"2024-08-17T02:47:10.484391+0000","last_clean":"2024-08-17T02:47:10.484391+0000","last_became_active":"2024-08-17T02:47:10.484093+0000","last_became_peered":"2024-08-17T02:47:10.484093+0000","last_unstale":"2024-08-17T02:47:10.484391+0000","last_undegraded":"2024-08-17T02:47:10.484391+0000","last_fullsized":"2024-08-17T02:47:10.484391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:54.781955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.481833+0000","last_change":"2024-08-17T02:47:10.481833+0000","last_active":"2024-08-17T02:47:10.481833+0000","last_peered":"2024-08-17T02:47:10.481833+0000","last_clean":"2024-08-17T02:47:10.481833+0000","last_became_active":"2024-08-17T02:47:10.481521+0000","last_became_peered":"2024-08-17T02:47:10.481521+0000","last_unstale":"2024-08-17T02:47:10.481833+0000","last_undegraded":"2024-08-17T02:47:10.481833+0000","last_fullsized":"2024-08-17T02:47:10.481833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:22.845857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.487517+0000","last_change":"2024-08-17T02:47:10.487517+0000","last_active":"2024-08-17T02:47:10.487517+0000","last_peered":"2024-08-17T02:47:10.487517+0000","last_clean":"2024-08-17T02:47:10.487517+0000","last_became_active":"2024-08-17T02:47:10.485748+0000","last_became_peered":"2024-08-17T02:47:10.485748+0000","last_unstale":"2024-08-17T02:47:10.487517+0000","last_undegraded":"2024-08-17T02:47:10.487517+0000","last_fullsized":"2024-08-17T02:47:10.487517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:53.624019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.499419+0000","last_change":"2024-08-17T02:47:10.499419+0000","last_active":"2024-08-17T02:47:10.499419+0000","last_peered":"2024-08-17T02:47:10.499419+0000","last_clean":"2024-08-17T02:47:10.499419+0000","last_became_active":"2024-08-17T02:47:10.499146+0000","last_became_peered":"2024-08-17T02:47:10.499146+0000","last_unstale":"2024-08-17T02:47:10.499419+0000","last_undegraded":"2024-08-17T02:47:10.499419+0000","last_fullsized":"2024-08-17T02:47:10.499419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:52.545739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.485764+0000","last_change":"2024-08-17T02:47:10.485764+0000","last_active":"2024-08-17T02:47:10.485764+0000","last_peered":"2024-08-17T02:47:10.485764+0000","last_clean":"2024-08-17T02:47:10.485764+0000","last_became_active":"2024-08-17T02:47:10.485408+0000","last_became_peered":"2024-08-17T02:47:10.485408+0000","last_unstale":"2024-08-17T02:47:10.485764+0000","last_undegraded":"2024-08-17T02:47:10.485764+0000","last_fullsized":"2024-08-17T02:47:10.485764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:22.845857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.492792+0000","last_change":"2024-08-17T02:47:10.492792+0000","last_active":"2024-08-17T02:47:10.492792+0000","last_peered":"2024-08-17T02:47:10.492792+0000","last_clean":"2024-08-17T02:47:10.492792+0000","last_became_active":"2024-08-17T02:47:10.492483+0000","last_became_peered":"2024-08-17T02:47:10.492483+0000","last_unstale":"2024-08-17T02:47:10.492792+0000","last_undegraded":"2024-08-17T02:47:10.492792+0000","last_fullsized":"2024-08-17T02:47:10.492792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:53.624019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.494248+0000","last_change":"2024-08-17T02:47:10.494248+0000","last_active":"2024-08-17T02:47:10.494248+0000","last_peered":"2024-08-17T02:47:10.494248+0000","last_clean":"2024-08-17T02:47:10.494248+0000","last_became_active":"2024-08-17T02:47:10.493975+0000","last_became_peered":"2024-08-17T02:47:10.493975+0000","last_unstale":"2024-08-17T02:47:10.494248+0000","last_undegraded":"2024-08-17T02:47:10.494248+0000","last_fullsized":"2024-08-17T02:47:10.494248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:57.744071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488215+0000","last_change":"2024-08-17T02:47:10.488215+0000","last_active":"2024-08-17T02:47:10.488215+0000","last_peered":"2024-08-17T02:47:10.488215+0000","last_clean":"2024-08-17T02:47:10.488215+0000","last_became_active":"2024-08-17T02:47:10.487065+0000","last_became_peered":"2024-08-17T02:47:10.487065+0000","last_unstale":"2024-08-17T02:47:10.488215+0000","last_undegraded":"2024-08-17T02:47:10.488215+0000","last_fullsized":"2024-08-17T02:47:10.488215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:15:50.269168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.504107+0000","last_change":"2024-08-17T02:47:10.504107+0000","last_active":"2024-08-17T02:47:10.504107+0000","last_peered":"2024-08-17T02:47:10.504107+0000","last_clean":"2024-08-17T02:47:10.504107+0000","last_became_active":"2024-08-17T02:47:10.501470+0000","last_became_peered":"2024-08-17T02:47:10.501470+0000","last_unstale":"2024-08-17T02:47:10.504107+0000","last_undegraded":"2024-08-17T02:47:10.504107+0000","last_fullsized":"2024-08-17T02:47:10.504107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:11.218121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.481938+0000","last_change":"2024-08-17T02:47:10.481938+0000","last_active":"2024-08-17T02:47:10.481938+0000","last_peered":"2024-08-17T02:47:10.481938+0000","last_clean":"2024-08-17T02:47:10.481938+0000","last_became_active":"2024-08-17T02:47:10.481564+0000","last_became_peered":"2024-08-17T02:47:10.481564+0000","last_unstale":"2024-08-17T02:47:10.481938+0000","last_undegraded":"2024-08-17T02:47:10.481938+0000","last_fullsized":"2024-08-17T02:47:10.481938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:06.185346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.486724+0000","last_change":"2024-08-17T02:47:10.486724+0000","last_active":"2024-08-17T02:47:10.486724+0000","last_peered":"2024-08-17T02:47:10.486724+0000","last_clean":"2024-08-17T02:47:10.486724+0000","last_became_active":"2024-08-17T02:47:10.486478+0000","last_became_peered":"2024-08-17T02:47:10.486478+0000","last_unstale":"2024-08-17T02:47:10.486724+0000","last_undegraded":"2024-08-17T02:47:10.486724+0000","last_fullsized":"2024-08-17T02:47:10.486724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:28.780515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.482891+0000","last_change":"2024-08-17T02:47:10.482891+0000","last_active":"2024-08-17T02:47:10.482891+0000","last_peered":"2024-08-17T02:47:10.482891+0000","last_clean":"2024-08-17T02:47:10.482891+0000","last_became_active":"2024-08-17T02:47:10.481957+0000","last_became_peered":"2024-08-17T02:47:10.481957+0000","last_unstale":"2024-08-17T02:47:10.482891+0000","last_undegraded":"2024-08-17T02:47:10.482891+0000","last_fullsized":"2024-08-17T02:47:10.482891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:14.372316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.492656+0000","last_change":"2024-08-17T02:47:10.492656+0000","last_active":"2024-08-17T02:47:10.492656+0000","last_peered":"2024-08-17T02:47:10.492656+0000","last_clean":"2024-08-17T02:47:10.492656+0000","last_became_active":"2024-08-17T02:47:10.492355+0000","last_became_peered":"2024-08-17T02:47:10.492355+0000","last_unstale":"2024-08-17T02:47:10.492656+0000","last_undegraded":"2024-08-17T02:47:10.492656+0000","last_fullsized":"2024-08-17T02:47:10.492656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:08.538645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488968+0000","last_change":"2024-08-17T02:47:10.488968+0000","last_active":"2024-08-17T02:47:10.488968+0000","last_peered":"2024-08-17T02:47:10.488968+0000","last_clean":"2024-08-17T02:47:10.488968+0000","last_became_active":"2024-08-17T02:47:10.488734+0000","last_became_peered":"2024-08-17T02:47:10.488734+0000","last_unstale":"2024-08-17T02:47:10.488968+0000","last_undegraded":"2024-08-17T02:47:10.488968+0000","last_fullsized":"2024-08-17T02:47:10.488968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:05:34.308613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.480024+0000","last_change":"2024-08-17T02:47:10.480024+0000","last_active":"2024-08-17T02:47:10.480024+0000","last_peered":"2024-08-17T02:47:10.480024+0000","last_clean":"2024-08-17T02:47:10.480024+0000","last_became_active":"2024-08-17T02:47:10.479171+0000","last_became_peered":"2024-08-17T02:47:10.479171+0000","last_unstale":"2024-08-17T02:47:10.480024+0000","last_undegraded":"2024-08-17T02:47:10.480024+0000","last_fullsized":"2024-08-17T02:47:10.480024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:09.752059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484932+0000","last_change":"2024-08-17T02:47:10.484932+0000","last_active":"2024-08-17T02:47:10.484932+0000","last_peered":"2024-08-17T02:47:10.484932+0000","last_clean":"2024-08-17T02:47:10.484932+0000","last_became_active":"2024-08-17T02:47:10.479544+0000","last_became_peered":"2024-08-17T02:47:10.479544+0000","last_unstale":"2024-08-17T02:47:10.484932+0000","last_undegraded":"2024-08-17T02:47:10.484932+0000","last_fullsized":"2024-08-17T02:47:10.484932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:08.538645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.504246+0000","last_change":"2024-08-17T02:47:10.504246+0000","last_active":"2024-08-17T02:47:10.504246+0000","last_peered":"2024-08-17T02:47:10.504246+0000","last_clean":"2024-08-17T02:47:10.504246+0000","last_became_active":"2024-08-17T02:47:10.501937+0000","last_became_peered":"2024-08-17T02:47:10.501937+0000","last_unstale":"2024-08-17T02:47:10.504246+0000","last_undegraded":"2024-08-17T02:47:10.504246+0000","last_fullsized":"2024-08-17T02:47:10.504246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:28.780515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.490321+0000","last_change":"2024-08-17T02:47:10.490321+0000","last_active":"2024-08-17T02:47:10.490321+0000","last_peered":"2024-08-17T02:47:10.490321+0000","last_clean":"2024-08-17T02:47:10.490321+0000","last_became_active":"2024-08-17T02:47:10.490069+0000","last_became_peered":"2024-08-17T02:47:10.490069+0000","last_unstale":"2024-08-17T02:47:10.490321+0000","last_undegraded":"2024-08-17T02:47:10.490321+0000","last_fullsized":"2024-08-17T02:47:10.490321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:02.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.477068+0000","last_change":"2024-08-17T02:47:10.477068+0000","last_active":"2024-08-17T02:47:10.477068+0000","last_peered":"2024-08-17T02:47:10.477068+0000","last_clean":"2024-08-17T02:47:10.477068+0000","last_became_active":"2024-08-17T02:47:10.476710+0000","last_became_peered":"2024-08-17T02:47:10.476710+0000","last_unstale":"2024-08-17T02:47:10.477068+0000","last_undegraded":"2024-08-17T02:47:10.477068+0000","last_fullsized":"2024-08-17T02:47:10.477068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:02.441874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502081+0000","last_change":"2024-08-17T02:47:10.502081+0000","last_active":"2024-08-17T02:47:10.502081+0000","last_peered":"2024-08-17T02:47:10.502081+0000","last_clean":"2024-08-17T02:47:10.502081+0000","last_became_active":"2024-08-17T02:47:10.501093+0000","last_became_peered":"2024-08-17T02:47:10.501093+0000","last_unstale":"2024-08-17T02:47:10.502081+0000","last_undegraded":"2024-08-17T02:47:10.502081+0000","last_fullsized":"2024-08-17T02:47:10.502081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:16.928151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.490545+0000","last_change":"2024-08-17T02:47:10.490545+0000","last_active":"2024-08-17T02:47:10.490545+0000","last_peered":"2024-08-17T02:47:10.490545+0000","last_clean":"2024-08-17T02:47:10.490545+0000","last_became_active":"2024-08-17T02:47:10.489622+0000","last_became_peered":"2024-08-17T02:47:10.489622+0000","last_unstale":"2024-08-17T02:47:10.490545+0000","last_undegraded":"2024-08-17T02:47:10.490545+0000","last_fullsized":"2024-08-17T02:47:10.490545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:32.610381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.498470+0000","last_change":"2024-08-17T02:47:09.478752+0000","last_active":"2024-08-17T02:47:10.498470+0000","last_peered":"2024-08-17T02:47:10.498470+0000","last_clean":"2024-08-17T02:47:10.498470+0000","last_became_active":"2024-08-17T02:47:09.478035+0000","last_became_peered":"2024-08-17T02:47:09.478035+0000","last_unstale":"2024-08-17T02:47:10.498470+0000","last_undegraded":"2024-08-17T02:47:10.498470+0000","last_fullsized":"2024-08-17T02:47:10.498470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:53.775592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502797+0000","last_change":"2024-08-17T02:47:10.502797+0000","last_active":"2024-08-17T02:47:10.502797+0000","last_peered":"2024-08-17T02:47:10.502797+0000","last_clean":"2024-08-17T02:47:10.502797+0000","last_became_active":"2024-08-17T02:47:10.502471+0000","last_became_peered":"2024-08-17T02:47:10.502471+0000","last_unstale":"2024-08-17T02:47:10.502797+0000","last_undegraded":"2024-08-17T02:47:10.502797+0000","last_fullsized":"2024-08-17T02:47:10.502797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:54.914854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.470748+0000","last_change":"2024-08-17T02:47:09.486443+0000","last_active":"2024-08-17T02:47:10.470748+0000","last_peered":"2024-08-17T02:47:10.470748+0000","last_clean":"2024-08-17T02:47:10.470748+0000","last_became_active":"2024-08-17T02:47:09.486177+0000","last_became_peered":"2024-08-17T02:47:09.486177+0000","last_unstale":"2024-08-17T02:47:10.470748+0000","last_undegraded":"2024-08-17T02:47:10.470748+0000","last_fullsized":"2024-08-17T02:47:10.470748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:20.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.504488+0000","last_change":"2024-08-17T02:47:10.504488+0000","last_active":"2024-08-17T02:47:10.504488+0000","last_peered":"2024-08-17T02:47:10.504488+0000","last_clean":"2024-08-17T02:47:10.504488+0000","last_became_active":"2024-08-17T02:47:10.501688+0000","last_became_peered":"2024-08-17T02:47:10.501688+0000","last_unstale":"2024-08-17T02:47:10.504488+0000","last_undegraded":"2024-08-17T02:47:10.504488+0000","last_fullsized":"2024-08-17T02:47:10.504488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:32.610381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.506750+0000","last_change":"2024-08-17T02:47:09.483885+0000","last_active":"2024-08-17T02:47:10.506750+0000","last_peered":"2024-08-17T02:47:10.506750+0000","last_clean":"2024-08-17T02:47:10.506750+0000","last_became_active":"2024-08-17T02:47:09.483639+0000","last_became_peered":"2024-08-17T02:47:09.483639+0000","last_unstale":"2024-08-17T02:47:10.506750+0000","last_undegraded":"2024-08-17T02:47:10.506750+0000","last_fullsized":"2024-08-17T02:47:10.506750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:20.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.485184+0000","last_change":"2024-08-17T02:47:10.485184+0000","last_active":"2024-08-17T02:47:10.485184+0000","last_peered":"2024-08-17T02:47:10.485184+0000","last_clean":"2024-08-17T02:47:10.485184+0000","last_became_active":"2024-08-17T02:47:10.482363+0000","last_became_peered":"2024-08-17T02:47:10.482363+0000","last_unstale":"2024-08-17T02:47:10.485184+0000","last_undegraded":"2024-08-17T02:47:10.485184+0000","last_fullsized":"2024-08-17T02:47:10.485184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:05.734743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.499001+0000","last_change":"2024-08-17T02:47:09.473562+0000","last_active":"2024-08-17T02:47:10.499001+0000","last_peered":"2024-08-17T02:47:10.499001+0000","last_clean":"2024-08-17T02:47:10.499001+0000","last_became_active":"2024-08-17T02:47:09.473336+0000","last_became_peered":"2024-08-17T02:47:09.473336+0000","last_unstale":"2024-08-17T02:47:10.499001+0000","last_undegraded":"2024-08-17T02:47:10.499001+0000","last_fullsized":"2024-08-17T02:47:10.499001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:55.411370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502057+0000","last_change":"2024-08-17T02:47:10.502057+0000","last_active":"2024-08-17T02:47:10.502057+0000","last_peered":"2024-08-17T02:47:10.502057+0000","last_clean":"2024-08-17T02:47:10.502057+0000","last_became_active":"2024-08-17T02:47:10.501086+0000","last_became_peered":"2024-08-17T02:47:10.501086+0000","last_unstale":"2024-08-17T02:47:10.502057+0000","last_undegraded":"2024-08-17T02:47:10.502057+0000","last_fullsized":"2024-08-17T02:47:10.502057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:08.538645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.487466+0000","last_change":"2024-08-17T02:47:09.484371+0000","last_active":"2024-08-17T02:47:10.487466+0000","last_peered":"2024-08-17T02:47:10.487466+0000","last_clean":"2024-08-17T02:47:10.487466+0000","last_became_active":"2024-08-17T02:47:09.484072+0000","last_became_peered":"2024-08-17T02:47:09.484072+0000","last_unstale":"2024-08-17T02:47:10.487466+0000","last_undegraded":"2024-08-17T02:47:10.487466+0000","last_fullsized":"2024-08-17T02:47:10.487466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:58.796344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.491107+0000","last_change":"2024-08-17T02:47:10.491107+0000","last_active":"2024-08-17T02:47:10.491107+0000","last_peered":"2024-08-17T02:47:10.491107+0000","last_clean":"2024-08-17T02:47:10.491107+0000","last_became_active":"2024-08-17T02:47:10.478032+0000","last_became_peered":"2024-08-17T02:47:10.478032+0000","last_unstale":"2024-08-17T02:47:10.491107+0000","last_undegraded":"2024-08-17T02:47:10.491107+0000","last_fullsized":"2024-08-17T02:47:10.491107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:02:57.744071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.482114+0000","last_change":"2024-08-17T02:47:09.486387+0000","last_active":"2024-08-17T02:47:10.482114+0000","last_peered":"2024-08-17T02:47:10.482114+0000","last_clean":"2024-08-17T02:47:10.482114+0000","last_became_active":"2024-08-17T02:47:09.486156+0000","last_became_peered":"2024-08-17T02:47:09.486156+0000","last_unstale":"2024-08-17T02:47:10.482114+0000","last_undegraded":"2024-08-17T02:47:10.482114+0000","last_fullsized":"2024-08-17T02:47:10.482114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:10:53.775592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.477794+0000","last_change":"2024-08-17T02:47:10.477794+0000","last_active":"2024-08-17T02:47:10.477794+0000","last_peered":"2024-08-17T02:47:10.477794+0000","last_clean":"2024-08-17T02:47:10.477794+0000","last_became_active":"2024-08-17T02:47:10.477452+0000","last_became_peered":"2024-08-17T02:47:10.477452+0000","last_unstale":"2024-08-17T02:47:10.477794+0000","last_undegraded":"2024-08-17T02:47:10.477794+0000","last_fullsized":"2024-08-17T02:47:10.477794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:26.311547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.484809+0000","last_change":"2024-08-17T02:47:09.480911+0000","last_active":"2024-08-17T02:47:09.484809+0000","last_peered":"2024-08-17T02:47:09.484809+0000","last_clean":"2024-08-17T02:47:09.484809+0000","last_became_active":"2024-08-17T02:47:09.480592+0000","last_became_peered":"2024-08-17T02:47:09.480592+0000","last_unstale":"2024-08-17T02:47:09.484809+0000","last_undegraded":"2024-08-17T02:47:09.484809+0000","last_fullsized":"2024-08-17T02:47:09.484809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:22.735572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.493330+0000","last_change":"2024-08-17T02:47:10.493330+0000","last_active":"2024-08-17T02:47:10.493330+0000","last_peered":"2024-08-17T02:47:10.493330+0000","last_clean":"2024-08-17T02:47:10.493330+0000","last_became_active":"2024-08-17T02:47:10.493045+0000","last_became_peered":"2024-08-17T02:47:10.493045+0000","last_unstale":"2024-08-17T02:47:10.493330+0000","last_undegraded":"2024-08-17T02:47:10.493330+0000","last_fullsized":"2024-08-17T02:47:10.493330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:06.185346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.480474+0000","last_change":"2024-08-17T02:47:09.477030+0000","last_active":"2024-08-17T02:47:09.480474+0000","last_peered":"2024-08-17T02:47:09.480474+0000","last_clean":"2024-08-17T02:47:09.480474+0000","last_became_active":"2024-08-17T02:47:09.476727+0000","last_became_peered":"2024-08-17T02:47:09.476727+0000","last_unstale":"2024-08-17T02:47:09.480474+0000","last_undegraded":"2024-08-17T02:47:09.480474+0000","last_fullsized":"2024-08-17T02:47:09.480474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:44.390373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502589+0000","last_change":"2024-08-17T02:47:10.502589+0000","last_active":"2024-08-17T02:47:10.502589+0000","last_peered":"2024-08-17T02:47:10.502589+0000","last_clean":"2024-08-17T02:47:10.502589+0000","last_became_active":"2024-08-17T02:47:10.502316+0000","last_became_peered":"2024-08-17T02:47:10.502316+0000","last_unstale":"2024-08-17T02:47:10.502589+0000","last_undegraded":"2024-08-17T02:47:10.502589+0000","last_fullsized":"2024-08-17T02:47:10.502589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:22.845857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.488808+0000","last_change":"2024-08-17T02:47:09.487448+0000","last_active":"2024-08-17T02:47:09.488808+0000","last_peered":"2024-08-17T02:47:09.488808+0000","last_clean":"2024-08-17T02:47:09.488808+0000","last_became_active":"2024-08-17T02:47:09.487113+0000","last_became_peered":"2024-08-17T02:47:09.487113+0000","last_unstale":"2024-08-17T02:47:09.488808+0000","last_undegraded":"2024-08-17T02:47:09.488808+0000","last_fullsized":"2024-08-17T02:47:09.488808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:53.908491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.502280+0000","last_change":"2024-08-17T02:47:10.502280+0000","last_active":"2024-08-17T02:47:10.502280+0000","last_peered":"2024-08-17T02:47:10.502280+0000","last_clean":"2024-08-17T02:47:10.502280+0000","last_became_active":"2024-08-17T02:47:10.501943+0000","last_became_peered":"2024-08-17T02:47:10.501943+0000","last_unstale":"2024-08-17T02:47:10.502280+0000","last_undegraded":"2024-08-17T02:47:10.502280+0000","last_fullsized":"2024-08-17T02:47:10.502280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:14.372316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.486670+0000","last_change":"2024-08-17T02:47:09.484685+0000","last_active":"2024-08-17T02:47:09.486670+0000","last_peered":"2024-08-17T02:47:09.486670+0000","last_clean":"2024-08-17T02:47:09.486670+0000","last_became_active":"2024-08-17T02:47:09.484272+0000","last_became_peered":"2024-08-17T02:47:09.484272+0000","last_unstale":"2024-08-17T02:47:09.486670+0000","last_undegraded":"2024-08-17T02:47:09.486670+0000","last_fullsized":"2024-08-17T02:47:09.486670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:51.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.489632+0000","last_change":"2024-08-17T02:47:10.489632+0000","last_active":"2024-08-17T02:47:10.489632+0000","last_peered":"2024-08-17T02:47:10.489632+0000","last_clean":"2024-08-17T02:47:10.489632+0000","last_became_active":"2024-08-17T02:47:10.489380+0000","last_became_peered":"2024-08-17T02:47:10.489380+0000","last_unstale":"2024-08-17T02:47:10.489632+0000","last_undegraded":"2024-08-17T02:47:10.489632+0000","last_fullsized":"2024-08-17T02:47:10.489632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:59:48.511799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.493034+0000","last_change":"2024-08-17T02:47:09.483150+0000","last_active":"2024-08-17T02:47:10.493034+0000","last_peered":"2024-08-17T02:47:10.493034+0000","last_clean":"2024-08-17T02:47:10.493034+0000","last_became_active":"2024-08-17T02:47:09.482614+0000","last_became_peered":"2024-08-17T02:47:09.482614+0000","last_unstale":"2024-08-17T02:47:10.493034+0000","last_undegraded":"2024-08-17T02:47:10.493034+0000","last_fullsized":"2024-08-17T02:47:10.493034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:10.211758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488214+0000","last_change":"2024-08-17T02:47:10.488214+0000","last_active":"2024-08-17T02:47:10.488214+0000","last_peered":"2024-08-17T02:47:10.488214+0000","last_clean":"2024-08-17T02:47:10.488214+0000","last_became_active":"2024-08-17T02:47:10.487918+0000","last_became_peered":"2024-08-17T02:47:10.487918+0000","last_unstale":"2024-08-17T02:47:10.488214+0000","last_undegraded":"2024-08-17T02:47:10.488214+0000","last_fullsized":"2024-08-17T02:47:10.488214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:29.043609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.508045+0000","last_change":"2024-08-17T02:47:09.479454+0000","last_active":"2024-08-17T02:47:10.508045+0000","last_peered":"2024-08-17T02:47:10.508045+0000","last_clean":"2024-08-17T02:47:10.508045+0000","last_became_active":"2024-08-17T02:47:09.479209+0000","last_became_peered":"2024-08-17T02:47:09.479209+0000","last_unstale":"2024-08-17T02:47:10.508045+0000","last_undegraded":"2024-08-17T02:47:10.508045+0000","last_fullsized":"2024-08-17T02:47:10.508045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:06.775573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.475319+0000","last_change":"2024-08-17T02:47:10.475319+0000","last_active":"2024-08-17T02:47:10.475319+0000","last_peered":"2024-08-17T02:47:10.475319+0000","last_clean":"2024-08-17T02:47:10.475319+0000","last_became_active":"2024-08-17T02:47:10.473269+0000","last_became_peered":"2024-08-17T02:47:10.473269+0000","last_unstale":"2024-08-17T02:47:10.475319+0000","last_undegraded":"2024-08-17T02:47:10.475319+0000","last_fullsized":"2024-08-17T02:47:10.475319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:06.382253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.505363+0000","last_change":"2024-08-17T02:47:09.481275+0000","last_active":"2024-08-17T02:47:10.505363+0000","last_peered":"2024-08-17T02:47:10.505363+0000","last_clean":"2024-08-17T02:47:10.505363+0000","last_became_active":"2024-08-17T02:47:09.481003+0000","last_became_peered":"2024-08-17T02:47:09.481003+0000","last_unstale":"2024-08-17T02:47:10.505363+0000","last_undegraded":"2024-08-17T02:47:10.505363+0000","last_fullsized":"2024-08-17T02:47:10.505363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:04.260871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.483951+0000","last_change":"2024-08-17T02:47:10.483951+0000","last_active":"2024-08-17T02:47:10.483951+0000","last_peered":"2024-08-17T02:47:10.483951+0000","last_clean":"2024-08-17T02:47:10.483951+0000","last_became_active":"2024-08-17T02:47:10.481452+0000","last_became_peered":"2024-08-17T02:47:10.481452+0000","last_unstale":"2024-08-17T02:47:10.483951+0000","last_undegraded":"2024-08-17T02:47:10.483951+0000","last_fullsized":"2024-08-17T02:47:10.483951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:29.043609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.479881+0000","last_change":"2024-08-17T02:47:09.477129+0000","last_active":"2024-08-17T02:47:09.479881+0000","last_peered":"2024-08-17T02:47:09.479881+0000","last_clean":"2024-08-17T02:47:09.479881+0000","last_became_active":"2024-08-17T02:47:09.471378+0000","last_became_peered":"2024-08-17T02:47:09.471378+0000","last_unstale":"2024-08-17T02:47:09.479881+0000","last_undegraded":"2024-08-17T02:47:09.479881+0000","last_fullsized":"2024-08-17T02:47:09.479881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:06.554698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.505086+0000","last_change":"2024-08-17T02:47:10.505086+0000","last_active":"2024-08-17T02:47:10.505086+0000","last_peered":"2024-08-17T02:47:10.505086+0000","last_clean":"2024-08-17T02:47:10.505086+0000","last_became_active":"2024-08-17T02:47:10.504799+0000","last_became_peered":"2024-08-17T02:47:10.504799+0000","last_unstale":"2024-08-17T02:47:10.505086+0000","last_undegraded":"2024-08-17T02:47:10.505086+0000","last_fullsized":"2024-08-17T02:47:10.505086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:18:29.043609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.489070+0000","last_change":"2024-08-17T02:47:09.487983+0000","last_active":"2024-08-17T02:47:09.489070+0000","last_peered":"2024-08-17T02:47:09.489070+0000","last_clean":"2024-08-17T02:47:09.489070+0000","last_became_active":"2024-08-17T02:47:09.487427+0000","last_became_peered":"2024-08-17T02:47:09.487427+0000","last_unstale":"2024-08-17T02:47:09.489070+0000","last_undegraded":"2024-08-17T02:47:09.489070+0000","last_fullsized":"2024-08-17T02:47:09.489070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:10.211758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.482011+0000","last_change":"2024-08-17T02:47:10.482011+0000","last_active":"2024-08-17T02:47:10.482011+0000","last_peered":"2024-08-17T02:47:10.482011+0000","last_clean":"2024-08-17T02:47:10.482011+0000","last_became_active":"2024-08-17T02:47:10.481693+0000","last_became_peered":"2024-08-17T02:47:10.481693+0000","last_unstale":"2024-08-17T02:47:10.482011+0000","last_undegraded":"2024-08-17T02:47:10.482011+0000","last_fullsized":"2024-08-17T02:47:10.482011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:23.741935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.507386+0000","last_change":"2024-08-17T02:47:09.486527+0000","last_active":"2024-08-17T02:47:10.507386+0000","last_peered":"2024-08-17T02:47:10.507386+0000","last_clean":"2024-08-17T02:47:10.507386+0000","last_became_active":"2024-08-17T02:47:09.486012+0000","last_became_peered":"2024-08-17T02:47:09.486012+0000","last_unstale":"2024-08-17T02:47:10.507386+0000","last_undegraded":"2024-08-17T02:47:10.507386+0000","last_fullsized":"2024-08-17T02:47:10.507386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:25.305184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.497191+0000","last_change":"2024-08-17T02:47:10.497191+0000","last_active":"2024-08-17T02:47:10.497191+0000","last_peered":"2024-08-17T02:47:10.497191+0000","last_clean":"2024-08-17T02:47:10.497191+0000","last_became_active":"2024-08-17T02:47:10.496907+0000","last_became_peered":"2024-08-17T02:47:10.496907+0000","last_unstale":"2024-08-17T02:47:10.497191+0000","last_undegraded":"2024-08-17T02:47:10.497191+0000","last_fullsized":"2024-08-17T02:47:10.497191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:23.741935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.463725+0000","last_change":"2024-08-17T02:47:09.483175+0000","last_active":"2024-08-17T02:47:10.463725+0000","last_peered":"2024-08-17T02:47:10.463725+0000","last_clean":"2024-08-17T02:47:10.463725+0000","last_became_active":"2024-08-17T02:47:09.482906+0000","last_became_peered":"2024-08-17T02:47:09.482906+0000","last_unstale":"2024-08-17T02:47:10.463725+0000","last_undegraded":"2024-08-17T02:47:10.463725+0000","last_fullsized":"2024-08-17T02:47:10.463725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:20.292077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.495308+0000","last_change":"2024-08-17T02:47:10.495308+0000","last_active":"2024-08-17T02:47:10.495308+0000","last_peered":"2024-08-17T02:47:10.495308+0000","last_clean":"2024-08-17T02:47:10.495308+0000","last_became_active":"2024-08-17T02:47:10.495024+0000","last_became_peered":"2024-08-17T02:47:10.495024+0000","last_unstale":"2024-08-17T02:47:10.495308+0000","last_undegraded":"2024-08-17T02:47:10.495308+0000","last_fullsized":"2024-08-17T02:47:10.495308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:16.928151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.505390+0000","last_change":"2024-08-17T02:47:09.478473+0000","last_active":"2024-08-17T02:47:10.505390+0000","last_peered":"2024-08-17T02:47:10.505390+0000","last_clean":"2024-08-17T02:47:10.505390+0000","last_became_active":"2024-08-17T02:47:09.477559+0000","last_became_peered":"2024-08-17T02:47:09.477559+0000","last_unstale":"2024-08-17T02:47:10.505390+0000","last_undegraded":"2024-08-17T02:47:10.505390+0000","last_fullsized":"2024-08-17T02:47:10.505390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:23:45.753837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.481192+0000","last_change":"2024-08-17T02:47:10.481192+0000","last_active":"2024-08-17T02:47:10.481192+0000","last_peered":"2024-08-17T02:47:10.481192+0000","last_clean":"2024-08-17T02:47:10.481192+0000","last_became_active":"2024-08-17T02:47:10.479666+0000","last_became_peered":"2024-08-17T02:47:10.479666+0000","last_unstale":"2024-08-17T02:47:10.481192+0000","last_undegraded":"2024-08-17T02:47:10.481192+0000","last_fullsized":"2024-08-17T02:47:10.481192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:28:50.051083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488912+0000","last_change":"2024-08-17T02:47:09.483655+0000","last_active":"2024-08-17T02:47:10.488912+0000","last_peered":"2024-08-17T02:47:10.488912+0000","last_clean":"2024-08-17T02:47:10.488912+0000","last_became_active":"2024-08-17T02:47:09.483407+0000","last_became_peered":"2024-08-17T02:47:09.483407+0000","last_unstale":"2024-08-17T02:47:10.488912+0000","last_undegraded":"2024-08-17T02:47:10.488912+0000","last_fullsized":"2024-08-17T02:47:10.488912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:15.011853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.483140+0000","last_change":"2024-08-17T02:47:10.483140+0000","last_active":"2024-08-17T02:47:10.483140+0000","last_peered":"2024-08-17T02:47:10.483140+0000","last_clean":"2024-08-17T02:47:10.483140+0000","last_became_active":"2024-08-17T02:47:10.482876+0000","last_became_peered":"2024-08-17T02:47:10.482876+0000","last_unstale":"2024-08-17T02:47:10.483140+0000","last_undegraded":"2024-08-17T02:47:10.483140+0000","last_fullsized":"2024-08-17T02:47:10.483140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:10:29.389545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.487912+0000","last_change":"2024-08-17T02:47:09.484585+0000","last_active":"2024-08-17T02:47:09.487912+0000","last_peered":"2024-08-17T02:47:09.487912+0000","last_clean":"2024-08-17T02:47:09.487912+0000","last_became_active":"2024-08-17T02:47:09.484331+0000","last_became_peered":"2024-08-17T02:47:09.484331+0000","last_unstale":"2024-08-17T02:47:09.487912+0000","last_undegraded":"2024-08-17T02:47:09.487912+0000","last_fullsized":"2024-08-17T02:47:09.487912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:31.750997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.482306+0000","last_change":"2024-08-17T02:47:10.482306+0000","last_active":"2024-08-17T02:47:10.482306+0000","last_peered":"2024-08-17T02:47:10.482306+0000","last_clean":"2024-08-17T02:47:10.482306+0000","last_became_active":"2024-08-17T02:47:10.482026+0000","last_became_peered":"2024-08-17T02:47:10.482026+0000","last_unstale":"2024-08-17T02:47:10.482306+0000","last_undegraded":"2024-08-17T02:47:10.482306+0000","last_fullsized":"2024-08-17T02:47:10.482306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:39.753346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.499570+0000","last_change":"2024-08-17T02:47:09.481508+0000","last_active":"2024-08-17T02:47:10.499570+0000","last_peered":"2024-08-17T02:47:10.499570+0000","last_clean":"2024-08-17T02:47:10.499570+0000","last_became_active":"2024-08-17T02:47:09.481303+0000","last_became_peered":"2024-08-17T02:47:09.481303+0000","last_unstale":"2024-08-17T02:47:10.499570+0000","last_undegraded":"2024-08-17T02:47:10.499570+0000","last_fullsized":"2024-08-17T02:47:10.499570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:06.554698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.484188+0000","last_change":"2024-08-17T02:47:10.484188+0000","last_active":"2024-08-17T02:47:10.484188+0000","last_peered":"2024-08-17T02:47:10.484188+0000","last_clean":"2024-08-17T02:47:10.484188+0000","last_became_active":"2024-08-17T02:47:10.483720+0000","last_became_peered":"2024-08-17T02:47:10.483720+0000","last_unstale":"2024-08-17T02:47:10.484188+0000","last_undegraded":"2024-08-17T02:47:10.484188+0000","last_fullsized":"2024-08-17T02:47:10.484188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:59.802707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.481441+0000","last_change":"2024-08-17T02:47:09.480418+0000","last_active":"2024-08-17T02:47:09.481441+0000","last_peered":"2024-08-17T02:47:09.481441+0000","last_clean":"2024-08-17T02:47:09.481441+0000","last_became_active":"2024-08-17T02:47:09.479679+0000","last_became_peered":"2024-08-17T02:47:09.479679+0000","last_unstale":"2024-08-17T02:47:09.481441+0000","last_undegraded":"2024-08-17T02:47:09.481441+0000","last_fullsized":"2024-08-17T02:47:09.481441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:15:49.262805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.483351+0000","last_change":"2024-08-17T02:47:10.483351+0000","last_active":"2024-08-17T02:47:10.483351+0000","last_peered":"2024-08-17T02:47:10.483351+0000","last_clean":"2024-08-17T02:47:10.483351+0000","last_became_active":"2024-08-17T02:47:10.481373+0000","last_became_peered":"2024-08-17T02:47:10.481373+0000","last_unstale":"2024-08-17T02:47:10.483351+0000","last_undegraded":"2024-08-17T02:47:10.483351+0000","last_fullsized":"2024-08-17T02:47:10.483351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:36.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.479539+0000","last_change":"2024-08-17T02:47:09.474751+0000","last_active":"2024-08-17T02:47:09.479539+0000","last_peered":"2024-08-17T02:47:09.479539+0000","last_clean":"2024-08-17T02:47:09.479539+0000","last_became_active":"2024-08-17T02:47:09.474488+0000","last_became_peered":"2024-08-17T02:47:09.474488+0000","last_unstale":"2024-08-17T02:47:09.479539+0000","last_undegraded":"2024-08-17T02:47:09.479539+0000","last_fullsized":"2024-08-17T02:47:09.479539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:39:28.951828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.495320+0000","last_change":"2024-08-17T02:47:10.495320+0000","last_active":"2024-08-17T02:47:10.495320+0000","last_peered":"2024-08-17T02:47:10.495320+0000","last_clean":"2024-08-17T02:47:10.495320+0000","last_became_active":"2024-08-17T02:47:10.492679+0000","last_became_peered":"2024-08-17T02:47:10.492679+0000","last_unstale":"2024-08-17T02:47:10.495320+0000","last_undegraded":"2024-08-17T02:47:10.495320+0000","last_fullsized":"2024-08-17T02:47:10.495320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:53.624019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.484846+0000","last_change":"2024-08-17T02:47:09.483345+0000","last_active":"2024-08-17T02:47:09.484846+0000","last_peered":"2024-08-17T02:47:09.484846+0000","last_clean":"2024-08-17T02:47:09.484846+0000","last_became_active":"2024-08-17T02:47:09.483047+0000","last_became_peered":"2024-08-17T02:47:09.483047+0000","last_unstale":"2024-08-17T02:47:09.484846+0000","last_undegraded":"2024-08-17T02:47:09.484846+0000","last_fullsized":"2024-08-17T02:47:09.484846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:53.908491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.488165+0000","last_change":"2024-08-17T02:47:10.488165+0000","last_active":"2024-08-17T02:47:10.488165+0000","last_peered":"2024-08-17T02:47:10.488165+0000","last_clean":"2024-08-17T02:47:10.488165+0000","last_became_active":"2024-08-17T02:47:10.487889+0000","last_became_peered":"2024-08-17T02:47:10.487889+0000","last_unstale":"2024-08-17T02:47:10.488165+0000","last_undegraded":"2024-08-17T02:47:10.488165+0000","last_fullsized":"2024-08-17T02:47:10.488165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:32.757360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.501329+0000","last_change":"2024-08-17T02:47:09.475352+0000","last_active":"2024-08-17T02:47:10.501329+0000","last_peered":"2024-08-17T02:47:10.501329+0000","last_clean":"2024-08-17T02:47:10.501329+0000","last_became_active":"2024-08-17T02:47:09.472691+0000","last_became_peered":"2024-08-17T02:47:09.472691+0000","last_unstale":"2024-08-17T02:47:10.501329+0000","last_undegraded":"2024-08-17T02:47:10.501329+0000","last_fullsized":"2024-08-17T02:47:10.501329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:07:52.007878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.496206+0000","last_change":"2024-08-17T02:47:10.496206+0000","last_active":"2024-08-17T02:47:10.496206+0000","last_peered":"2024-08-17T02:47:10.496206+0000","last_clean":"2024-08-17T02:47:10.496206+0000","last_became_active":"2024-08-17T02:47:10.495917+0000","last_became_peered":"2024-08-17T02:47:10.495917+0000","last_unstale":"2024-08-17T02:47:10.496206+0000","last_undegraded":"2024-08-17T02:47:10.496206+0000","last_fullsized":"2024-08-17T02:47:10.496206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:52.545739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.480468+0000","last_change":"2024-08-17T02:47:09.474614+0000","last_active":"2024-08-17T02:47:09.480468+0000","last_peered":"2024-08-17T02:47:09.480468+0000","last_clean":"2024-08-17T02:47:09.480468+0000","last_became_active":"2024-08-17T02:47:09.474371+0000","last_became_peered":"2024-08-17T02:47:09.474371+0000","last_unstale":"2024-08-17T02:47:09.480468+0000","last_undegraded":"2024-08-17T02:47:09.480468+0000","last_fullsized":"2024-08-17T02:47:09.480468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:07:52.007878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.495845+0000","last_change":"2024-08-17T02:47:10.495845+0000","last_active":"2024-08-17T02:47:10.495845+0000","last_peered":"2024-08-17T02:47:10.495845+0000","last_clean":"2024-08-17T02:47:10.495845+0000","last_became_active":"2024-08-17T02:47:10.495537+0000","last_became_peered":"2024-08-17T02:47:10.495537+0000","last_unstale":"2024-08-17T02:47:10.495845+0000","last_undegraded":"2024-08-17T02:47:10.495845+0000","last_fullsized":"2024-08-17T02:47:10.495845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:19.220840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.482415+0000","last_change":"2024-08-17T02:47:09.479723+0000","last_active":"2024-08-17T02:47:09.482415+0000","last_peered":"2024-08-17T02:47:09.482415+0000","last_clean":"2024-08-17T02:47:09.482415+0000","last_became_active":"2024-08-17T02:47:09.479449+0000","last_became_peered":"2024-08-17T02:47:09.479449+0000","last_unstale":"2024-08-17T02:47:09.482415+0000","last_undegraded":"2024-08-17T02:47:09.482415+0000","last_fullsized":"2024-08-17T02:47:09.482415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:59.214613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.475585+0000","last_change":"2024-08-17T02:47:10.475585+0000","last_active":"2024-08-17T02:47:10.475585+0000","last_peered":"2024-08-17T02:47:10.475585+0000","last_clean":"2024-08-17T02:47:10.475585+0000","last_became_active":"2024-08-17T02:47:10.475187+0000","last_became_peered":"2024-08-17T02:47:10.475187+0000","last_unstale":"2024-08-17T02:47:10.475585+0000","last_undegraded":"2024-08-17T02:47:10.475585+0000","last_fullsized":"2024-08-17T02:47:10.475585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:18:26.311547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.483132+0000","last_change":"2024-08-17T02:47:09.478695+0000","last_active":"2024-08-17T02:47:09.483132+0000","last_peered":"2024-08-17T02:47:09.483132+0000","last_clean":"2024-08-17T02:47:09.483132+0000","last_became_active":"2024-08-17T02:47:09.478408+0000","last_became_peered":"2024-08-17T02:47:09.478408+0000","last_unstale":"2024-08-17T02:47:09.483132+0000","last_undegraded":"2024-08-17T02:47:09.483132+0000","last_fullsized":"2024-08-17T02:47:09.483132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:10:28.383182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.478047+0000","last_change":"2024-08-17T02:47:10.478047+0000","last_active":"2024-08-17T02:47:10.478047+0000","last_peered":"2024-08-17T02:47:10.478047+0000","last_clean":"2024-08-17T02:47:10.478047+0000","last_became_active":"2024-08-17T02:47:10.477800+0000","last_became_peered":"2024-08-17T02:47:10.477800+0000","last_unstale":"2024-08-17T02:47:10.478047+0000","last_undegraded":"2024-08-17T02:47:10.478047+0000","last_fullsized":"2024-08-17T02:47:10.478047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:54.914854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.482971+0000","last_change":"2024-08-17T02:47:09.477370+0000","last_active":"2024-08-17T02:47:09.482971+0000","last_peered":"2024-08-17T02:47:09.482971+0000","last_clean":"2024-08-17T02:47:09.482971+0000","last_became_active":"2024-08-17T02:47:09.476851+0000","last_became_peered":"2024-08-17T02:47:09.476851+0000","last_unstale":"2024-08-17T02:47:09.482971+0000","last_undegraded":"2024-08-17T02:47:09.482971+0000","last_fullsized":"2024-08-17T02:47:09.482971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:51.055427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.491175+0000","last_change":"2024-08-17T02:47:10.491175+0000","last_active":"2024-08-17T02:47:10.491175+0000","last_peered":"2024-08-17T02:47:10.491175+0000","last_clean":"2024-08-17T02:47:10.491175+0000","last_became_active":"2024-08-17T02:47:10.490889+0000","last_became_peered":"2024-08-17T02:47:10.490889+0000","last_unstale":"2024-08-17T02:47:10.491175+0000","last_undegraded":"2024-08-17T02:47:10.491175+0000","last_fullsized":"2024-08-17T02:47:10.491175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:02.196280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.487023+0000","last_change":"2024-08-17T02:47:09.481920+0000","last_active":"2024-08-17T02:47:09.487023+0000","last_peered":"2024-08-17T02:47:09.487023+0000","last_clean":"2024-08-17T02:47:09.487023+0000","last_became_active":"2024-08-17T02:47:09.481652+0000","last_became_peered":"2024-08-17T02:47:09.481652+0000","last_unstale":"2024-08-17T02:47:09.487023+0000","last_undegraded":"2024-08-17T02:47:09.487023+0000","last_fullsized":"2024-08-17T02:47:09.487023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:24.778055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.499033+0000","last_change":"2024-08-17T02:47:10.499033+0000","last_active":"2024-08-17T02:47:10.499033+0000","last_peered":"2024-08-17T02:47:10.499033+0000","last_clean":"2024-08-17T02:47:10.499033+0000","last_became_active":"2024-08-17T02:47:10.498813+0000","last_became_peered":"2024-08-17T02:47:10.498813+0000","last_unstale":"2024-08-17T02:47:10.499033+0000","last_undegraded":"2024-08-17T02:47:10.499033+0000","last_fullsized":"2024-08-17T02:47:10.499033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:19.220840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.488749+0000","last_change":"2024-08-17T02:47:09.486679+0000","last_active":"2024-08-17T02:47:09.488749+0000","last_peered":"2024-08-17T02:47:09.488749+0000","last_clean":"2024-08-17T02:47:09.488749+0000","last_became_active":"2024-08-17T02:47:09.486314+0000","last_became_peered":"2024-08-17T02:47:09.486314+0000","last_unstale":"2024-08-17T02:47:09.488749+0000","last_undegraded":"2024-08-17T02:47:09.488749+0000","last_fullsized":"2024-08-17T02:47:09.488749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:52:01.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:47:10.493099+0000","last_change":"2024-08-17T02:47:10.493099+0000","last_active":"2024-08-17T02:47:10.493099+0000","last_peered":"2024-08-17T02:47:10.493099+0000","last_clean":"2024-08-17T02:47:10.493099+0000","last_became_active":"2024-08-17T02:47:10.492701+0000","last_became_peered":"2024-08-17T02:47:10.492701+0000","last_unstale":"2024-08-17T02:47:10.493099+0000","last_undegraded":"2024-08-17T02:47:10.493099+0000","last_fullsized":"2024-08-17T02:47:10.493099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:09.453228+0000","last_clean_scrub_stamp":"2024-08-17T02:47:09.453228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:59:16.317027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.479442+0000","last_change":"2024-08-17T02:47:09.476112+0000","last_active":"2024-08-17T02:47:09.479442+0000","last_peered":"2024-08-17T02:47:09.479442+0000","last_clean":"2024-08-17T02:47:09.479442+0000","last_became_active":"2024-08-17T02:47:09.475729+0000","last_became_peered":"2024-08-17T02:47:09.475729+0000","last_unstale":"2024-08-17T02:47:09.479442+0000","last_undegraded":"2024-08-17T02:47:09.479442+0000","last_fullsized":"2024-08-17T02:47:09.479442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:47:08.446865+0000","last_clean_scrub_stamp":"2024-08-17T02:47:08.446865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:00:38.746983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:47:09.482553+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:47:09.482553+0000","last_peered":"2024-08-17T02:47:09.482553+0000","last_clean":"2024-08-17T02:47:09.482553+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:47:09.482553+0000","last_undegraded":"2024-08-17T02:47:09.482553+0000","last_fullsized":"2024-08-17T02:47:09.482553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":958464,"data_stored":727846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.501},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.81399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.78700000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.48599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":348160,"data_stored":130625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.505},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.624},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69399999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.66800000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.71299999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.746}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":368640,"data_stored":138048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71899999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.495},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:47:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.61899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":348160,"data_stored":130625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":2.8780000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":2.4470000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":2.3540000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":6.859}]},{"osd":2,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":8.3379999999999992},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":5.2969999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.7149999999999999,"5min":3.7149999999999999,"15min":3.7149999999999999},"last":2.403},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":8.2899999999999991}]},{"osd":5,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":6.0640000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":3.7629999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":5.2169999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:47:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":2.484},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":12.157999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":138962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":137458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":6.0810000000000004,"5min":6.0810000000000004,"15min":6.0810000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.61199999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.9740000000000002,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.378},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":6.1120000000000001,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":6.0499999999999998,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.75},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":6.3200000000000003,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.3899999999999997,"5min":6.3899999999999997,"15min":6.3899999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":6.0190000000000001,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":138962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6240000000000001,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":5.2789999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.501}]},{"osd":4,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.673,"5min":3.673,"15min":3.673},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.73099999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.75},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":5.3079999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":954368,"data_stored":727756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.76800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84499999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.75}]},{"osd":6,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.62},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.92900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:47:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:47:15.105 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:47:15.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:47:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.298+0000 7fa90d400640 1 Processor -- start 2024-08-17T02:47:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.298+0000 7fa90d400640 1 -- start start 2024-08-17T02:47:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.299+0000 7fa90d400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080add30 0x7fa908156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.299+0000 7fa90d400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080cb160 con 0x7fa9080ad960 2024-08-17T02:47:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.299+0000 7fa90d400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080b0d10 con 0x7fa9080ca050 2024-08-17T02:47:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.299+0000 7fa90d400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080ca550 con 0x7fa9080add30 2024-08-17T02:47:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.299+0000 7fa906800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa9080ad960 0x7fa908156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57630/0 (socket says 172.21.15.2:57630) 2024-08-17T02:47:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.299+0000 7fa906800640 1 -- 172.21.15.2:0/1185864276 learned_addr learned my addr 172.21.15.2:0/1185864276 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:15.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.300+0000 7fa907200640 1 --2- 172.21.15.2:0/1185864276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080add30 0x7fa908156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.300+0000 7fa905e00640 1 -- 172.21.15.2:0/1185864276 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863537929 0 0) 0x7fa9080cb160 con 0x7fa9080ad960 2024-08-17T02:47:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.300+0000 7fa905e00640 1 -- 172.21.15.2:0/1185864276 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ec0034e0 con 0x7fa9080ad960 2024-08-17T02:47:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.300+0000 7fa905e00640 1 -- 172.21.15.2:0/1185864276 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502753157 0 0) 0x7fa9080b0d10 con 0x7fa9080ca050 2024-08-17T02:47:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.300+0000 7fa905e00640 1 -- 172.21.15.2:0/1185864276 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9080cb160 con 0x7fa9080ca050 2024-08-17T02:47:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.300+0000 7fa907200640 1 -- 172.21.15.2:0/1185864276 >> v1:172.21.15.26:6789/0 conn(0x7fa9080ca050 legacy=0x7fa9080aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.300+0000 7fa907200640 1 -- 172.21.15.2:0/1185864276 >> v1:172.21.15.2:6789/0 conn(0x7fa9080ad960 legacy=0x7fa908156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.300+0000 7fa907200640 1 -- 172.21.15.2:0/1185864276 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080ca830 con 0x7fa9080add30 2024-08-17T02:47:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.301+0000 7fa907200640 1 --2- 172.21.15.2:0/1185864276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080add30 0x7fa908156b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa900009e90 tx=0x7fa900009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb3566ac5134144 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.301+0000 7fa905e00640 1 -- 172.21.15.2:0/1185864276 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900032420 con 0x7fa9080add30 2024-08-17T02:47:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa905e00640 1 -- 172.21.15.2:0/1185864276 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa900032580 con 0x7fa9080add30 2024-08-17T02:47:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa905e00640 1 -- 172.21.15.2:0/1185864276 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900032920 con 0x7fa9080add30 2024-08-17T02:47:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa90d400640 1 -- 172.21.15.2:0/1185864276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080add30 msgr2=0x7fa908156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa90d400640 1 --2- 172.21.15.2:0/1185864276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080add30 0x7fa908156b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa900009e90 tx=0x7fa900009780 comp rx=0 tx=0).stop 2024-08-17T02:47:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa90d400640 1 -- 172.21.15.2:0/1185864276 shutdown_connections 2024-08-17T02:47:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa90d400640 1 --2- 172.21.15.2:0/1185864276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080add30 0x7fa908156b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa90d400640 1 -- 172.21.15.2:0/1185864276 >> 172.21.15.2:0/1185864276 conn(0x7fa908066e60 msgr2=0x7fa908067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa90d400640 1 -- 172.21.15.2:0/1185864276 shutdown_connections 2024-08-17T02:47:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.302+0000 7fa90d400640 1 -- 172.21.15.2:0/1185864276 wait complete. 2024-08-17T02:47:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.303+0000 7fa90d400640 1 Processor -- start 2024-08-17T02:47:15.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.304+0000 7fa90d400640 1 -- start start 2024-08-17T02:47:15.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.304+0000 7fa90d400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080ad960 0x7fa908148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.304+0000 7fa90d400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9080add30 0x7fa9080a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.304+0000 7fa90d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9080ca050 0x7fa908168a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.304+0000 7fa90d400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080a8f10 con 0x7fa9080ca050 2024-08-17T02:47:15.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.304+0000 7fa90d400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080a88e0 con 0x7fa9080add30 2024-08-17T02:47:15.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.304+0000 7fa90d400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908169570 con 0x7fa9080ad960 2024-08-17T02:47:15.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa907200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9080ca050 0x7fa908168a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa907200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9080ca050 0x7fa908168a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47830/0 (socket says 172.21.15.2:47830) 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa907200640 1 -- 172.21.15.2:0/2174284205 learned_addr learned my addr 172.21.15.2:0/2174284205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa906800640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080ad960 0x7fa908148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa8ffe00640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9080add30 0x7fa9080a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa907200640 1 -- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080ad960 msgr2=0x7fa908148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa907200640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080ad960 0x7fa908148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa907200640 1 -- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9080add30 msgr2=0x7fa9080a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa907200640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9080add30 0x7fa9080a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa907200640 1 -- 172.21.15.2:0/2174284205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900009a20 con 0x7fa9080ca050 2024-08-17T02:47:15.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.305+0000 7fa906800640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080ad960 0x7fa908148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:15.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.306+0000 7fa907200640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9080ca050 0x7fa908168a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9000099f0 tx=0x7fa900038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.306+0000 7fa8fe000640 1 -- 172.21.15.2:0/2174284205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900031870 con 0x7fa9080ca050 2024-08-17T02:47:15.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.306+0000 7fa8fe000640 1 -- 172.21.15.2:0/2174284205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa900041070 con 0x7fa9080ca050 2024-08-17T02:47:15.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.306+0000 7fa8fe000640 1 -- 172.21.15.2:0/2174284205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900031c00 con 0x7fa9080ca050 2024-08-17T02:47:15.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.306+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa908169850 con 0x7fa9080ca050 2024-08-17T02:47:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.306+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa908148980 con 0x7fa9080ca050 2024-08-17T02:47:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.307+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9081699e0 con 0x7fa9080ca050 2024-08-17T02:47:15.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.308+0000 7fa8fe000640 1 -- 172.21.15.2:0/2174284205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa900043030 con 0x7fa9080ca050 2024-08-17T02:47:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.309+0000 7fa8fe000640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa8e4065150 0x7fa8e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.309+0000 7fa8fe000640 1 -- 172.21.15.2:0/2174284205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9000a3b20 con 0x7fa9080ca050 2024-08-17T02:47:15.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.309+0000 7fa906800640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa8e4065150 0x7fa8e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.310+0000 7fa906800640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa8e4065150 0x7fa8e4067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8005840 tx=0x7fa8f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.313+0000 7fa8fe000640 1 -- 172.21.15.2:0/2174284205 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa900071c00 con 0x7fa9080ca050 2024-08-17T02:47:15.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.565+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa908063fb0 con 0x7fa9080ca050 2024-08-17T02:47:15.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.569+0000 7fa8fe000640 1 -- 172.21.15.2:0/2174284205 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa900075220 con 0x7fa9080ca050 2024-08-17T02:47:15.569 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2024-08-17T02:47:15.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa8e4065150 msgr2=0x7fa8e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa8e4065150 0x7fa8e4067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8005840 tx=0x7fa8f8009040 comp rx=0 tx=0).stop 2024-08-17T02:47:15.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9080ca050 msgr2=0x7fa908168a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9080ca050 0x7fa908168a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa9000099f0 tx=0x7fa900038000 comp rx=0 tx=0).stop 2024-08-17T02:47:15.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 shutdown_connections 2024-08-17T02:47:15.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9080ca050 0x7fa908168a40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9080add30 0x7fa9080a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa8e4065150 0x7fa8e4067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 --2- 172.21.15.2:0/2174284205 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa9080ad960 0x7fa908148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 >> 172.21.15.2:0/2174284205 conn(0x7fa908066e60 msgr2=0x7fa9081527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 shutdown_connections 2024-08-17T02:47:15.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.571+0000 7fa90d400640 1 -- 172.21.15.2:0/2174284205 wait complete. 2024-08-17T02:47:15.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:47:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.738+0000 7f9429a00640 1 Processor -- start 2024-08-17T02:47:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.738+0000 7f9429a00640 1 -- start start 2024-08-17T02:47:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.739+0000 7f9429a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9424156870 0x7f94240caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.739+0000 7f9429a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9424157ab0 con 0x7f94240b12f0 2024-08-17T02:47:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.739+0000 7f9429a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94240ae440 con 0x7f9424156c40 2024-08-17T02:47:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.739+0000 7f9429a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94240cb5d0 con 0x7f9424156870 2024-08-17T02:47:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9423400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f94240b12f0 0x7f9424157f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57640/0 (socket says 172.21.15.2:57640) 2024-08-17T02:47:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9423400640 1 -- 172.21.15.2:0/1874274998 learned_addr learned my addr 172.21.15.2:0/1874274998 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9422a00640 1 --2- 172.21.15.2:0/1874274998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9424156870 0x7f94240caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9421600640 1 -- 172.21.15.2:0/1874274998 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667751443 0 0) 0x7f9424157ab0 con 0x7f94240b12f0 2024-08-17T02:47:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9421600640 1 -- 172.21.15.2:0/1874274998 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94080034e0 con 0x7f94240b12f0 2024-08-17T02:47:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9421600640 1 -- 172.21.15.2:0/1874274998 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410716723 0 0) 0x7f94240ae440 con 0x7f9424156c40 2024-08-17T02:47:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9421600640 1 -- 172.21.15.2:0/1874274998 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9424157ab0 con 0x7f9424156c40 2024-08-17T02:47:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9421600640 1 -- 172.21.15.2:0/1874274998 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290090512 0 0) 0x7f94080034e0 con 0x7f94240b12f0 2024-08-17T02:47:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9422a00640 1 -- 172.21.15.2:0/1874274998 >> v1:172.21.15.26:6789/0 conn(0x7f9424156c40 legacy=0x7f94240b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9422a00640 1 -- 172.21.15.2:0/1874274998 >> v1:172.21.15.2:6789/0 conn(0x7f94240b12f0 legacy=0x7f9424157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.740+0000 7f9422a00640 1 -- 172.21.15.2:0/1874274998 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9424157180 con 0x7f9424156870 2024-08-17T02:47:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9422a00640 1 --2- 172.21.15.2:0/1874274998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9424156870 0x7f94240caa10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9414009880 tx=0x7f94140090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0664b11d5fff3a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9421600640 1 -- 172.21.15.2:0/1874274998 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0017f0 con 0x7f9424156870 2024-08-17T02:47:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9421600640 1 -- 172.21.15.2:0/1874274998 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941402aac0 con 0x7f9424156870 2024-08-17T02:47:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9421600640 1 -- 172.21.15.2:0/1874274998 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941402ae60 con 0x7f9424156870 2024-08-17T02:47:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9429a00640 1 -- 172.21.15.2:0/1874274998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9424156870 msgr2=0x7f94240caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9429a00640 1 --2- 172.21.15.2:0/1874274998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9424156870 0x7f94240caa10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9414009880 tx=0x7f94140090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9429a00640 1 -- 172.21.15.2:0/1874274998 shutdown_connections 2024-08-17T02:47:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9429a00640 1 --2- 172.21.15.2:0/1874274998 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9424156870 0x7f94240caa10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.742+0000 7f9429a00640 1 -- 172.21.15.2:0/1874274998 >> 172.21.15.2:0/1874274998 conn(0x7f9424066e60 msgr2=0x7f9424067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.743+0000 7f9429a00640 1 -- 172.21.15.2:0/1874274998 shutdown_connections 2024-08-17T02:47:15.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.743+0000 7f9429a00640 1 -- 172.21.15.2:0/1874274998 wait complete. 2024-08-17T02:47:15.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.744+0000 7f9429a00640 1 Processor -- start 2024-08-17T02:47:15.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.744+0000 7f9429a00640 1 -- start start 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9429a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94240b12f0 0x7f9424157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9429a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9424156870 0x7f94241513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9429a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9424156c40 0x7f942415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9429a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241590a0 con 0x7f9424156870 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9429a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241695a0 con 0x7f9424156c40 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9429a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9424158520 con 0x7f94240b12f0 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9422000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9424156870 0x7f94241513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9422000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9424156870 0x7f94241513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47844/0 (socket says 172.21.15.2:47844) 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9422000640 1 -- 172.21.15.2:0/407661194 learned_addr learned my addr 172.21.15.2:0/407661194 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9423400640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9424156c40 0x7f942415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.745+0000 7f9422a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94240b12f0 0x7f9424157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9422000640 1 -- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94240b12f0 msgr2=0x7f9424157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9422000640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94240b12f0 0x7f9424157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9422000640 1 -- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9424156c40 msgr2=0x7f942415a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9422000640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9424156c40 0x7f942415a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9422000640 1 -- 172.21.15.2:0/407661194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009390 con 0x7f9424156870 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9423400640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9424156c40 0x7f942415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9422000640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9424156870 0x7f94241513e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f941000c4e0 tx=0x7f9410007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f941a000640 1 -- 172.21.15.2:0/407661194 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410016070 con 0x7f9424156870 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f941a000640 1 -- 172.21.15.2:0/407661194 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9410011590 con 0x7f9424156870 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f941a000640 1 -- 172.21.15.2:0/407661194 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410011990 con 0x7f9424156870 2024-08-17T02:47:15.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9424158800 con 0x7f9424156870 2024-08-17T02:47:15.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.746+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9424158dc0 con 0x7f9424156870 2024-08-17T02:47:15.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.747+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9424063fb0 con 0x7f9424156870 2024-08-17T02:47:15.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.748+0000 7f941a000640 1 -- 172.21.15.2:0/407661194 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9410012420 con 0x7f9424156870 2024-08-17T02:47:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.749+0000 7f941a000640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9404065150 0x7f9404067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.749+0000 7f941a000640 1 -- 172.21.15.2:0/407661194 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9410081fd0 con 0x7f9424156870 2024-08-17T02:47:15.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.749+0000 7f9422a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9404065150 0x7f9404067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:15.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.750+0000 7f9422a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9404065150 0x7f9404067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9414034000 tx=0x7f9414032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:15.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.753+0000 7f941a000640 1 -- 172.21.15.2:0/407661194 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f941004fff0 con 0x7f9424156870 2024-08-17T02:47:15.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.977+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94241522d0 con 0x7f9424156870 2024-08-17T02:47:15.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.978+0000 7f941a000640 1 -- 172.21.15.2:0/407661194 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4591 (secure 0 0 0) 0x7f9410053610 con 0x7f9424156870 2024-08-17T02:47:15.979 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:15.979 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4953,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:09.888633+0000","modified":"2024-08-17T02:47:13.482114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.2:6837/1889487336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1889487336},{"type":"v1","addr":"172.21.15.2:6837","nonce":1889487336}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:47:15.979 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-08-17T02:47:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9404065150 msgr2=0x7f9404067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9404065150 0x7f9404067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9414034000 tx=0x7f9414032000 comp rx=0 tx=0).stop 2024-08-17T02:47:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9424156870 msgr2=0x7f94241513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9424156870 0x7f94241513e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f941000c4e0 tx=0x7f9410007d80 comp rx=0 tx=0).stop 2024-08-17T02:47:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 shutdown_connections 2024-08-17T02:47:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9424156c40 0x7f942415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9424156870 0x7f94241513e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9404065150 0x7f9404067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 --2- 172.21.15.2:0/407661194 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94240b12f0 0x7f9424157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 >> 172.21.15.2:0/407661194 conn(0x7f9424066e60 msgr2=0x7f9424067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 shutdown_connections 2024-08-17T02:47:15.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:15.980+0000 7f9429a00640 1 -- 172.21.15.2:0/407661194 wait complete. 2024-08-17T02:47:16.399 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:47:09.888633+0000', 'modified': '2024-08-17T02:47:13.482114+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4956}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4956': {'gid': 4956, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.2:6837/1889487336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6835', 'nonce': 1889487336}, {'type': 'v1', 'addr': '172.21.15.2:6837', 'nonce': 1889487336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:47:16.399 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:47:16.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:47:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.551+0000 7f084ae00640 1 Processor -- start 2024-08-17T02:47:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.551+0000 7f084ae00640 1 -- start start 2024-08-17T02:47:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.552+0000 7f084ae00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f08440afca0 0x7f08440b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.552+0000 7f084ae00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440acf10 0x7f0844159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.552+0000 7f084ae00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084415a4e0 con 0x7f08441589a0 2024-08-17T02:47:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.552+0000 7f084ae00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08440b0980 con 0x7f08440afca0 2024-08-17T02:47:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.552+0000 7f084ae00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440c92b0 con 0x7f08440acf10 2024-08-17T02:47:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0848e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f08441589a0 0x7f084406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57656/0 (socket says 172.21.15.2:57656) 2024-08-17T02:47:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0848e00640 1 -- 172.21.15.2:0/1068665033 learned_addr learned my addr 172.21.15.2:0/1068665033 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0843400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440acf10 0x7f0844159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0843e00640 1 --2- 172.21.15.2:0/1068665033 >> v2:172.21.15.26:3300/0 conn(0x7f08440afca0 0x7f08440b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0842a00640 1 -- 172.21.15.2:0/1068665033 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308317837 0 0) 0x7f083c001490 con 0x7f08441589a0 2024-08-17T02:47:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0842a00640 1 -- 172.21.15.2:0/1068665033 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08280034e0 con 0x7f08441589a0 2024-08-17T02:47:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0843400640 1 -- 172.21.15.2:0/1068665033 >> v2:172.21.15.26:3300/0 conn(0x7f08440afca0 msgr2=0x7f08440b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0843400640 1 --2- 172.21.15.2:0/1068665033 >> v2:172.21.15.26:3300/0 conn(0x7f08440afca0 0x7f08440b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0843400640 1 -- 172.21.15.2:0/1068665033 >> v1:172.21.15.2:6789/0 conn(0x7f08441589a0 legacy=0x7f084406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0843400640 1 -- 172.21.15.2:0/1068665033 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440ad480 con 0x7f08440acf10 2024-08-17T02:47:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.553+0000 7f0843e00640 1 --2- 172.21.15.2:0/1068665033 >> v2:172.21.15.26:3300/0 conn(0x7f08440afca0 0x7f08440b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.554+0000 7f0843400640 1 --2- 172.21.15.2:0/1068665033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440acf10 0x7f0844159fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0830009880 tx=0x7f08300090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=958df1565d896b74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f0842a00640 1 -- 172.21.15.2:0/1068665033 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083002ad70 con 0x7f08440acf10 2024-08-17T02:47:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f0842a00640 1 -- 172.21.15.2:0/1068665033 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830032440 con 0x7f08440acf10 2024-08-17T02:47:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f0842a00640 1 -- 172.21.15.2:0/1068665033 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830032820 con 0x7f08440acf10 2024-08-17T02:47:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f084ae00640 1 -- 172.21.15.2:0/1068665033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440acf10 msgr2=0x7f0844159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f084ae00640 1 --2- 172.21.15.2:0/1068665033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440acf10 0x7f0844159fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0830009880 tx=0x7f08300090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f084ae00640 1 -- 172.21.15.2:0/1068665033 shutdown_connections 2024-08-17T02:47:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f084ae00640 1 --2- 172.21.15.2:0/1068665033 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440acf10 0x7f0844159fa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f084ae00640 1 --2- 172.21.15.2:0/1068665033 >> v2:172.21.15.26:3300/0 conn(0x7f08440afca0 0x7f08440b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.555+0000 7f084ae00640 1 -- 172.21.15.2:0/1068665033 >> 172.21.15.2:0/1068665033 conn(0x7f0844066e60 msgr2=0x7f0844067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.556+0000 7f084ae00640 1 -- 172.21.15.2:0/1068665033 shutdown_connections 2024-08-17T02:47:16.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.556+0000 7f084ae00640 1 -- 172.21.15.2:0/1068665033 wait complete. 2024-08-17T02:47:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.557+0000 7f084ae00640 1 Processor -- start 2024-08-17T02:47:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.557+0000 7f084ae00640 1 -- start start 2024-08-17T02:47:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f084ae00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08440acf10 0x7f08440c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f084ae00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440afca0 0x7f08441560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f084ae00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08441589a0 0x7f0844168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f084ae00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844156600 con 0x7f08440acf10 2024-08-17T02:47:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f084ae00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08440c51d0 con 0x7f08441589a0 2024-08-17T02:47:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f084ae00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440c54b0 con 0x7f08440afca0 2024-08-17T02:47:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f0843e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08440acf10 0x7f08440c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f0843e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08440acf10 0x7f08440c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47854/0 (socket says 172.21.15.2:47854) 2024-08-17T02:47:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f0843e00640 1 -- 172.21.15.2:0/524954494 learned_addr learned my addr 172.21.15.2:0/524954494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f0843400640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440afca0 0x7f08441560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.558+0000 7f0848e00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08441589a0 0x7f0844168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f0843e00640 1 -- 172.21.15.2:0/524954494 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440afca0 msgr2=0x7f08441560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f0843e00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440afca0 0x7f08441560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f0843e00640 1 -- 172.21.15.2:0/524954494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08441589a0 msgr2=0x7f0844168dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f0843e00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08441589a0 0x7f0844168dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f0843e00640 1 -- 172.21.15.2:0/524954494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009390 con 0x7f08440acf10 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f0843e00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08440acf10 0x7f08440c4bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f083400ec80 tx=0x7f08340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f083b400640 1 -- 172.21.15.2:0/524954494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400eec0 con 0x7f08440acf10 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f083b400640 1 -- 172.21.15.2:0/524954494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083400cbc0 con 0x7f08440acf10 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f083b400640 1 -- 172.21.15.2:0/524954494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834013470 con 0x7f08440acf10 2024-08-17T02:47:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f084ae00640 1 -- 172.21.15.2:0/524954494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0830009390 con 0x7f08440acf10 2024-08-17T02:47:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.559+0000 7f084ae00640 1 -- 172.21.15.2:0/524954494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08440c5a70 con 0x7f08440acf10 2024-08-17T02:47:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.561+0000 7f083b400640 1 -- 172.21.15.2:0/524954494 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08340137e0 con 0x7f08440acf10 2024-08-17T02:47:16.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.563+0000 7f083b400640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0824065150 0x7f0824067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.563+0000 7f083b400640 1 -- 172.21.15.2:0/524954494 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08340828f0 con 0x7f08440acf10 2024-08-17T02:47:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.563+0000 7f0843400640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0824065150 0x7f0824067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.563+0000 7f084d3c7740 1 Processor -- start 2024-08-17T02:47:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.563+0000 7f084d3c7740 1 -- start start 2024-08-17T02:47:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.564+0000 7f0843400640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0824065150 0x7f0824067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0830034000 tx=0x7f0830032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.564+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957a2c70 0x55f3957a3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.564+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.564+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 0x55f395777b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.564+0000 7f084d3c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f395738240 con 0x55f39577e2e0 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.564+0000 7f084d3c7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3956e19e0 con 0x55f3957a2c70 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.564+0000 7f084d3c7740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3956df170 con 0x55f3957c0d50 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47870/0 (socket says 172.21.15.2:47870) 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 -- 172.21.15.2:0/585679450 learned_addr learned my addr 172.21.15.2:0/585679450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 -- 172.21.15.2:0/585679450 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 msgr2=0x55f395777b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 --2- 172.21.15.2:0/585679450 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 0x55f395777b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 -- 172.21.15.2:0/585679450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957a2c70 msgr2=0x55f3957a3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 --2- 172.21.15.2:0/585679450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957a2c70 0x55f3957a3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 -- 172.21.15.2:0/585679450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f39568e820 con 0x55f39577e2e0 2024-08-17T02:47:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f0843400640 1 --2- 172.21.15.2:0/585679450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c0810 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f08300098b0 tx=0x7f083003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5746415fadc465df server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.565+0000 7f082fe00640 1 -- 172.21.15.2:0/585679450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08300328a0 con 0x55f39577e2e0 2024-08-17T02:47:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f082fe00640 1 -- 172.21.15.2:0/585679450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083003c9f0 con 0x55f39577e2e0 2024-08-17T02:47:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f082fe00640 1 -- 172.21.15.2:0/585679450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083003cd90 con 0x55f39577e2e0 2024-08-17T02:47:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 -- 172.21.15.2:0/585679450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 msgr2=0x55f3957c0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 --2- 172.21.15.2:0/585679450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c0810 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f08300098b0 tx=0x7f083003c000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 -- 172.21.15.2:0/585679450 shutdown_connections 2024-08-17T02:47:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 --2- 172.21.15.2:0/585679450 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 0x55f395777b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 --2- 172.21.15.2:0/585679450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c0810 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 --2- 172.21.15.2:0/585679450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957a2c70 0x55f3957a3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 -- 172.21.15.2:0/585679450 >> 172.21.15.2:0/585679450 conn(0x55f395715a80 msgr2=0x55f3957c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 -- 172.21.15.2:0/585679450 shutdown_connections 2024-08-17T02:47:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.566+0000 7f084d3c7740 1 -- 172.21.15.2:0/585679450 wait complete. 2024-08-17T02:47:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.567+0000 7f084d3c7740 1 -- start start 2024-08-17T02:47:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.567+0000 7f084d3c7740 1 Processor -- start 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f39577e2e0 0x55f3957a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3957a2c70 0x55f39579e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 0x55f395777950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f084d3c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3956daf60 con 0x55f3957a2c70 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f084d3c7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f395683690 con 0x55f39577e2e0 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f084d3c7740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f395683330 con 0x55f3957c0d50 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f084d3c7740 10 client.0 _ll_register_callbacks cb 0x55f39568ccc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f0843400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3957a2c70 0x55f39579e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f0843400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3957a2c70 0x55f39579e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47886/0 (socket says 172.21.15.2:47886) 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f0843400640 1 -- 172.21.15.2:0/1545784406 learned_addr learned my addr 172.21.15.2:0/1545784406 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f0848e00640 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 0x55f395777950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.568+0000 7f0843e00640 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f39577e2e0 0x55f3957a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f0843400640 1 -- 172.21.15.2:0/1545784406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 msgr2=0x55f395777950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f0843400640 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 0x55f395777950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f0843400640 1 -- 172.21.15.2:0/1545784406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f39577e2e0 msgr2=0x55f3957a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f0843400640 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f39577e2e0 0x55f3957a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f0843400640 1 -- 172.21.15.2:0/1545784406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08440ad480 con 0x55f3957a2c70 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f0843400640 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3957a2c70 0x55f39579e260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f083004a040 tx=0x7f0830045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f893540d3eea78 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f082cc00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f082cc00640 1 -- 172.21.15.2:0/1545784406 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083003ce40 con 0x55f3957a2c70 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f082cc00640 1 -- 172.21.15.2:0/1545784406 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0830042040 con 0x55f3957a2c70 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.569+0000 7f084d3c7740 1 -- 172.21.15.2:0/1545784406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f39570e770 con 0x55f3957a2c70 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f082cc00640 1 -- 172.21.15.2:0/1545784406 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08300478a0 con 0x55f3957a2c70 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f084d3c7740 10 client.5127 fetch_fsmap learned FSMap version 17 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f084d3c7740 1 -- 172.21.15.2:0/1545784406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f3956a4ab0 con 0x55f3957a2c70 2024-08-17T02:47:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f082cc00640 1 -- 172.21.15.2:0/1545784406 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f39570e770 con 0x55f3957a2c70 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f082cc00640 1 -- 172.21.15.2:0/1545784406 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0830047a00 con 0x55f3957a2c70 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f084d3c7740 10 client.5127 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f084d3c7740 10 client.5127 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f084d3c7740 20 client.5127 populate_metadata read hostname 'smithi002' 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] conn(0x55f39579f850 0x55f39579fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f084d3c7740 4 client.5127 mds_command: new command op to 4956 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f084d3c7740 1 -- 172.21.15.2:0/1545784406 --> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3953e23c0 con 0x55f39579f850 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.570+0000 7f0843e00640 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] conn(0x55f39579f850 0x55f39579fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.571+0000 7f0843e00640 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] conn(0x55f39579f850 0x55f39579fc20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1837a2197a550c server_cookie=76263a61b6eec7c4 in_seq=0 out_seq=0 2024-08-17T02:47:16.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.571+0000 7f082cc00640 10 client.5127 ms_handle_connect on v2:172.21.15.2:6835/1889487336 2024-08-17T02:47:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.571+0000 7f082cc00640 1 -- 172.21.15.2:0/1545784406 <== mds.0 v2:172.21.15.2:6835/1889487336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55f3953e23c0 con 0x55f39579f850 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.571+0000 7f082cc00640 10 client.5127 handle_command_reply: tid=0 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 client.5127 shutdown 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 -- 172.21.15.2:0/1545784406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3957a2c70 msgr2=0x55f39579e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3957a2c70 0x55f39579e260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f083004a040 tx=0x7f0830045000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 -- 172.21.15.2:0/1545784406 shutdown_connections 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] conn(0x55f39579f850 0x55f39579fc20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957c0d50 0x55f395777950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f3957a2c70 0x55f39579e260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1545784406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f39577e2e0 0x55f3957a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f082cc00640 0 client.5127 ms_handle_reset on v2:172.21.15.2:6835/1889487336 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 -- 172.21.15.2:0/1545784406 >> 172.21.15.2:0/1545784406 conn(0x55f395715a80 msgr2=0x55f395776810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 -- 172.21.15.2:0/1545784406 shutdown_connections 2024-08-17T02:47:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 1 -- 172.21.15.2:0/1545784406 wait complete. 2024-08-17T02:47:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.572+0000 7f084d3c7740 20 client.5127 trim_cache size 0 max 16384 2024-08-17T02:47:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.588+0000 7f084d3c7740 1 Processor -- start 2024-08-17T02:47:16.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.588+0000 7f084d3c7740 1 -- start start 2024-08-17T02:47:16.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 0x55f3957c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 0x55f3957c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f084d3c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f395455f20 con 0x55f39577e2e0 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f084d3c7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f39577d8b0 con 0x55f3957c0d50 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f084d3c7740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f39577ce70 con 0x55f3957a2c70 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f0843e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f0843e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957d3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47894/0 (socket says 172.21.15.2:47894) 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f0843e00640 1 -- 172.21.15.2:0/1826329187 learned_addr learned my addr 172.21.15.2:0/1826329187 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f0843e00640 1 -- 172.21.15.2:0/1826329187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 msgr2=0x55f3957c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f0843e00640 1 --2- 172.21.15.2:0/1826329187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 0x55f3957c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f0843e00640 1 -- 172.21.15.2:0/1826329187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 msgr2=0x55f3957c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f0843e00640 1 --2- 172.21.15.2:0/1826329187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 0x55f3957c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.589+0000 7f0843e00640 1 -- 172.21.15.2:0/1826329187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3957171c0 con 0x55f39577e2e0 2024-08-17T02:47:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f0843e00640 1 --2- 172.21.15.2:0/1826329187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957d3fe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0834054560 tx=0x7f0834080cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a42756cf963d77 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f0838c00640 1 -- 172.21.15.2:0/1826329187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083405b570 con 0x55f39577e2e0 2024-08-17T02:47:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f0838c00640 1 -- 172.21.15.2:0/1826329187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08340545d0 con 0x55f39577e2e0 2024-08-17T02:47:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f0838c00640 1 -- 172.21.15.2:0/1826329187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834080e80 con 0x55f39577e2e0 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f084d3c7740 1 -- 172.21.15.2:0/1826329187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 msgr2=0x55f3957d3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1826329187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957d3fe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0834054560 tx=0x7f0834080cd0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f084d3c7740 1 -- 172.21.15.2:0/1826329187 shutdown_connections 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1826329187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 0x55f3957c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1826329187 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 0x55f3957c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f084d3c7740 1 --2- 172.21.15.2:0/1826329187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957d3fe0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.590+0000 7f084d3c7740 1 -- 172.21.15.2:0/1826329187 >> 172.21.15.2:0/1826329187 conn(0x55f395715a80 msgr2=0x55f3957bd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.591+0000 7f084d3c7740 1 -- 172.21.15.2:0/1826329187 shutdown_connections 2024-08-17T02:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.591+0000 7f084d3c7740 1 -- 172.21.15.2:0/1826329187 wait complete. 2024-08-17T02:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.591+0000 7f084d3c7740 1 -- start start 2024-08-17T02:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.591+0000 7f084d3c7740 1 Processor -- start 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.592+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.592+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 0x55f3957da860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.592+0000 7f084d3c7740 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 0x55f3957d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.592+0000 7f084d3c7740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f39577c2e0 con 0x55f39577e2e0 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.592+0000 7f084d3c7740 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3957c4050 con 0x55f3957c0d50 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.592+0000 7f084d3c7740 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f39577bfd0 con 0x55f3957a2c70 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.592+0000 7f084d3c7740 10 client.0 _ll_register_callbacks cb 0x7f0830035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47908/0 (socket says 172.21.15.2:47908) 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 -- 172.21.15.2:0/523333516 learned_addr learned my addr 172.21.15.2:0/523333516 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843400640 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 0x55f3957da860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0848e00640 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 0x55f3957d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 -- 172.21.15.2:0/523333516 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 msgr2=0x55f3957da860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 0x55f3957da860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 -- 172.21.15.2:0/523333516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 msgr2=0x55f3957d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 0x55f3957d1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 -- 172.21.15.2:0/523333516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08440c5a70 con 0x55f39577e2e0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f0843e00640 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c3b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f08340098b0 tx=0x7f0834069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837ec1a6dfbe800d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.593+0000 7f082cc00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f082cc00640 1 -- 172.21.15.2:0/523333516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340527e0 con 0x55f39577e2e0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f082cc00640 1 -- 172.21.15.2:0/523333516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f083406f290 con 0x55f39577e2e0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 1 -- 172.21.15.2:0/523333516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f083003c9f0 con 0x55f39577e2e0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f082cc00640 1 -- 172.21.15.2:0/523333516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0834053ac0 con 0x55f39577e2e0 2024-08-17T02:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 10 client.5133 fetch_fsmap learned FSMap version 17 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 1 -- 172.21.15.2:0/523333516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f3956a8490 con 0x55f39577e2e0 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f082cc00640 1 -- 172.21.15.2:0/523333516 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083003c9f0 con 0x55f39577e2e0 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f082cc00640 1 -- 172.21.15.2:0/523333516 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0834011070 con 0x55f39577e2e0 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 10 client.5133 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 10 client.5133 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 20 client.5133 populate_metadata read hostname 'smithi002' 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] conn(0x55f395828a40 0x55f3957d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 4 client.5133 mds_command: new command op to 4956 tid=0[{"prefix": "status"}] 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f084d3c7740 1 -- 172.21.15.2:0/523333516 --> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f3953f36c0 con 0x55f395828a40 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.594+0000 7f0843400640 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] conn(0x55f395828a40 0x55f3957d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f0843400640 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] conn(0x55f395828a40 0x55f3957d1bd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=650f9c24336c035 server_cookie=1cc0bb2eef7f87bb in_seq=0 out_seq=0 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f082cc00640 10 client.5133 ms_handle_connect on v2:172.21.15.2:6835/1889487336 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f082cc00640 1 -- 172.21.15.2:0/523333516 <== mds.0 v2:172.21.15.2:6835/1889487336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f3953f36c0 con 0x55f395828a40 2024-08-17T02:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f082cc00640 10 client.5133 handle_command_reply: tid=0 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 client.5133 shutdown 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 -- 172.21.15.2:0/523333516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 msgr2=0x55f3957c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c3b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f08340098b0 tx=0x7f0834069000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 -- 172.21.15.2:0/523333516 shutdown_connections 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.2:6835/1889487336,v1:172.21.15.2:6837/1889487336] conn(0x55f395828a40 0x55f3957d1bd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f3957c0d50 0x55f3957d1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55f3957a2c70 0x55f3957da860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f082cc00640 0 client.5133 ms_handle_reset on v2:172.21.15.2:6835/1889487336 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 --2- 172.21.15.2:0/523333516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f39577e2e0 0x55f3957c3b10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.595+0000 7f084d3c7740 1 -- 172.21.15.2:0/523333516 >> 172.21.15.2:0/523333516 conn(0x55f395715a80 msgr2=0x55f395778360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084d3c7740 1 -- 172.21.15.2:0/523333516 shutdown_connections 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084d3c7740 1 -- 172.21.15.2:0/523333516 wait complete. 2024-08-17T02:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084d3c7740 20 client.5133 trim_cache size 0 max 16384 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "f19c300a-c18c-4d11-a652-563f33592040", 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4956, 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.135019979, 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 17, 2024-08-17T02:47:16.601 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 33, 2024-08-17T02:47:16.602 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 33, 2024-08-17T02:47:16.602 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 21.046073400000001 2024-08-17T02:47:16.602 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:47:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 -- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0824065150 msgr2=0x7f0824067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0824065150 0x7f0824067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0830034000 tx=0x7f0830032000 comp rx=0 tx=0).stop 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 -- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08440acf10 msgr2=0x7f08440c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08440acf10 0x7f08440c4bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f083400ec80 tx=0x7f08340090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 -- 172.21.15.2:0/524954494 shutdown_connections 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08441589a0 0x7f0844168dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f0824065150 0x7f0824067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f08440afca0 0x7f08441560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 --2- 172.21.15.2:0/524954494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08440acf10 0x7f08440c4bf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.596+0000 7f084ae00640 1 -- 172.21.15.2:0/524954494 >> 172.21.15.2:0/524954494 conn(0x7f0844066e60 msgr2=0x7f08440c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.597+0000 7f084ae00640 1 -- 172.21.15.2:0/524954494 shutdown_connections 2024-08-17T02:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.597+0000 7f084ae00640 1 -- 172.21.15.2:0/524954494 wait complete. 2024-08-17T02:47:16.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:16.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.762+0000 7f84b0c00640 1 Processor -- start 2024-08-17T02:47:16.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.762+0000 7f84b0c00640 1 -- start start 2024-08-17T02:47:16.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84b0c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac0afca0 0x7f84ac0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84b0c00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84ac1590b0 0x7f84ac159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84b0c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac15a4e0 con 0x7f84ac0acf10 2024-08-17T02:47:16.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84b0c00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac0b0980 con 0x7f84ac1590b0 2024-08-17T02:47:16.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84b0c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0c92b0 con 0x7f84ac0afca0 2024-08-17T02:47:16.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84a3e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f84ac0acf10 0x7f84ac1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57662/0 (socket says 172.21.15.2:57662) 2024-08-17T02:47:16.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84a3e00640 1 -- 172.21.15.2:0/2514119584 learned_addr learned my addr 172.21.15.2:0/2514119584 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84a9e00640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac0afca0 0x7f84ac0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84aa800640 1 --2- 172.21.15.2:0/2514119584 >> v2:172.21.15.26:3300/0 conn(0x7f84ac1590b0 0x7f84ac159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706891166 0 0) 0x7f8494001110 con 0x7f84ac0acf10 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.764+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84900034e0 con 0x7f84ac0acf10 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212800486 0 0) 0x7f84900034e0 con 0x7f84ac0acf10 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac0afca0 msgr2=0x7f84ac0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac0afca0 0x7f84ac0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 >> v2:172.21.15.26:3300/0 conn(0x7f84ac1590b0 msgr2=0x7f84ac159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 --2- 172.21.15.2:0/2514119584 >> v2:172.21.15.26:3300/0 conn(0x7f84ac1590b0 0x7f84ac159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0ad480 con 0x7f84ac0acf10 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f8494001600 con 0x7f84ac0acf10 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 >> v1:172.21.15.2:6789/0 conn(0x7f84ac0acf10 legacy=0x7f84ac1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490003a50 0x7f8490003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490004780 0x7f8490004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac0afca0 0x7f8490005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0c92b0 con 0x7f8490003a50 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849000ba00 con 0x7f8490004780 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849000bbc0 con 0x7f84ac0afca0 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a9e00640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490003a50 0x7f8490003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84a3e00640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490004780 0x7f8490004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.765+0000 7f84aa800640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac0afca0 0x7f8490005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.766+0000 7f84a9e00640 1 -- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac0afca0 msgr2=0x7f8490005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.766+0000 7f84a9e00640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac0afca0 0x7f8490005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.766+0000 7f84a9e00640 1 -- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490004780 msgr2=0x7f8490004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.766+0000 7f84a9e00640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490004780 0x7f8490004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.766+0000 7f84a9e00640 1 -- 172.21.15.2:0/2514119584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900034e0 con 0x7f8490003a50 2024-08-17T02:47:16.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84a9e00640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490003a50 0x7f8490003e60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f849c009b70 tx=0x7f849c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996e89d36a7d7a90 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c031400 con 0x7f8490003a50 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c02d050 con 0x7f8490003a50 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84a9400640 1 -- 172.21.15.2:0/2514119584 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c031790 con 0x7f8490003a50 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84b0c00640 1 -- 172.21.15.2:0/2514119584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490003a50 msgr2=0x7f8490003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84b0c00640 1 --2- 172.21.15.2:0/2514119584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8490003a50 0x7f8490003e60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f849c009b70 tx=0x7f849c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84aa800640 1 -- 172.21.15.2:0/2514119584 reap_dead start 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84b0c00640 1 -- 172.21.15.2:0/2514119584 shutdown_connections 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.767+0000 7f84b0c00640 1 -- 172.21.15.2:0/2514119584 >> 172.21.15.2:0/2514119584 conn(0x7f84ac066e60 msgr2=0x7f84ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.768+0000 7f84b0c00640 1 -- 172.21.15.2:0/2514119584 shutdown_connections 2024-08-17T02:47:16.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.768+0000 7f84b0c00640 1 -- 172.21.15.2:0/2514119584 wait complete. 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.769+0000 7f84b0c00640 1 Processor -- start 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.769+0000 7f84b0c00640 1 -- start start 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84b0c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490003a50 0x7f84ac06af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84b0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84ac06b490 0x7f84ac155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84b0c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac156000 0x7f84ac14b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84b0c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac155510 con 0x7f84ac06b490 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84b0c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac156630 con 0x7f8490003a50 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84b0c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac156910 con 0x7f84ac156000 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84a3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84ac06b490 0x7f84ac155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84a3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84ac06b490 0x7f84ac155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47916/0 (socket says 172.21.15.2:47916) 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84a3e00640 1 -- 172.21.15.2:0/82349427 learned_addr learned my addr 172.21.15.2:0/82349427 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84aa800640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac156000 0x7f84ac14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.770+0000 7f84a9e00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490003a50 0x7f84ac06af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a3e00640 1 -- 172.21.15.2:0/82349427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac156000 msgr2=0x7f84ac14b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a3e00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac156000 0x7f84ac14b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a3e00640 1 -- 172.21.15.2:0/82349427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490003a50 msgr2=0x7f84ac06af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a3e00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490003a50 0x7f84ac06af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a3e00640 1 -- 172.21.15.2:0/82349427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac156bf0 con 0x7f84ac06b490 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a3e00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84ac06b490 0x7f84ac155ac0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8494000fd0 tx=0x7f8494007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a1600640 1 -- 172.21.15.2:0/82349427 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494018030 con 0x7f84ac06b490 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a1600640 1 -- 172.21.15.2:0/82349427 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494004e60 con 0x7f84ac06b490 2024-08-17T02:47:16.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84a1600640 1 -- 172.21.15.2:0/82349427 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400fb40 con 0x7f84ac06b490 2024-08-17T02:47:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac156ed0 con 0x7f84ac06b490 2024-08-17T02:47:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.771+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac14b9d0 con 0x7f84ac06b490 2024-08-17T02:47:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.772+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ac156400 con 0x7f84ac06b490 2024-08-17T02:47:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.773+0000 7f84a1600640 1 -- 172.21.15.2:0/82349427 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f849401b070 con 0x7f84ac06b490 2024-08-17T02:47:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.774+0000 7f84a1600640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8488065150 0x7f8488067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:16.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.774+0000 7f84a1600640 1 -- 172.21.15.2:0/82349427 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8494019070 con 0x7f84ac06b490 2024-08-17T02:47:16.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.774+0000 7f84a9e00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8488065150 0x7f8488067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:16.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.775+0000 7f84a9e00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8488065150 0x7f8488067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f849c034000 tx=0x7f849c035000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:16.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.778+0000 7f84a1600640 1 -- 172.21.15.2:0/82349427 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f84940501d0 con 0x7f84ac06b490 2024-08-17T02:47:16.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.998+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84ac14c500 con 0x7f84ac06b490 2024-08-17T02:47:17.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:16.999+0000 7f84a1600640 1 -- 172.21.15.2:0/82349427 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84ac14c500 con 0x7f84ac06b490 2024-08-17T02:47:17.000 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:17.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8488065150 msgr2=0x7f8488067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8488065150 0x7f8488067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f849c034000 tx=0x7f849c035000 comp rx=0 tx=0).stop 2024-08-17T02:47:17.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84ac06b490 msgr2=0x7f84ac155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84ac06b490 0x7f84ac155ac0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8494000fd0 tx=0x7f8494007940 comp rx=0 tx=0).stop 2024-08-17T02:47:17.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 shutdown_connections 2024-08-17T02:47:17.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8488065150 0x7f8488067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f84ac156000 0x7f84ac14b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84ac06b490 0x7f84ac155ac0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 --2- 172.21.15.2:0/82349427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8490003a50 0x7f84ac06af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 >> 172.21.15.2:0/82349427 conn(0x7f84ac066e60 msgr2=0x7f84ac0cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 shutdown_connections 2024-08-17T02:47:17.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.001+0000 7f84b0c00640 1 -- 172.21.15.2:0/82349427 wait complete. 2024-08-17T02:47:17.017 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:47:17.017 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:17.017 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-08-17T02:47:17.017 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:47:17.017 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:17.018 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:47:17.018 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:47:17.018 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:17.018 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:17.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.018 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-08-17T02:47:17.054 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:17.055 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42585sec preferred_lft 42585sec 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 3a:17:d0:22:86:ac brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::449a:a9ff:feb8:db3/64 scope link 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 3a:17:d0:22:86:ac brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::3817:d0ff:fe22:86ac/64 scope link 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether fe:24:22:b0:de:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::fc24:22ff:feb0:de95/64 scope link 2024-08-17T02:47:17.057 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:17.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.058 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:17.149 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-08-17T02:47:17.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.152 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-08-17T02:47:17.188 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-08-17T02:47:17.189 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:17.189 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:47:17.189 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:47:17.189 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:17.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.189 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2024-08-17T02:47:17.190 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-08-17T02:47:17.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:47:17.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:47:17.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:47:17.190 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-08-17T02:47:17.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.334 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:47:17.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:47:17.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:47:17.371 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:17.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-08-17T02:47:17.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:17.468 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:17.505 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:47:17.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:17.506 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:17.580 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:47:17.581 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:17.581 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:17.702 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:17.702 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:17.729 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:17.729 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:17.730 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.26:3300,172.21.15.26:3301" 2024-08-17T02:47:17.730 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@f19c300a-c18c-4d11-a652-563f33592040.cephfs=/ 2024-08-17T02:47:17.730 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.2:3300/172.21.15.26:3300/172.21.15.26:3301" will pass to kernel 2024-08-17T02:47:17.731 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:47:17.731 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:17.731 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:17.731 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:17.731 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:17.734 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:17.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:17.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:47:17.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:47:17.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.945+0000 7f49da400640 1 Processor -- start 2024-08-17T02:47:17.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.945+0000 7f49da400640 1 -- start start 2024-08-17T02:47:17.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.946+0000 7f49da400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49d41590b0 0x7f49d40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.946+0000 7f49da400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d40acf10 0x7f49d4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.946+0000 7f49da400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d415a4e0 con 0x7f49d40afca0 2024-08-17T02:47:17.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.946+0000 7f49da400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d40b0980 con 0x7f49d41590b0 2024-08-17T02:47:17.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.946+0000 7f49da400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c92b0 con 0x7f49d40acf10 2024-08-17T02:47:17.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.946+0000 7f49d2a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49d41590b0 0x7f49d40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.947+0000 7f49d2a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f49d41590b0 0x7f49d40b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47920/0 (socket says 172.21.15.2:47920) 2024-08-17T02:47:17.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.947+0000 7f49d2a00640 1 -- 172.21.15.2:0/740485155 learned_addr learned my addr 172.21.15.2:0/740485155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:17.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.947+0000 7f49d3e00640 1 --2- 172.21.15.2:0/740485155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d40acf10 0x7f49d4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.947+0000 7f49d2a00640 1 -- 172.21.15.2:0/740485155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d40acf10 msgr2=0x7f49d4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:17.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.947+0000 7f49d2a00640 1 --2- 172.21.15.2:0/740485155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d40acf10 0x7f49d4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.947+0000 7f49d2a00640 1 -- 172.21.15.2:0/740485155 >> v1:172.21.15.26:6789/0 conn(0x7f49d40afca0 legacy=0x7f49d41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.947+0000 7f49d2a00640 1 -- 172.21.15.2:0/740485155 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40ad480 con 0x7f49d41590b0 2024-08-17T02:47:17.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.948+0000 7f49d2a00640 1 --2- 172.21.15.2:0/740485155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d41590b0 0x7f49d40b0070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009910 tx=0x7f49c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9761119b6e141045 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.948+0000 7f49d2000640 1 -- 172.21.15.2:0/740485155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c002ae40 con 0x7f49d41590b0 2024-08-17T02:47:17.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.948+0000 7f49d2000640 1 -- 172.21.15.2:0/740485155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c0032440 con 0x7f49d41590b0 2024-08-17T02:47:17.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.948+0000 7f49d2000640 1 -- 172.21.15.2:0/740485155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0032820 con 0x7f49d41590b0 2024-08-17T02:47:17.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.949+0000 7f49da400640 1 -- 172.21.15.2:0/740485155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d41590b0 msgr2=0x7f49d40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.949+0000 7f49da400640 1 --2- 172.21.15.2:0/740485155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d41590b0 0x7f49d40b0070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009910 tx=0x7f49c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.949+0000 7f49da400640 1 -- 172.21.15.2:0/740485155 shutdown_connections 2024-08-17T02:47:17.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.949+0000 7f49da400640 1 --2- 172.21.15.2:0/740485155 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d40acf10 0x7f49d4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.949+0000 7f49da400640 1 --2- 172.21.15.2:0/740485155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d41590b0 0x7f49d40b0070 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.949+0000 7f49da400640 1 -- 172.21.15.2:0/740485155 >> 172.21.15.2:0/740485155 conn(0x7f49d4066e60 msgr2=0x7f49d4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:17.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.949+0000 7f49da400640 1 -- 172.21.15.2:0/740485155 shutdown_connections 2024-08-17T02:47:17.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.949+0000 7f49da400640 1 -- 172.21.15.2:0/740485155 wait complete. 2024-08-17T02:47:17.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.950+0000 7f49da400640 1 Processor -- start 2024-08-17T02:47:17.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.951+0000 7f49da400640 1 -- start start 2024-08-17T02:47:17.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.951+0000 7f49da400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d40acf10 0x7f49d4167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.951+0000 7f49da400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49d40afca0 0x7f49d40c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.951+0000 7f49da400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d41590b0 0x7f49d40c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.951+0000 7f49da400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c45a0 con 0x7f49d40acf10 2024-08-17T02:47:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.951+0000 7f49da400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c2110 con 0x7f49d40afca0 2024-08-17T02:47:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.951+0000 7f49da400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c1ae0 con 0x7f49d41590b0 2024-08-17T02:47:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d40acf10 0x7f49d4167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d40acf10 0x7f49d4167f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47930/0 (socket says 172.21.15.2:47930) 2024-08-17T02:47:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3400640 1 -- 172.21.15.2:0/662579141 learned_addr learned my addr 172.21.15.2:0/662579141 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:17.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d2a00640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49d40afca0 0x7f49d40c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3e00640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d41590b0 0x7f49d40c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3400640 1 -- 172.21.15.2:0/662579141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d41590b0 msgr2=0x7f49d40c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d41590b0 0x7f49d40c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3400640 1 -- 172.21.15.2:0/662579141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49d40afca0 msgr2=0x7f49d40c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49d40afca0 0x7f49d40c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.952+0000 7f49d3400640 1 -- 172.21.15.2:0/662579141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0009450 con 0x7f49d40acf10 2024-08-17T02:47:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.953+0000 7f49d3400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d40acf10 0x7f49d4167f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f49c400c560 tx=0x7f49c4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.953+0000 7f49caa00640 1 -- 172.21.15.2:0/662579141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4011590 con 0x7f49d40acf10 2024-08-17T02:47:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.953+0000 7f49caa00640 1 -- 172.21.15.2:0/662579141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c4011710 con 0x7f49d40acf10 2024-08-17T02:47:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.953+0000 7f49caa00640 1 -- 172.21.15.2:0/662579141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4011ad0 con 0x7f49d40acf10 2024-08-17T02:47:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.953+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d40c6230 con 0x7f49d40acf10 2024-08-17T02:47:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.953+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d4169f30 con 0x7f49d40acf10 2024-08-17T02:47:17.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.954+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d416a120 con 0x7f49d40acf10 2024-08-17T02:47:17.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.955+0000 7f49caa00640 1 -- 172.21.15.2:0/662579141 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f49c401b3b0 con 0x7f49d40acf10 2024-08-17T02:47:17.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.956+0000 7f49caa00640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f49b4065150 0x7f49b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:17.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.956+0000 7f49caa00640 1 -- 172.21.15.2:0/662579141 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49c4081770 con 0x7f49d40acf10 2024-08-17T02:47:17.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.956+0000 7f49d2a00640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f49b4065150 0x7f49b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:17.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.957+0000 7f49d2a00640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f49b4065150 0x7f49b4067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49c0034000 tx=0x7f49c0032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:17.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:17.960+0000 7f49caa00640 1 -- 172.21.15.2:0/662579141 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f49c404f840 con 0x7f49d40acf10 2024-08-17T02:47:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.184+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49d415a4e0 con 0x7f49d40acf10 2024-08-17T02:47:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.184+0000 7f49caa00640 1 -- 172.21.15.2:0/662579141 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f49c4017060 con 0x7f49d40acf10 2024-08-17T02:47:18.186 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:47:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f49b4065150 msgr2=0x7f49b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f49b4065150 0x7f49b4067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49c0034000 tx=0x7f49c0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d40acf10 msgr2=0x7f49d4167f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d40acf10 0x7f49d4167f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f49c400c560 tx=0x7f49c4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 shutdown_connections 2024-08-17T02:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f49b4065150 0x7f49b4067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f49d41590b0 0x7f49d40c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f49d40afca0 0x7f49d40c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 --2- 172.21.15.2:0/662579141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d40acf10 0x7f49d4167f70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 >> 172.21.15.2:0/662579141 conn(0x7f49d4066e60 msgr2=0x7f49d40ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 shutdown_connections 2024-08-17T02:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:18.186+0000 7f49da400640 1 -- 172.21.15.2:0/662579141 wait complete. 2024-08-17T02:47:18.202 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:47:18.202 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:47:18.202 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-08-17T02:47:18.202 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:47:18.202 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:18.202 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:47:18.202 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:47:18.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:47:18.203 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:18.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.205 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-08-17T02:47:18.247 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:47:18.247 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:47:18.247 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:47:18.247 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:18.247 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-08-17T02:47:18.247 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:18.247 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:47:18.248 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42580sec preferred_lft 42580sec 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link noprefixroute 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 32:51:83:bf:46:3e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::684f:21ff:fe25:720/64 scope link 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:18.249 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether b6:51:e4:10:94:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:47:18.250 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::b451:e4ff:fe10:9409/64 scope link 2024-08-17T02:47:18.250 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:18.250 INFO:teuthology.orchestra.run.smithi026.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:47:18.250 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 32:51:83:bf:46:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:47:18.250 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::3051:83ff:febf:463e/64 scope link 2024-08-17T02:47:18.250 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:47:18.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.250 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:47:18.346 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-08-17T02:47:18.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.350 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-08-17T02:47:18.388 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-08-17T02:47:18.388 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:47:18.388 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:47:18.388 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:47:18.388 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:47:18.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.389 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2024-08-17T02:47:18.389 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-08-17T02:47:18.389 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:47:18.389 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:47:18.389 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:47:18.389 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-08-17T02:47:18.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.541 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-08-17T02:47:18.576 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:47:18.576 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:47:18.577 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:18.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.577 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2024-08-17T02:47:18.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:18.675 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:18.711 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:47:18.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:47:18.711 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:18.786 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:47:18.786 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:47:18.786 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:18.909 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:18.909 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:18.936 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:47:18.936 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:47:18.936 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.26:3300,172.21.15.26:3301" 2024-08-17T02:47:18.936 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with new device syntax: 1@f19c300a-c18c-4d11-a652-563f33592040.cephfs=/ 2024-08-17T02:47:18.936 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.2:3300/172.21.15.26:3300/172.21.15.26:3301" will pass to kernel 2024-08-17T02:47:18.937 INFO:teuthology.orchestra.run.smithi026.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:47:18.937 INFO:teuthology.orchestra.run.smithi026.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:47:18.937 INFO:teuthology.orchestra.run.smithi026.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:47:18.937 INFO:teuthology.orchestra.run.smithi026.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:47:18.937 INFO:teuthology.orchestra.run.smithi026.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:47:18.940 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:47:18.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:47:18.940 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:47:18.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:47:19.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.157+0000 7fa35e000640 1 Processor -- start 2024-08-17T02:47:19.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.157+0000 7fa35e000640 1 -- start start 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.158+0000 7fa35e000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa358158c70 0x7fa3580a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.158+0000 7fa35e000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa3580af120 0x7fa35806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.158+0000 7fa35e000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3580a9e90 con 0x7fa358159040 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.158+0000 7fa35e000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3580aec90 con 0x7fa3580af120 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.158+0000 7fa35e000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580a98d0 con 0x7fa358158c70 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.159+0000 7fa357e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa3580af120 0x7fa35806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.159+0000 7fa357e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa3580af120 0x7fa35806d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47942/0 (socket says 172.21.15.2:47942) 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.159+0000 7fa357e00640 1 -- 172.21.15.2:0/2743140093 learned_addr learned my addr 172.21.15.2:0/2743140093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:19.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.159+0000 7fa357400640 1 --2- 172.21.15.2:0/2743140093 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa358158c70 0x7fa3580a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.159+0000 7fa357e00640 1 -- 172.21.15.2:0/2743140093 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa358158c70 msgr2=0x7fa3580a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:19.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.159+0000 7fa357e00640 1 --2- 172.21.15.2:0/2743140093 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa358158c70 0x7fa3580a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.159+0000 7fa357e00640 1 -- 172.21.15.2:0/2743140093 >> v1:172.21.15.26:6789/0 conn(0x7fa358159040 legacy=0x7fa35815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.159+0000 7fa357e00640 1 -- 172.21.15.2:0/2743140093 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580a9bb0 con 0x7fa3580af120 2024-08-17T02:47:19.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.160+0000 7fa357e00640 1 --2- 172.21.15.2:0/2743140093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3580af120 0x7fa35806d7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa350009f20 tx=0x7fa350009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a4011317f8c735 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.160+0000 7fa356a00640 1 -- 172.21.15.2:0/2743140093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350031400 con 0x7fa3580af120 2024-08-17T02:47:19.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.160+0000 7fa356a00640 1 -- 172.21.15.2:0/2743140093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35002d050 con 0x7fa3580af120 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.160+0000 7fa356a00640 1 -- 172.21.15.2:0/2743140093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3500317d0 con 0x7fa3580af120 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.161+0000 7fa35e000640 1 -- 172.21.15.2:0/2743140093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3580af120 msgr2=0x7fa35806d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.161+0000 7fa35e000640 1 --2- 172.21.15.2:0/2743140093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3580af120 0x7fa35806d7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa350009f20 tx=0x7fa350009840 comp rx=0 tx=0).stop 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.161+0000 7fa35e000640 1 -- 172.21.15.2:0/2743140093 shutdown_connections 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.161+0000 7fa35e000640 1 --2- 172.21.15.2:0/2743140093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3580af120 0x7fa35806d7a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.161+0000 7fa35e000640 1 --2- 172.21.15.2:0/2743140093 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa358158c70 0x7fa3580a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.161+0000 7fa35e000640 1 -- 172.21.15.2:0/2743140093 >> 172.21.15.2:0/2743140093 conn(0x7fa358066e60 msgr2=0x7fa358067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.161+0000 7fa35e000640 1 -- 172.21.15.2:0/2743140093 shutdown_connections 2024-08-17T02:47:19.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.161+0000 7fa35e000640 1 -- 172.21.15.2:0/2743140093 wait complete. 2024-08-17T02:47:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.162+0000 7fa35e000640 1 Processor -- start 2024-08-17T02:47:19.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.163+0000 7fa35e000640 1 -- start start 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa35e000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3580af120 0x7fa35815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa35e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa358158c70 0x7fa358150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa35e000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa358159040 0x7fa358157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa35e000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa358154690 con 0x7fa358158c70 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa35e000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa358153ac0 con 0x7fa358159040 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa35e000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa358153d60 con 0x7fa3580af120 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa34fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa358158c70 0x7fa358150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3580af120 0x7fa35815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3580af120 0x7fa35815b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:47832/0 (socket says 172.21.15.2:47832) 2024-08-17T02:47:19.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357400640 1 -- 172.21.15.2:0/470092556 learned_addr learned my addr 172.21.15.2:0/470092556 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:19.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357e00640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa358159040 0x7fa358157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357400640 1 -- 172.21.15.2:0/470092556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa358159040 msgr2=0x7fa358157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357400640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa358159040 0x7fa358157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357400640 1 -- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa358158c70 msgr2=0x7fa358150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357400640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa358158c70 0x7fa358150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.164+0000 7fa357400640 1 -- 172.21.15.2:0/470092556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350009ae0 con 0x7fa3580af120 2024-08-17T02:47:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.165+0000 7fa357400640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3580af120 0x7fa35815b8e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa34800ea20 tx=0x7fa3480090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.165+0000 7fa34ea00640 1 -- 172.21.15.2:0/470092556 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800ca10 con 0x7fa3580af120 2024-08-17T02:47:19.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.165+0000 7fa34ea00640 1 -- 172.21.15.2:0/470092556 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34800cb70 con 0x7fa3580af120 2024-08-17T02:47:19.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.165+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa358154040 con 0x7fa3580af120 2024-08-17T02:47:19.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.165+0000 7fa34ea00640 1 -- 172.21.15.2:0/470092556 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348013470 con 0x7fa3580af120 2024-08-17T02:47:19.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.165+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa358169430 con 0x7fa3580af120 2024-08-17T02:47:19.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.166+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa358063fb0 con 0x7fa3580af120 2024-08-17T02:47:19.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.167+0000 7fa34ea00640 1 -- 172.21.15.2:0/470092556 <== mon.2 v2:172.21.15.26:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa348013860 con 0x7fa3580af120 2024-08-17T02:47:19.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.168+0000 7fa34ea00640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa334065150 0x7fa334067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.168+0000 7fa34ea00640 1 -- 172.21.15.2:0/470092556 <== mon.2 v2:172.21.15.26:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa348082730 con 0x7fa3580af120 2024-08-17T02:47:19.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.168+0000 7fa34fe00640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa334065150 0x7fa334067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.168+0000 7fa34fe00640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa334065150 0x7fa334067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa358153570 tx=0x7fa340007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.172+0000 7fa34ea00640 1 -- 172.21.15.2:0/470092556 <== mon.2 v2:172.21.15.26:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa348050800 con 0x7fa3580af120 2024-08-17T02:47:19.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.394+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa35806aba0 con 0x7fa3580af120 2024-08-17T02:47:19.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.500+0000 7fa34ea00640 1 -- 172.21.15.2:0/470092556 <== mon.2 v2:172.21.15.26:3301/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa348053e20 con 0x7fa3580af120 2024-08-17T02:47:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa334065150 msgr2=0x7fa334067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa334065150 0x7fa334067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa358153570 tx=0x7fa340007e30 comp rx=0 tx=0).stop 2024-08-17T02:47:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3580af120 msgr2=0x7fa35815b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3580af120 0x7fa35815b8e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa34800ea20 tx=0x7fa3480090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 shutdown_connections 2024-08-17T02:47:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa358159040 0x7fa358157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa358158c70 0x7fa358150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa334065150 0x7fa334067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 --2- 172.21.15.2:0/470092556 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa3580af120 0x7fa35815b8e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 >> 172.21.15.2:0/470092556 conn(0x7fa358066e60 msgr2=0x7fa358069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 shutdown_connections 2024-08-17T02:47:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.502+0000 7fa35e000640 1 -- 172.21.15.2:0/470092556 wait complete. 2024-08-17T02:47:19.518 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:47:19.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.670+0000 7f6399200640 1 Processor -- start 2024-08-17T02:47:19.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.670+0000 7f6399200640 1 -- start start 2024-08-17T02:47:19.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6399200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 0x7f639415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6399200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63940ca050 0x7f6394156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6399200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63940add30 0x7f6394156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6399200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639415b5e0 con 0x7f63940add30 2024-08-17T02:47:19.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6399200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940cb160 con 0x7f63940ca050 2024-08-17T02:47:19.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6399200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940b0d10 con 0x7f63940ad960 2024-08-17T02:47:19.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6392800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63940add30 0x7f6394156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6392800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f63940add30 0x7f6394156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47958/0 (socket says 172.21.15.2:47958) 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.671+0000 7f6392800640 1 -- 172.21.15.2:0/2450827644 learned_addr learned my addr 172.21.15.2:0/2450827644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.672+0000 7f6391e00640 1 --2- 172.21.15.2:0/2450827644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 0x7f639415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.672+0000 7f6391400640 1 --2- 172.21.15.2:0/2450827644 >> v2:172.21.15.26:3300/0 conn(0x7f63940ca050 0x7f6394156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.672+0000 7f6392800640 1 -- 172.21.15.2:0/2450827644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 msgr2=0x7f639415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.672+0000 7f6392800640 1 --2- 172.21.15.2:0/2450827644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 0x7f639415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.672+0000 7f6392800640 1 -- 172.21.15.2:0/2450827644 >> v2:172.21.15.26:3300/0 conn(0x7f63940ca050 msgr2=0x7f6394156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.672+0000 7f6392800640 1 --2- 172.21.15.2:0/2450827644 >> v2:172.21.15.26:3300/0 conn(0x7f63940ca050 0x7f6394156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.672+0000 7f6392800640 1 -- 172.21.15.2:0/2450827644 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63940ca550 con 0x7f63940add30 2024-08-17T02:47:19.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.672+0000 7f6391400640 1 --2- 172.21.15.2:0/2450827644 >> v2:172.21.15.26:3300/0 conn(0x7f63940ca050 0x7f6394156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:19.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.673+0000 7f6392800640 1 --2- 172.21.15.2:0/2450827644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394156960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f639406d1e0 tx=0x7f638c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72151fb0c954796e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.673+0000 7f6390a00640 1 -- 172.21.15.2:0/2450827644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c031400 con 0x7f63940add30 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.673+0000 7f6390a00640 1 -- 172.21.15.2:0/2450827644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c02d050 con 0x7f63940add30 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.673+0000 7f6390a00640 1 -- 172.21.15.2:0/2450827644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c0317d0 con 0x7f63940add30 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 -- 172.21.15.2:0/2450827644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 msgr2=0x7f6394156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 --2- 172.21.15.2:0/2450827644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394156960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f639406d1e0 tx=0x7f638c009840 comp rx=0 tx=0).stop 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 -- 172.21.15.2:0/2450827644 shutdown_connections 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 --2- 172.21.15.2:0/2450827644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394156960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 --2- 172.21.15.2:0/2450827644 >> v2:172.21.15.26:3300/0 conn(0x7f63940ca050 0x7f6394156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 --2- 172.21.15.2:0/2450827644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 0x7f639415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 -- 172.21.15.2:0/2450827644 >> 172.21.15.2:0/2450827644 conn(0x7f6394066e60 msgr2=0x7f6394067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 -- 172.21.15.2:0/2450827644 shutdown_connections 2024-08-17T02:47:19.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.674+0000 7f6399200640 1 -- 172.21.15.2:0/2450827644 wait complete. 2024-08-17T02:47:19.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.675+0000 7f6399200640 1 Processor -- start 2024-08-17T02:47:19.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.675+0000 7f6399200640 1 -- start start 2024-08-17T02:47:19.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6399200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 0x7f6394157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6399200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6399200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63940ca050 0x7f639414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6399200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639413f6c0 con 0x7f63940add30 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6399200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394140e90 con 0x7f63940ca050 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6399200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6394141cb0 con 0x7f63940ad960 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6391400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6391400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47966/0 (socket says 172.21.15.2:47966) 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.676+0000 7f6391400640 1 -- 172.21.15.2:0/3584050644 learned_addr learned my addr 172.21.15.2:0/3584050644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6391e00640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 0x7f6394157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6392800640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63940ca050 0x7f639414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6391400640 1 -- 172.21.15.2:0/3584050644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 msgr2=0x7f6394157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6391400640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 0x7f6394157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6391400640 1 -- 172.21.15.2:0/3584050644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63940ca050 msgr2=0x7f639414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6391400640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63940ca050 0x7f639414a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6391400640 1 -- 172.21.15.2:0/3584050644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c009ae0 con 0x7f63940add30 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6391400640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394142140 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f638000d860 tx=0x7f6380008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6389600640 1 -- 172.21.15.2:0/3584050644 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000de50 con 0x7f63940add30 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6389600640 1 -- 172.21.15.2:0/3584050644 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638000b870 con 0x7f63940add30 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6389600640 1 -- 172.21.15.2:0/3584050644 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000bc30 con 0x7f63940add30 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.677+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639413f1a0 con 0x7f63940add30 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.678+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6394141400 con 0x7f63940add30 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.679+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6394063fb0 con 0x7f63940add30 2024-08-17T02:47:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.679+0000 7f6389600640 1 -- 172.21.15.2:0/3584050644 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f638001e460 con 0x7f63940add30 2024-08-17T02:47:19.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.680+0000 7f6389600640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6374065150 0x7f6374067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:19.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.680+0000 7f6389600640 1 -- 172.21.15.2:0/3584050644 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6380082a80 con 0x7f63940add30 2024-08-17T02:47:19.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.680+0000 7f6391e00640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6374065150 0x7f6374067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:19.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.681+0000 7f6391e00640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6374065150 0x7f6374067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f638400bd40 tx=0x7f6384008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:19.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.684+0000 7f6389600640 1 -- 172.21.15.2:0/3584050644 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6380050b50 con 0x7f63940add30 2024-08-17T02:47:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.894+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6394141df0 con 0x7f6374065150 2024-08-17T02:47:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.896+0000 7f6389600640 1 -- 172.21.15.2:0/3584050644 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6394141df0 con 0x7f6374065150 2024-08-17T02:47:19.897 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-17T02:47:19.898 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:19.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2024-08-17T02:47:19.898 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:19.898 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-17T02:47:19.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6374065150 msgr2=0x7f6374067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6374065150 0x7f6374067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f638400bd40 tx=0x7f6384008040 comp rx=0 tx=0).stop 2024-08-17T02:47:19.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 msgr2=0x7f6394142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:19.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394142140 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f638000d860 tx=0x7f6380008040 comp rx=0 tx=0).stop 2024-08-17T02:47:19.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 shutdown_connections 2024-08-17T02:47:19.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63940ca050 0x7f639414a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63940add30 0x7f6394142140 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6374065150 0x7f6374067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 --2- 172.21.15.2:0/3584050644 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f63940ad960 0x7f6394157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:19.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 >> 172.21.15.2:0/3584050644 conn(0x7f6394066e60 msgr2=0x7f6394155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:19.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 shutdown_connections 2024-08-17T02:47:19.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:19.898+0000 7f6399200640 1 -- 172.21.15.2:0/3584050644 wait complete. 2024-08-17T02:47:19.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:47:20.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.067+0000 7f4ab5800640 1 Processor -- start 2024-08-17T02:47:20.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.067+0000 7f4ab5800640 1 -- start start 2024-08-17T02:47:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.068+0000 7f4ab5800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.068+0000 7f4ab5800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4ab00add30 0x7f4ab0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.068+0000 7f4ab5800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab015b5e0 con 0x7f4ab00ca050 2024-08-17T02:47:20.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.068+0000 7f4ab5800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab00cb160 con 0x7f4ab00add30 2024-08-17T02:47:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.068+0000 7f4ab5800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00b0d10 con 0x7f4ab00ad960 2024-08-17T02:47:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.068+0000 7f4aa6000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4ab00ca050 0x7f4ab0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57672/0 (socket says 172.21.15.2:57672) 2024-08-17T02:47:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.068+0000 7f4aa6000640 1 -- 172.21.15.2:0/4026885882 learned_addr learned my addr 172.21.15.2:0/4026885882 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aaea00640 1 --2- 172.21.15.2:0/4026885882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aaf400640 1 --2- 172.21.15.2:0/4026885882 >> v2:172.21.15.26:3300/0 conn(0x7f4ab00add30 0x7f4ab0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aae000640 1 -- 172.21.15.2:0/4026885882 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740656035 0 0) 0x7f4a98001110 con 0x7f4ab00ca050 2024-08-17T02:47:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aae000640 1 -- 172.21.15.2:0/4026885882 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a940034e0 con 0x7f4ab00ca050 2024-08-17T02:47:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aaea00640 1 -- 172.21.15.2:0/4026885882 >> v2:172.21.15.26:3300/0 conn(0x7f4ab00add30 msgr2=0x7f4ab0156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aaea00640 1 --2- 172.21.15.2:0/4026885882 >> v2:172.21.15.26:3300/0 conn(0x7f4ab00add30 0x7f4ab0156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aaea00640 1 -- 172.21.15.2:0/4026885882 >> v1:172.21.15.2:6789/0 conn(0x7f4ab00ca050 legacy=0x7f4ab0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aaea00640 1 -- 172.21.15.2:0/4026885882 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00ca550 con 0x7f4ab00ad960 2024-08-17T02:47:20.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.069+0000 7f4aaf400640 1 --2- 172.21.15.2:0/4026885882 >> v2:172.21.15.26:3300/0 conn(0x7f4ab00add30 0x7f4ab0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:47:20.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.070+0000 7f4aaea00640 1 --2- 172.21.15.2:0/4026885882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab015b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009850 tx=0x7f4aa00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b1515877e1ee9e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4aae000640 1 -- 172.21.15.2:0/4026885882 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa002ae10 con 0x7f4ab00ad960 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4aae000640 1 -- 172.21.15.2:0/4026885882 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0032440 con 0x7f4ab00ad960 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4aae000640 1 -- 172.21.15.2:0/4026885882 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0032820 con 0x7f4ab00ad960 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4ab5800640 1 -- 172.21.15.2:0/4026885882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 msgr2=0x7f4ab015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4ab5800640 1 --2- 172.21.15.2:0/4026885882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab015b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009850 tx=0x7f4aa00090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4ab5800640 1 -- 172.21.15.2:0/4026885882 shutdown_connections 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4ab5800640 1 --2- 172.21.15.2:0/4026885882 >> v2:172.21.15.26:3300/0 conn(0x7f4ab00add30 0x7f4ab0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4ab5800640 1 --2- 172.21.15.2:0/4026885882 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab015b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4ab5800640 1 -- 172.21.15.2:0/4026885882 >> 172.21.15.2:0/4026885882 conn(0x7f4ab0066e60 msgr2=0x7f4ab0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4ab5800640 1 -- 172.21.15.2:0/4026885882 shutdown_connections 2024-08-17T02:47:20.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.071+0000 7f4ab5800640 1 -- 172.21.15.2:0/4026885882 wait complete. 2024-08-17T02:47:20.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.073+0000 7f4ab5800640 1 Processor -- start 2024-08-17T02:47:20.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.073+0000 7f4ab5800640 1 -- start start 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4ab5800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab0149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4ab5800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ab00add30 0x7f4ab015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4ab5800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab00ca050 0x7f4ab015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4ab5800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0169370 con 0x7f4ab00ca050 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4ab5800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0169570 con 0x7f4ab00add30 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4ab5800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0169850 con 0x7f4ab00ad960 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4aaf400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab00ca050 0x7f4ab015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4aaf400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab00ca050 0x7f4ab015a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47974/0 (socket says 172.21.15.2:47974) 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4aaf400640 1 -- 172.21.15.2:0/95401078 learned_addr learned my addr 172.21.15.2:0/95401078 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4aaea00640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab0149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.074+0000 7f4aa6000640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ab00add30 0x7f4ab015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aaf400640 1 -- 172.21.15.2:0/95401078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 msgr2=0x7f4ab0149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aaf400640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab0149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aaf400640 1 -- 172.21.15.2:0/95401078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ab00add30 msgr2=0x7f4ab015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aaf400640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ab00add30 0x7f4ab015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aaf400640 1 -- 172.21.15.2:0/95401078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8009a20 con 0x7f4ab00ca050 2024-08-17T02:47:20.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aaf400640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab00ca050 0x7f4ab015a940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009fc0 tx=0x7f4aa800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aa6a00640 1 -- 172.21.15.2:0/95401078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800ce70 con 0x7f4ab00ca050 2024-08-17T02:47:20.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aa6a00640 1 -- 172.21.15.2:0/95401078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa800f040 con 0x7f4ab00ca050 2024-08-17T02:47:20.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4aa6a00640 1 -- 172.21.15.2:0/95401078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa80146d0 con 0x7f4ab00ca050 2024-08-17T02:47:20.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa0009390 con 0x7f4ab00ca050 2024-08-17T02:47:20.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.075+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab016a0f0 con 0x7f4ab00ca050 2024-08-17T02:47:20.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.076+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab0169c50 con 0x7f4ab00ca050 2024-08-17T02:47:20.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.077+0000 7f4aa6a00640 1 -- 172.21.15.2:0/95401078 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4aa8003020 con 0x7f4ab00ca050 2024-08-17T02:47:20.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.078+0000 7f4aa6a00640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4a8c065150 0x7f4a8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.078+0000 7f4aa6a00640 1 -- 172.21.15.2:0/95401078 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4aa8082eb0 con 0x7f4ab00ca050 2024-08-17T02:47:20.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.078+0000 7f4aaea00640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4a8c065150 0x7f4a8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.079+0000 7f4aaea00640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4a8c065150 0x7f4a8c067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0034000 tx=0x7f4aa0032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.082+0000 7f4aa6a00640 1 -- 172.21.15.2:0/95401078 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4aa8050f80 con 0x7f4ab00ca050 2024-08-17T02:47:20.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.263+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4ab0169a10 con 0x7f4ab00ca050 2024-08-17T02:47:20.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.263+0000 7f4aa6a00640 1 -- 172.21.15.2:0/95401078 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4aa80545a0 con 0x7f4ab00ca050 2024-08-17T02:47:20.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4a8c065150 msgr2=0x7f4a8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4a8c065150 0x7f4a8c067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0034000 tx=0x7f4aa0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:20.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab00ca050 msgr2=0x7f4ab015a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab00ca050 0x7f4ab015a940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009fc0 tx=0x7f4aa800b040 comp rx=0 tx=0).stop 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 shutdown_connections 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ab00ca050 0x7f4ab015a940 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4ab00add30 0x7f4ab015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f4a8c065150 0x7f4a8c067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 --2- 172.21.15.2:0/95401078 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f4ab00ad960 0x7f4ab0149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 >> 172.21.15.2:0/95401078 conn(0x7f4ab0066e60 msgr2=0x7f4ab0154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 shutdown_connections 2024-08-17T02:47:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.265+0000 7f4ab5800640 1 -- 172.21.15.2:0/95401078 wait complete. 2024-08-17T02:47:20.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000943317 2024-08-17T02:47:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.433+0000 7f24b2a00640 1 Processor -- start 2024-08-17T02:47:20.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.434+0000 7f24b2a00640 1 -- start start 2024-08-17T02:47:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.435+0000 7f24b2a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24ac156900 0x7f24ac0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.435+0000 7f24b2a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac0b0b10 con 0x7f24ac0ae180 2024-08-17T02:47:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.435+0000 7f24b2a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac0b0df0 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.435+0000 7f24b2a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac0b10d0 con 0x7f24ac156900 2024-08-17T02:47:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.435+0000 7f24b1600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24ac156900 0x7f24ac0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.435+0000 7f24b1600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24ac156900 0x7f24ac0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47988/0 (socket says 172.21.15.2:47988) 2024-08-17T02:47:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.435+0000 7f24b1600640 1 -- 172.21.15.2:0/3465125846 learned_addr learned my addr 172.21.15.2:0/3465125846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:20.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.435+0000 7f24b2000640 1 --1- 172.21.15.2:0/3465125846 >> v1:172.21.15.2:6789/0 conn(0x7f24ac0ae180 0x7f24ac0aab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57684/0 (socket says 172.21.15.2:57684) 2024-08-17T02:47:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.436+0000 7f24b1600640 1 -- 172.21.15.2:0/3465125846 >> v1:172.21.15.26:6789/0 conn(0x7f24ac0ae7d0 legacy=0x7f24ac0ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.436+0000 7f24b1600640 1 -- 172.21.15.2:0/3465125846 >> v1:172.21.15.2:6789/0 conn(0x7f24ac0ae180 legacy=0x7f24ac0aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.436+0000 7f24b1600640 1 -- 172.21.15.2:0/3465125846 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0b13b0 con 0x7f24ac156900 2024-08-17T02:47:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.436+0000 7f24abe00640 1 -- 172.21.15.2:0/3465125846 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611482684 0 0) 0x7f24ac0b0b10 con 0x7f24ac0ae180 2024-08-17T02:47:20.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24b1600640 1 --2- 172.21.15.2:0/3465125846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac156900 0x7f24ac0b01c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009910 tx=0x7f24a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db46051c36de8126 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24abe00640 1 -- 172.21.15.2:0/3465125846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0032440 con 0x7f24ac156900 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24abe00640 1 -- 172.21.15.2:0/3465125846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a00325a0 con 0x7f24ac156900 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24abe00640 1 -- 172.21.15.2:0/3465125846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0032940 con 0x7f24ac156900 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24b2a00640 1 -- 172.21.15.2:0/3465125846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac156900 msgr2=0x7f24ac0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24b2a00640 1 --2- 172.21.15.2:0/3465125846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac156900 0x7f24ac0b01c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f24a0009910 tx=0x7f24a00091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24b2a00640 1 -- 172.21.15.2:0/3465125846 shutdown_connections 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24b2a00640 1 --2- 172.21.15.2:0/3465125846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac156900 0x7f24ac0b01c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.437+0000 7f24b2a00640 1 -- 172.21.15.2:0/3465125846 >> 172.21.15.2:0/3465125846 conn(0x7f24ac067930 msgr2=0x7f24ac0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.438+0000 7f24b2a00640 1 -- 172.21.15.2:0/3465125846 shutdown_connections 2024-08-17T02:47:20.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.438+0000 7f24b2a00640 1 -- 172.21.15.2:0/3465125846 wait complete. 2024-08-17T02:47:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.439+0000 7f24b2a00640 1 Processor -- start 2024-08-17T02:47:20.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.439+0000 7f24b2a00640 1 -- start start 2024-08-17T02:47:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b2a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24ac0ae180 0x7f24ac14c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac0ae7d0 0x7f24ac14eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b2a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24ac156900 0x7f24ac1670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b2a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac14da40 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b2a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac14f3f0 con 0x7f24ac156900 2024-08-17T02:47:20.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b2a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac14ce30 con 0x7f24ac0ae180 2024-08-17T02:47:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac0ae7d0 0x7f24ac14eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac0ae7d0 0x7f24ac14eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47998/0 (socket says 172.21.15.2:47998) 2024-08-17T02:47:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b0c00640 1 -- 172.21.15.2:0/2771855508 learned_addr learned my addr 172.21.15.2:0/2771855508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b2000640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24ac156900 0x7f24ac1670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.440+0000 7f24b1600640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24ac0ae180 0x7f24ac14c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24b0c00640 1 -- 172.21.15.2:0/2771855508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24ac0ae180 msgr2=0x7f24ac14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24b0c00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24ac0ae180 0x7f24ac14c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24b0c00640 1 -- 172.21.15.2:0/2771855508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24ac156900 msgr2=0x7f24ac1670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24b0c00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24ac156900 0x7f24ac1670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24b0c00640 1 -- 172.21.15.2:0/2771855508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0009450 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24b0c00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac0ae7d0 0x7f24ac14eeb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f249800c590 tx=0x7f2498007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24a8c00640 1 -- 172.21.15.2:0/2771855508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498012630 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24a8c00640 1 -- 172.21.15.2:0/2771855508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24980127b0 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24a8c00640 1 -- 172.21.15.2:0/2771855508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498012b70 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.441+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac14d110 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.442+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac14d6d0 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.442+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac1491a0 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.443+0000 7f24a8c00640 1 -- 172.21.15.2:0/2771855508 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f249801b400 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.444+0000 7f24a8c00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f248c065150 0x7f248c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.444+0000 7f24a8c00640 1 -- 172.21.15.2:0/2771855508 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2498081e90 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.444+0000 7f24b1600640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f248c065150 0x7f248c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:20.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.445+0000 7f24b1600640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f248c065150 0x7f248c067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f24a0034000 tx=0x7f24a0032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.448+0000 7f24a8c00640 1 -- 172.21.15.2:0/2771855508 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f24ac1491a0 con 0x7f24ac0ae7d0 2024-08-17T02:47:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:20.659+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000943317", "target": ["mon-mgr", ""]}) v1 -- 0x7f24ac1491a0 con 0x7f248c065150 2024-08-17T02:47:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.517+0000 7f24a8c00640 1 -- 172.21.15.2:0/2771855508 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f24ac1491a0 con 0x7f248c065150 2024-08-17T02:47:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:47:23.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.523+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f248c065150 msgr2=0x7f248c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.523+0000 7f24b2a00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f248c065150 0x7f248c067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f24a0034000 tx=0x7f24a0032000 comp rx=0 tx=0).stop 2024-08-17T02:47:23.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.523+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac0ae7d0 msgr2=0x7f24ac14eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.523+0000 7f24b2a00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac0ae7d0 0x7f24ac14eeb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f249800c590 tx=0x7f2498007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.524+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 shutdown_connections 2024-08-17T02:47:23.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.524+0000 7f24b2a00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24ac156900 0x7f24ac1670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.524+0000 7f24b2a00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24ac0ae7d0 0x7f24ac14eeb0 secure :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f249800c590 tx=0x7f2498007ef0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.524+0000 7f24b2a00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f248c065150 0x7f248c067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.524+0000 7f24b2a00640 1 --2- 172.21.15.2:0/2771855508 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24ac0ae180 0x7f24ac14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.524+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 >> 172.21.15.2:0/2771855508 conn(0x7f24ac067930 msgr2=0x7f24ac0aab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:23.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.525+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 shutdown_connections 2024-08-17T02:47:23.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.526+0000 7f24b2a00640 1 -- 172.21.15.2:0/2771855508 wait complete. 2024-08-17T02:47:23.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:47:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.725+0000 7f8282600640 1 Processor -- start 2024-08-17T02:47:23.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.725+0000 7f8282600640 1 -- start start 2024-08-17T02:47:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f8282600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f8282600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c0b14e0 con 0x7f827c069d40 2024-08-17T02:47:23.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f8282600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c069210 con 0x7f827c159100 2024-08-17T02:47:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f8282600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c0694f0 con 0x7f827c0af1f0 2024-08-17T02:47:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f827c069d40 0x7f827c0cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48770/0 (socket says 172.21.15.2:48770) 2024-08-17T02:47:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827be00640 1 -- 172.21.15.2:0/181371853 learned_addr learned my addr 172.21.15.2:0/181371853 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827aa00640 1 --2- 172.21.15.2:0/181371853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827a000640 1 -- 172.21.15.2:0/181371853 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528552344 0 0) 0x7f827c0b14e0 con 0x7f827c069d40 2024-08-17T02:47:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827a000640 1 -- 172.21.15.2:0/181371853 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82600034e0 con 0x7f827c069d40 2024-08-17T02:47:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827a000640 1 -- 172.21.15.2:0/181371853 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976044906 0 0) 0x7f827c069210 con 0x7f827c159100 2024-08-17T02:47:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827a000640 1 -- 172.21.15.2:0/181371853 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f827c0b14e0 con 0x7f827c159100 2024-08-17T02:47:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827aa00640 1 -- 172.21.15.2:0/181371853 >> v1:172.21.15.26:6789/0 conn(0x7f827c159100 legacy=0x7f827c0aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827aa00640 1 -- 172.21.15.2:0/181371853 >> v1:172.21.15.2:6789/0 conn(0x7f827c069d40 legacy=0x7f827c0cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.726+0000 7f827aa00640 1 -- 172.21.15.2:0/181371853 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0697d0 con 0x7f827c0af1f0 2024-08-17T02:47:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.727+0000 7f827aa00640 1 --2- 172.21.15.2:0/181371853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0ccc30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8268009880 tx=0x7f82680090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd1fd22673ea56c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f827a000640 1 -- 172.21.15.2:0/181371853 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826802ad80 con 0x7f827c0af1f0 2024-08-17T02:47:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f827a000640 1 -- 172.21.15.2:0/181371853 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268032440 con 0x7f827c0af1f0 2024-08-17T02:47:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f827a000640 1 -- 172.21.15.2:0/181371853 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680327e0 con 0x7f827c0af1f0 2024-08-17T02:47:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f8282600640 1 -- 172.21.15.2:0/181371853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 msgr2=0x7f827c0ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f8282600640 1 --2- 172.21.15.2:0/181371853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0ccc30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8268009880 tx=0x7f82680090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f8282600640 1 -- 172.21.15.2:0/181371853 shutdown_connections 2024-08-17T02:47:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f8282600640 1 --2- 172.21.15.2:0/181371853 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0ccc30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f8282600640 1 -- 172.21.15.2:0/181371853 >> 172.21.15.2:0/181371853 conn(0x7f827c0ce5e0 msgr2=0x7f827c095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f8282600640 1 -- 172.21.15.2:0/181371853 shutdown_connections 2024-08-17T02:47:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.728+0000 7f8282600640 1 -- 172.21.15.2:0/181371853 wait complete. 2024-08-17T02:47:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.731+0000 7f8282600640 1 Processor -- start 2024-08-17T02:47:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.731+0000 7f8282600640 1 -- start start 2024-08-17T02:47:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8282600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c069d40 0x7f827c169cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8282600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8282600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f827c159100 0x7f827c0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8282600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c0c6880 con 0x7f827c159100 2024-08-17T02:47:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8282600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c16a640 con 0x7f827c069d40 2024-08-17T02:47:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8282600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c0c5fe0 con 0x7f827c0af1f0 2024-08-17T02:47:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f827c159100 0x7f827c0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f827c159100 0x7f827c0999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41676/0 (socket says 172.21.15.2:41676) 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 -- 172.21.15.2:0/1433595406 learned_addr learned my addr 172.21.15.2:0/1433595406 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827aa00640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827b400640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c069d40 0x7f827c169cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 -- 172.21.15.2:0/1433595406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 msgr2=0x7f827c0c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 -- 172.21.15.2:0/1433595406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c069d40 msgr2=0x7f827c169cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c069d40 0x7f827c169cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 -- 172.21.15.2:0/1433595406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268009390 con 0x7f827c159100 2024-08-17T02:47:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f827be00640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f827c159100 0x7f827c0999f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f827400cc90 tx=0x7f8274001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8272a00640 1 -- 172.21.15.2:0/1433595406 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827400a850 con 0x7f827c159100 2024-08-17T02:47:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8272a00640 1 -- 172.21.15.2:0/1433595406 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827400a9b0 con 0x7f827c159100 2024-08-17T02:47:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8272a00640 1 -- 172.21.15.2:0/1433595406 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827400ad50 con 0x7f827c159100 2024-08-17T02:47:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c0c62c0 con 0x7f827c159100 2024-08-17T02:47:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.732+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c16a230 con 0x7f827c159100 2024-08-17T02:47:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.733+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c16a7d0 con 0x7f827c159100 2024-08-17T02:47:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.734+0000 7f8272a00640 1 -- 172.21.15.2:0/1433595406 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8274007300 con 0x7f827c159100 2024-08-17T02:47:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.735+0000 7f8272a00640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f825c065150 0x7f825c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.735+0000 7f8272a00640 1 -- 172.21.15.2:0/1433595406 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f82740829f0 con 0x7f827c159100 2024-08-17T02:47:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.735+0000 7f827b400640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f825c065150 0x7f825c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.736+0000 7f827b400640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f825c065150 0x7f825c067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f826c0037e0 tx=0x7f826c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:23.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.740+0000 7f8272a00640 1 -- 172.21.15.2:0/1433595406 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f82740507d0 con 0x7f827c159100 2024-08-17T02:47:23.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.948+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f827c063fb0 con 0x7f825c065150 2024-08-17T02:47:23.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.949+0000 7f8272a00640 1 -- 172.21.15.2:0/1433595406 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f827c063fb0 con 0x7f825c065150 2024-08-17T02:47:23.950 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-08-17T02:47:23.950 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:23.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2024-08-17T02:47:23.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-08-17T02:47:23.951 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-08-17T02:47:23.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volume_0000000000943317" 2024-08-17T02:47:23.951 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-08-17T02:47:23.951 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-08-17T02:47:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f825c065150 msgr2=0x7f825c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f825c065150 0x7f825c067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f826c0037e0 tx=0x7f826c009040 comp rx=0 tx=0).stop 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f827c159100 msgr2=0x7f827c0999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f827c159100 0x7f827c0999f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f827400cc90 tx=0x7f8274001ae0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 shutdown_connections 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f827c159100 0x7f827c0999f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f825c065150 0x7f825c067600 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f827c0af1f0 0x7f827c0c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 --2- 172.21.15.2:0/1433595406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f827c069d40 0x7f827c169cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 >> 172.21.15.2:0/1433595406 conn(0x7f827c0ce5e0 msgr2=0x7f827c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:23.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 shutdown_connections 2024-08-17T02:47:23.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:23.952+0000 7f8282600640 1 -- 172.21.15.2:0/1433595406 wait complete. 2024-08-17T02:47:23.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:47:24.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.122+0000 7f5445000640 1 Processor -- start 2024-08-17T02:47:24.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.122+0000 7f5445000640 1 -- start start 2024-08-17T02:47:24.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5445000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f54400afca0 0x7f54400b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5445000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54400acf10 0x7f5440159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5445000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544015a4e0 con 0x7f54401589a0 2024-08-17T02:47:24.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5445000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400b0980 con 0x7f54400acf10 2024-08-17T02:47:24.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5445000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400c92b0 con 0x7f54400afca0 2024-08-17T02:47:24.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5437e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f54400acf10 0x7f5440159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f543e800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f54401589a0 0x7f5440158de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48778/0 (socket says 172.21.15.2:48778) 2024-08-17T02:47:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f543e800640 1 -- 172.21.15.2:0/2245250562 learned_addr learned my addr 172.21.15.2:0/2245250562 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:24.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f543de00640 1 --2- 172.21.15.2:0/2245250562 >> v2:172.21.15.26:3300/0 conn(0x7f54400afca0 0x7f54400b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5437e00640 1 -- 172.21.15.2:0/2245250562 >> v2:172.21.15.26:3300/0 conn(0x7f54400afca0 msgr2=0x7f54400b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5437e00640 1 --2- 172.21.15.2:0/2245250562 >> v2:172.21.15.26:3300/0 conn(0x7f54400afca0 0x7f54400b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5437e00640 1 -- 172.21.15.2:0/2245250562 >> v1:172.21.15.2:6789/0 conn(0x7f54401589a0 legacy=0x7f5440158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f5437e00640 1 -- 172.21.15.2:0/2245250562 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400ad480 con 0x7f54400acf10 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.123+0000 7f543de00640 1 --2- 172.21.15.2:0/2245250562 >> v2:172.21.15.26:3300/0 conn(0x7f54400afca0 0x7f54400b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.124+0000 7f5437e00640 1 --2- 172.21.15.2:0/2245250562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400acf10 0x7f5440159fa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5440067e40 tx=0x7f54280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b88a516c1fc96ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.124+0000 7f543d400640 1 -- 172.21.15.2:0/2245250562 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542802adb0 con 0x7f54400acf10 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.124+0000 7f543d400640 1 -- 172.21.15.2:0/2245250562 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428032440 con 0x7f54400acf10 2024-08-17T02:47:24.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.124+0000 7f543d400640 1 -- 172.21.15.2:0/2245250562 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428032820 con 0x7f54400acf10 2024-08-17T02:47:24.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.124+0000 7f5445000640 1 -- 172.21.15.2:0/2245250562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400acf10 msgr2=0x7f5440159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.124+0000 7f5445000640 1 --2- 172.21.15.2:0/2245250562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400acf10 0x7f5440159fa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5440067e40 tx=0x7f54280090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.125+0000 7f5445000640 1 -- 172.21.15.2:0/2245250562 shutdown_connections 2024-08-17T02:47:24.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.125+0000 7f5445000640 1 --2- 172.21.15.2:0/2245250562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400acf10 0x7f5440159fa0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.125+0000 7f5445000640 1 --2- 172.21.15.2:0/2245250562 >> v2:172.21.15.26:3300/0 conn(0x7f54400afca0 0x7f54400b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.125+0000 7f5445000640 1 -- 172.21.15.2:0/2245250562 >> 172.21.15.2:0/2245250562 conn(0x7f5440066e60 msgr2=0x7f5440067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.125+0000 7f5445000640 1 -- 172.21.15.2:0/2245250562 shutdown_connections 2024-08-17T02:47:24.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.125+0000 7f5445000640 1 -- 172.21.15.2:0/2245250562 wait complete. 2024-08-17T02:47:24.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.126+0000 7f5445000640 1 Processor -- start 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.126+0000 7f5445000640 1 -- start start 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5445000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400acf10 0x7f544014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5445000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400afca0 0x7f5440157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5445000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54401589a0 0x7f5440147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5445000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544014bda0 con 0x7f54400afca0 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5445000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440158380 con 0x7f54400acf10 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5445000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544014b470 con 0x7f54401589a0 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5437e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400afca0 0x7f5440157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5437e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400afca0 0x7f5440157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41704/0 (socket says 172.21.15.2:41704) 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.127+0000 7f5437e00640 1 -- 172.21.15.2:0/3471533285 learned_addr learned my addr 172.21.15.2:0/3471533285 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f543de00640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400acf10 0x7f544014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f543e800640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54401589a0 0x7f5440147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5437e00640 1 -- 172.21.15.2:0/3471533285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54401589a0 msgr2=0x7f5440147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5437e00640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54401589a0 0x7f5440147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5437e00640 1 -- 172.21.15.2:0/3471533285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400acf10 msgr2=0x7f544014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5437e00640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400acf10 0x7f544014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5437e00640 1 -- 172.21.15.2:0/3471533285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428009390 con 0x7f54400afca0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5437e00640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400afca0 0x7f5440157d10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5428009360 tx=0x7f5428032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5435600640 1 -- 172.21.15.2:0/3471533285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428031dc0 con 0x7f54400afca0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5435600640 1 -- 172.21.15.2:0/3471533285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428000c40 con 0x7f54400afca0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5435600640 1 -- 172.21.15.2:0/3471533285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542803d670 con 0x7f54400afca0 2024-08-17T02:47:24.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.128+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544014b750 con 0x7f54400afca0 2024-08-17T02:47:24.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.129+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544006ab40 con 0x7f54400afca0 2024-08-17T02:47:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.130+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544014bf50 con 0x7f54400afca0 2024-08-17T02:47:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.130+0000 7f5435600640 1 -- 172.21.15.2:0/3471533285 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5428039040 con 0x7f54400afca0 2024-08-17T02:47:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.131+0000 7f5435600640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f541c065150 0x7f541c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.131+0000 7f5435600640 1 -- 172.21.15.2:0/3471533285 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f54280a2740 con 0x7f54400afca0 2024-08-17T02:47:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.131+0000 7f543de00640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f541c065150 0x7f541c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.132+0000 7f543de00640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f541c065150 0x7f541c067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5430006e70 tx=0x7f5430008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.135+0000 7f5435600640 1 -- 172.21.15.2:0/3471533285 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f544014bf50 con 0x7f54400afca0 2024-08-17T02:47:24.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.324+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f544014bbd0 con 0x7f54400afca0 2024-08-17T02:47:24.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.324+0000 7f5435600640 1 -- 172.21.15.2:0/3471533285 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v37) v1 ==== 97+0+8037 (secure 0 0 0) 0x7f54280703e0 con 0x7f54400afca0 2024-08-17T02:47:24.324 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:24.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f541c065150 msgr2=0x7f541c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f541c065150 0x7f541c067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5430006e70 tx=0x7f5430008040 comp rx=0 tx=0).stop 2024-08-17T02:47:24.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400afca0 msgr2=0x7f5440157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400afca0 0x7f5440157d10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5428009360 tx=0x7f5428032000 comp rx=0 tx=0).stop 2024-08-17T02:47:24.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 shutdown_connections 2024-08-17T02:47:24.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f541c065150 0x7f541c067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f54401589a0 0x7f5440147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54400afca0 0x7f5440157d10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 --2- 172.21.15.2:0/3471533285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f54400acf10 0x7f544014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 >> 172.21.15.2:0/3471533285 conn(0x7f5440066e60 msgr2=0x7f5440152450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 shutdown_connections 2024-08-17T02:47:24.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.326+0000 7f5445000640 1 -- 172.21.15.2:0/3471533285 wait complete. 2024-08-17T02:47:24.341 INFO:teuthology.orchestra.run.smithi002.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:07.966246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:08.880865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000943317.meta","create_time":"2024-08-17T02:47:20.701176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000943317"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000943317.data","create_time":"2024-08-17T02:47:21.560605+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000943317"}}}] 2024-08-17T02:47:24.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000943317 --format=json 2024-08-17T02:47:24.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.495+0000 7f95c0a00640 1 Processor -- start 2024-08-17T02:47:24.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.495+0000 7f95c0a00640 1 -- start start 2024-08-17T02:47:24.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95c0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95bc0aff00 0x7f95bc159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95c0a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0ae7f0 0x7f95bc0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95c0a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95bc0b18a0 0x7f95bc0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95c0a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc1597b0 con 0x7f95bc0aff00 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95c0a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0ccd10 con 0x7f95bc0b18a0 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95c0a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0ccff0 con 0x7f95bc0ae7f0 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95ba800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95bc0aff00 0x7f95bc159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95ba800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95bc0aff00 0x7f95bc159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41718/0 (socket says 172.21.15.2:41718) 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95ba800640 1 -- 172.21.15.2:0/2903266696 learned_addr learned my addr 172.21.15.2:0/2903266696 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95b9e00640 1 --2- 172.21.15.2:0/2903266696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0ae7f0 0x7f95bc0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95ba800640 1 -- 172.21.15.2:0/2903266696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0ae7f0 msgr2=0x7f95bc0cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:24.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.496+0000 7f95bb200640 1 --2- 172.21.15.2:0/2903266696 >> v2:172.21.15.26:3300/0 conn(0x7f95bc0b18a0 0x7f95bc0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.497+0000 7f95ba800640 1 --2- 172.21.15.2:0/2903266696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0ae7f0 0x7f95bc0cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.497+0000 7f95ba800640 1 -- 172.21.15.2:0/2903266696 >> v2:172.21.15.26:3300/0 conn(0x7f95bc0b18a0 msgr2=0x7f95bc0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.497+0000 7f95ba800640 1 --2- 172.21.15.2:0/2903266696 >> v2:172.21.15.26:3300/0 conn(0x7f95bc0b18a0 0x7f95bc0b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.497+0000 7f95ba800640 1 -- 172.21.15.2:0/2903266696 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc159440 con 0x7f95bc0aff00 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.497+0000 7f95b9e00640 1 --2- 172.21.15.2:0/2903266696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0ae7f0 0x7f95bc0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:24.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.497+0000 7f95bb200640 1 --2- 172.21.15.2:0/2903266696 >> v2:172.21.15.26:3300/0 conn(0x7f95bc0b18a0 0x7f95bc0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.498+0000 7f95ba800640 1 --2- 172.21.15.2:0/2903266696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc159c40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f95bc088fb0 tx=0x7f95ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e43e14edc06d1d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.498+0000 7f95b9400640 1 -- 172.21.15.2:0/2903266696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac02add0 con 0x7f95bc0aff00 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.498+0000 7f95b9400640 1 -- 172.21.15.2:0/2903266696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac032440 con 0x7f95bc0aff00 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.498+0000 7f95b9400640 1 -- 172.21.15.2:0/2903266696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac032820 con 0x7f95bc0aff00 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.498+0000 7f95c0a00640 1 -- 172.21.15.2:0/2903266696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 msgr2=0x7f95bc159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.498+0000 7f95c0a00640 1 --2- 172.21.15.2:0/2903266696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc159c40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f95bc088fb0 tx=0x7f95ac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.499+0000 7f95c0a00640 1 -- 172.21.15.2:0/2903266696 shutdown_connections 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.499+0000 7f95c0a00640 1 --2- 172.21.15.2:0/2903266696 >> v2:172.21.15.26:3300/0 conn(0x7f95bc0b18a0 0x7f95bc0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.499+0000 7f95c0a00640 1 --2- 172.21.15.2:0/2903266696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0ae7f0 0x7f95bc0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.499+0000 7f95c0a00640 1 --2- 172.21.15.2:0/2903266696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc159c40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.499+0000 7f95c0a00640 1 -- 172.21.15.2:0/2903266696 >> 172.21.15.2:0/2903266696 conn(0x7f95bc06e590 msgr2=0x7f95bc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.499+0000 7f95c0a00640 1 -- 172.21.15.2:0/2903266696 shutdown_connections 2024-08-17T02:47:24.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.499+0000 7f95c0a00640 1 -- 172.21.15.2:0/2903266696 wait complete. 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.500+0000 7f95c0a00640 1 Processor -- start 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.500+0000 7f95c0a00640 1 -- start start 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95c0a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95bc0ae7f0 0x7f95bc147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95c0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc0c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95c0a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0b18a0 0x7f95bc0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95c0a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c6070 con 0x7f95bc0aff00 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95c0a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c6350 con 0x7f95bc0ae7f0 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95c0a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c6630 con 0x7f95bc0b18a0 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95b9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95b9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc0c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41732/0 (socket says 172.21.15.2:41732) 2024-08-17T02:47:24.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95b9e00640 1 -- 172.21.15.2:0/438831862 learned_addr learned my addr 172.21.15.2:0/438831862 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95bb200640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0b18a0 0x7f95bc0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.501+0000 7f95ba800640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95bc0ae7f0 0x7f95bc147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b9e00640 1 -- 172.21.15.2:0/438831862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0b18a0 msgr2=0x7f95bc0c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b9e00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0b18a0 0x7f95bc0c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b9e00640 1 -- 172.21.15.2:0/438831862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95bc0ae7f0 msgr2=0x7f95bc147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b9e00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95bc0ae7f0 0x7f95bc147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b9e00640 1 -- 172.21.15.2:0/438831862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac009450 con 0x7f95bc0aff00 2024-08-17T02:47:24.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b9e00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc0c7c20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f95a800c880 tx=0x7f95a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b2000640 1 -- 172.21.15.2:0/438831862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8007620 con 0x7f95bc0aff00 2024-08-17T02:47:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b2000640 1 -- 172.21.15.2:0/438831862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8007780 con 0x7f95bc0aff00 2024-08-17T02:47:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95b2000640 1 -- 172.21.15.2:0/438831862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8007b00 con 0x7f95bc0aff00 2024-08-17T02:47:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc0c6910 con 0x7f95bc0aff00 2024-08-17T02:47:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.502+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc148330 con 0x7f95bc0aff00 2024-08-17T02:47:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.503+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc0c38b0 con 0x7f95bc0aff00 2024-08-17T02:47:24.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.504+0000 7f95b2000640 1 -- 172.21.15.2:0/438831862 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95a80113f0 con 0x7f95bc0aff00 2024-08-17T02:47:24.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.505+0000 7f95b2000640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f959c065150 0x7f959c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.505+0000 7f95b2000640 1 -- 172.21.15.2:0/438831862 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f95a8082850 con 0x7f95bc0aff00 2024-08-17T02:47:24.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.505+0000 7f95ba800640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f959c065150 0x7f959c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.506+0000 7f95ba800640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f959c065150 0x7f959c067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95ac034000 tx=0x7f95ac032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.509+0000 7f95b2000640 1 -- 172.21.15.2:0/438831862 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95a80504f0 con 0x7f95bc0aff00 2024-08-17T02:47:24.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.733+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000943317", "format": "json"} v 0) v1 -- 0x7f95bc070720 con 0x7f95bc0aff00 2024-08-17T02:47:24.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.733+0000 7f95b2000640 1 -- 172.21.15.2:0/438831862 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000943317", "format": "json"}]=0 v20) v1 ==== 110+0+1841 (secure 0 0 0) 0x7f95a8053b10 con 0x7f95bc0aff00 2024-08-17T02:47:24.733 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:47:24.733 INFO:teuthology.orchestra.run.smithi002.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:22.521281+0000","modified":"2024-08-17T02:47:24.261416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4953},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4953":{"gid":4953,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000943317","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:47:24.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f959c065150 msgr2=0x7f959c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f959c065150 0x7f959c067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95ac034000 tx=0x7f95ac032000 comp rx=0 tx=0).stop 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 msgr2=0x7f95bc0c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc0c7c20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f95a800c880 tx=0x7f95a8008040 comp rx=0 tx=0).stop 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 shutdown_connections 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f959c065150 0x7f959c067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f95bc0b18a0 0x7f95bc0c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95bc0aff00 0x7f95bc0c7c20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 --2- 172.21.15.2:0/438831862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95bc0ae7f0 0x7f95bc147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 >> 172.21.15.2:0/438831862 conn(0x7f95bc06e590 msgr2=0x7f95bc15bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.735+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 shutdown_connections 2024-08-17T02:47:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.736+0000 7f95c0a00640 1 -- 172.21.15.2:0/438831862 wait complete. 2024-08-17T02:47:24.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000943317 --yes-i-really-mean-it 2024-08-17T02:47:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.905+0000 7f03e5600640 1 Processor -- start 2024-08-17T02:47:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.905+0000 7f03e5600640 1 -- start start 2024-08-17T02:47:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.906+0000 7f03e5600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f03e00ad960 0x7f03e015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.906+0000 7f03e5600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f03e00ca050 0x7f03e0156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.906+0000 7f03e5600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e015b5e0 con 0x7f03e00add30 2024-08-17T02:47:24.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.906+0000 7f03e5600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00cb160 con 0x7f03e00ca050 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03e5600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00b0d10 con 0x7f03e00ad960 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03df400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f03e00add30 0x7f03e0156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48788/0 (socket says 172.21.15.2:48788) 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03df400640 1 -- 172.21.15.2:0/2044916523 learned_addr learned my addr 172.21.15.2:0/2044916523 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03d7e00640 1 --2- 172.21.15.2:0/2044916523 >> v2:172.21.15.2:3300/0 conn(0x7f03e00ca050 0x7f03e0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03dea00640 1 --2- 172.21.15.2:0/2044916523 >> v2:172.21.15.26:3300/0 conn(0x7f03e00ad960 0x7f03e015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03de000640 1 -- 172.21.15.2:0/2044916523 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270421415 0 0) 0x7f03d8001490 con 0x7f03e00add30 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03de000640 1 -- 172.21.15.2:0/2044916523 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c40034e0 con 0x7f03e00add30 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03d7e00640 1 -- 172.21.15.2:0/2044916523 >> v2:172.21.15.26:3300/0 conn(0x7f03e00ad960 msgr2=0x7f03e015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03d7e00640 1 --2- 172.21.15.2:0/2044916523 >> v2:172.21.15.26:3300/0 conn(0x7f03e00ad960 0x7f03e015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03d7e00640 1 -- 172.21.15.2:0/2044916523 >> v1:172.21.15.2:6789/0 conn(0x7f03e00add30 legacy=0x7f03e0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.907+0000 7f03d7e00640 1 -- 172.21.15.2:0/2044916523 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00ca550 con 0x7f03e00ca050 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.908+0000 7f03d7e00640 1 --2- 172.21.15.2:0/2044916523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e00ca050 0x7f03e0156420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f03e00cc910 tx=0x7f03c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fdf63466671465 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03de000640 1 -- 172.21.15.2:0/2044916523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c802ae40 con 0x7f03e00ca050 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03de000640 1 -- 172.21.15.2:0/2044916523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c8032440 con 0x7f03e00ca050 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03de000640 1 -- 172.21.15.2:0/2044916523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8032800 con 0x7f03e00ca050 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03e5600640 1 -- 172.21.15.2:0/2044916523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e00ca050 msgr2=0x7f03e0156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03e5600640 1 --2- 172.21.15.2:0/2044916523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e00ca050 0x7f03e0156420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f03e00cc910 tx=0x7f03c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03e5600640 1 -- 172.21.15.2:0/2044916523 shutdown_connections 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03e5600640 1 --2- 172.21.15.2:0/2044916523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e00ca050 0x7f03e0156420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03e5600640 1 --2- 172.21.15.2:0/2044916523 >> v2:172.21.15.26:3300/0 conn(0x7f03e00ad960 0x7f03e015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03e5600640 1 -- 172.21.15.2:0/2044916523 >> 172.21.15.2:0/2044916523 conn(0x7f03e0066e60 msgr2=0x7f03e0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:47:24.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03e5600640 1 -- 172.21.15.2:0/2044916523 shutdown_connections 2024-08-17T02:47:24.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.909+0000 7f03e5600640 1 -- 172.21.15.2:0/2044916523 wait complete. 2024-08-17T02:47:24.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.911+0000 7f03e5600640 1 Processor -- start 2024-08-17T02:47:24.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.911+0000 7f03e5600640 1 -- start start 2024-08-17T02:47:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03e5600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00ad960 0x7f03e0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03e5600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e00add30 0x7f03e0144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03e5600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e00ca050 0x7f03e00af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03e5600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0151550 con 0x7f03e00ca050 2024-08-17T02:47:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03e5600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0144940 con 0x7f03e00add30 2024-08-17T02:47:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03e5600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0158290 con 0x7f03e00ad960 2024-08-17T02:47:24.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03df400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e00ca050 0x7f03e00af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03df400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e00ca050 0x7f03e00af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41750/0 (socket says 172.21.15.2:41750) 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03df400640 1 -- 172.21.15.2:0/3580518511 learned_addr learned my addr 172.21.15.2:0/3580518511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03d7e00640 1 --2- 172.21.15.2:0/3580518511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e00add30 0x7f03e0144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.912+0000 7f03dea00640 1 --2- 172.21.15.2:0/3580518511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00ad960 0x7f03e0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03df400640 1 -- 172.21.15.2:0/3580518511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00ad960 msgr2=0x7f03e0157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03df400640 1 --2- 172.21.15.2:0/3580518511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f03e00ad960 0x7f03e0157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03df400640 1 -- 172.21.15.2:0/3580518511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e00add30 msgr2=0x7f03e0144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03df400640 1 --2- 172.21.15.2:0/3580518511 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f03e00add30 0x7f03e0144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03df400640 1 -- 172.21.15.2:0/3580518511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8009390 con 0x7f03e00ca050 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03df400640 1 --2- 172.21.15.2:0/3580518511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03e00ca050 0x7f03e00af0b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f03d800cd00 tx=0x7f03d8001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03d6000640 1 -- 172.21.15.2:0/3580518511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800a850 con 0x7f03e00ca050 2024-08-17T02:47:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03d6000640 1 -- 172.21.15.2:0/3580518511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d800a9b0 con 0x7f03e00ca050 2024-08-17T02:47:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03d6000640 1 -- 172.21.15.2:0/3580518511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800ad70 con 0x7f03e00ca050 2024-08-17T02:47:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03e5600640 1 -- 172.21.15.2:0/3580518511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e00a4ea0 con 0x7f03e00ca050 2024-08-17T02:47:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.913+0000 7f03e5600640 1 -- 172.21.15.2:0/3580518511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e00a5420 con 0x7f03e00ca050 2024-08-17T02:47:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.914+0000 7f03e5600640 1 -- 172.21.15.2:0/3580518511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e006b840 con 0x7f03e00ca050 2024-08-17T02:47:24.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.915+0000 7f03d6000640 1 -- 172.21.15.2:0/3580518511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f03d8007300 con 0x7f03e00ca050 2024-08-17T02:47:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.916+0000 7f03d6000640 1 --2- 172.21.15.2:0/3580518511 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03bc065150 0x7f03bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:47:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.916+0000 7f03d6000640 1 -- 172.21.15.2:0/3580518511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f03d8082770 con 0x7f03e00ca050 2024-08-17T02:47:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.916+0000 7f03dea00640 1 --2- 172.21.15.2:0/3580518511 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03bc065150 0x7f03bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:47:24.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.917+0000 7f03dea00640 1 --2- 172.21.15.2:0/3580518511 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f03bc065150 0x7f03bc067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009c80 tx=0x7f03d00090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:47:24.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:24.920+0000 7f03d6000640 1 -- 172.21.15.2:0/3580518511 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f03e006b840 con 0x7f03e00ca050 2024-08-17T02:47:25.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:47:25.128+0000 7f03e5600640 1 -- 172.21.15.2:0/3580518511 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000943317", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f03e015b5e0 con 0x7f03bc065150 2024-08-17T02:47:26.343 INFO:tasks.ceph.mds.c.smithi002.stderr:2024-08-17T02:47:26.343+0000 7fead3c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:47:39.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:47:39.262 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:09.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:09.361 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:39.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:48:39.452 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:09.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:09.545 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:24.821 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:49:24.822 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:49:24.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:49:24.904 DEBUG:teuthology.orchestra.run.smithi026:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:49:25.001 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:49:25.001 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:49:25.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:49:25.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:49:25.070 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:49:25.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:25.071 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:49:25.108 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:49:25.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:49:25.108 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:49:25.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:49:25.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:25.176 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:49:25.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.366+0000 7f222e200640 1 Processor -- start 2024-08-17T02:49:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.366+0000 7f222e200640 1 -- start start 2024-08-17T02:49:25.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.367+0000 7f222e200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22281590b0 0x7f22280b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.367+0000 7f222e200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22280acf10 0x7f2228159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.367+0000 7f222e200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222815a4e0 con 0x7f22280afca0 2024-08-17T02:49:25.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.367+0000 7f222e200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22280b0980 con 0x7f22280acf10 2024-08-17T02:49:25.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.367+0000 7f222e200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280c92b0 con 0x7f22281590b0 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.367+0000 7f221fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22281590b0 0x7f22280b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.367+0000 7f2227e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f22280acf10 0x7f2228159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.368+0000 7f221fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22281590b0 0x7f22280b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:41506/0 (socket says 172.21.15.2:41506) 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.368+0000 7f221fe00640 1 -- 172.21.15.2:0/383782166 learned_addr learned my addr 172.21.15.2:0/383782166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.368+0000 7f2227400640 1 --1- 172.21.15.2:0/383782166 >> v1:172.21.15.26:6789/0 conn(0x7f22280afca0 0x7f22281589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:43238/0 (socket says 172.21.15.2:43238) 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.368+0000 7f221fe00640 1 -- 172.21.15.2:0/383782166 >> v2:172.21.15.26:3300/0 conn(0x7f22280acf10 msgr2=0x7f2228159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.368+0000 7f221fe00640 1 --2- 172.21.15.2:0/383782166 >> v2:172.21.15.26:3300/0 conn(0x7f22280acf10 0x7f2228159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.368+0000 7f221fe00640 1 -- 172.21.15.2:0/383782166 >> v1:172.21.15.26:6789/0 conn(0x7f22280afca0 legacy=0x7f22281589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.368+0000 7f221fe00640 1 -- 172.21.15.2:0/383782166 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280ad480 con 0x7f22281590b0 2024-08-17T02:49:25.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.368+0000 7f2227e00640 1 --2- 172.21.15.2:0/383782166 >> v2:172.21.15.26:3300/0 conn(0x7f22280acf10 0x7f2228159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:25.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.369+0000 7f221fe00640 1 --2- 172.21.15.2:0/383782166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22281590b0 0x7f22280b0070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2210009910 tx=0x7f22100091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ffcab1d6a9ae7ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:25.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.369+0000 7f2226a00640 1 -- 172.21.15.2:0/383782166 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221002ae40 con 0x7f22281590b0 2024-08-17T02:49:25.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.369+0000 7f2226a00640 1 -- 172.21.15.2:0/383782166 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210032440 con 0x7f22281590b0 2024-08-17T02:49:25.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.369+0000 7f2226a00640 1 -- 172.21.15.2:0/383782166 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210032820 con 0x7f22281590b0 2024-08-17T02:49:25.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.370+0000 7f222e200640 1 -- 172.21.15.2:0/383782166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22281590b0 msgr2=0x7f22280b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.370+0000 7f222e200640 1 --2- 172.21.15.2:0/383782166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22281590b0 0x7f22280b0070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2210009910 tx=0x7f22100091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.370+0000 7f222e200640 1 -- 172.21.15.2:0/383782166 shutdown_connections 2024-08-17T02:49:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.370+0000 7f222e200640 1 --2- 172.21.15.2:0/383782166 >> v2:172.21.15.26:3300/0 conn(0x7f22280acf10 0x7f2228159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.370+0000 7f222e200640 1 --2- 172.21.15.2:0/383782166 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22281590b0 0x7f22280b0070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.370+0000 7f222e200640 1 -- 172.21.15.2:0/383782166 >> 172.21.15.2:0/383782166 conn(0x7f2228066e60 msgr2=0x7f2228067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.370+0000 7f222e200640 1 -- 172.21.15.2:0/383782166 shutdown_connections 2024-08-17T02:49:25.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.370+0000 7f222e200640 1 -- 172.21.15.2:0/383782166 wait complete. 2024-08-17T02:49:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.371+0000 7f222e200640 1 Processor -- start 2024-08-17T02:49:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.372+0000 7f222e200640 1 -- start start 2024-08-17T02:49:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.372+0000 7f222e200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22280acf10 0x7f22281522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.372+0000 7f222e200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22280afca0 0x7f2228153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.372+0000 7f222e200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22281590b0 0x7f2228153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.372+0000 7f222e200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228168df0 con 0x7f22280acf10 2024-08-17T02:49:25.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.372+0000 7f222e200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281690b0 con 0x7f22281590b0 2024-08-17T02:49:25.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.372+0000 7f222e200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2228169390 con 0x7f22280afca0 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22280acf10 0x7f22281522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22280acf10 0x7f22281522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32802/0 (socket says 172.21.15.2:32802) 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227400640 1 -- 172.21.15.2:0/2357623933 learned_addr learned my addr 172.21.15.2:0/2357623933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f221fe00640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22280afca0 0x7f2228153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227e00640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22281590b0 0x7f2228153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227400640 1 -- 172.21.15.2:0/2357623933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22280afca0 msgr2=0x7f2228153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227400640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22280afca0 0x7f2228153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227400640 1 -- 172.21.15.2:0/2357623933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22281590b0 msgr2=0x7f2228153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227400640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22281590b0 0x7f2228153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.373+0000 7f2227400640 1 -- 172.21.15.2:0/2357623933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220009a20 con 0x7f22280acf10 2024-08-17T02:49:25.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.374+0000 7f2227400640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22280acf10 0x7f22281522c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f221800c590 tx=0x7f2218007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:25.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.374+0000 7f221ea00640 1 -- 172.21.15.2:0/2357623933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218007300 con 0x7f22280acf10 2024-08-17T02:49:25.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.374+0000 7f221ea00640 1 -- 172.21.15.2:0/2357623933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22180074a0 con 0x7f22280acf10 2024-08-17T02:49:25.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.374+0000 7f221ea00640 1 -- 172.21.15.2:0/2357623933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22180047a0 con 0x7f22280acf10 2024-08-17T02:49:25.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.374+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2210009450 con 0x7f22280acf10 2024-08-17T02:49:25.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.374+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2228169950 con 0x7f22280acf10 2024-08-17T02:49:25.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.375+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2228063fb0 con 0x7f22280acf10 2024-08-17T02:49:25.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.376+0000 7f221ea00640 1 -- 172.21.15.2:0/2357623933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2218004bd0 con 0x7f22280acf10 2024-08-17T02:49:25.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.377+0000 7f221ea00640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2204065150 0x7f2204067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.377+0000 7f221ea00640 1 -- 172.21.15.2:0/2357623933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2218081620 con 0x7f22280acf10 2024-08-17T02:49:25.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.377+0000 7f221fe00640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2204065150 0x7f2204067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.378+0000 7f221fe00640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2204065150 0x7f2204067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2210034000 tx=0x7f2210032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:25.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.381+0000 7f221ea00640 1 -- 172.21.15.2:0/2357623933 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f221804be40 con 0x7f22280acf10 2024-08-17T02:49:25.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.605+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f222815a4e0 con 0x7f22280acf10 2024-08-17T02:49:25.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.605+0000 7f221ea00640 1 -- 172.21.15.2:0/2357623933 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5678 (secure 0 0 0) 0x7f222815a4e0 con 0x7f22280acf10 2024-08-17T02:49:25.607 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:25.607 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:09.888633+0000","modified":"2024-08-17T02:47:13.482114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.2:6837/1889487336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1889487336},{"type":"v1","addr":"172.21.15.2:6837","nonce":1889487336}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:22.521281+0000","modified":"2024-08-17T02:47:24.261416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4953},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4953":{"gid":4953,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000943317","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:25.608 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-08-17T02:49:25.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2204065150 msgr2=0x7f2204067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2204065150 0x7f2204067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2210034000 tx=0x7f2210032000 comp rx=0 tx=0).stop 2024-08-17T02:49:25.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22280acf10 msgr2=0x7f22281522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22280acf10 0x7f22281522c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f221800c590 tx=0x7f2218007ee0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 shutdown_connections 2024-08-17T02:49:25.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22281590b0 0x7f2228153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2204065150 0x7f2204067600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f22280afca0 0x7f2228153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 --2- 172.21.15.2:0/2357623933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22280acf10 0x7f22281522c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.607+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 >> 172.21.15.2:0/2357623933 conn(0x7f2228066e60 msgr2=0x7f2228154930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:25.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.608+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 shutdown_connections 2024-08-17T02:49:25.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.608+0000 7f222e200640 1 -- 172.21.15.2:0/2357623933 wait complete. 2024-08-17T02:49:25.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.775+0000 7fe4d6000640 1 Processor -- start 2024-08-17T02:49:25.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.775+0000 7fe4d6000640 1 -- start start 2024-08-17T02:49:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.776+0000 7fe4d6000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4d00afca0 0x7fe4d00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4d6000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00c92b0 con 0x7fe4d00acf10 2024-08-17T02:49:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4d6000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00ad480 con 0x7fe4d01590b0 2024-08-17T02:49:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4d6000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00b0980 con 0x7fe4d00afca0 2024-08-17T02:49:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4cf400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4d00afca0 0x7fe4d00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4c7e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe4d00acf10 0x7fe4d01589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52238/0 (socket says 172.21.15.2:52238) 2024-08-17T02:49:25.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4c7e00640 1 -- 172.21.15.2:0/2509447851 learned_addr learned my addr 172.21.15.2:0/2509447851 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4cf400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4d00afca0 0x7fe4d00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32816/0 (socket says 172.21.15.2:32816) 2024-08-17T02:49:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4cf400640 1 -- 172.21.15.2:0/2509447851 >> v1:172.21.15.26:6789/0 conn(0x7fe4d01590b0 legacy=0x7fe4d00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4cf400640 1 -- 172.21.15.2:0/2509447851 >> v1:172.21.15.2:6789/0 conn(0x7fe4d00acf10 legacy=0x7fe4d01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.777+0000 7fe4cf400640 1 -- 172.21.15.2:0/2509447851 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00ad760 con 0x7fe4d00afca0 2024-08-17T02:49:25.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.778+0000 7fe4cf400640 1 --2- 172.21.15.2:0/2509447851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00b0070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009850 tx=0x7fe4c00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21099f9d79ae8a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4cea00640 1 -- 172.21.15.2:0/2509447851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c002ae20 con 0x7fe4d00afca0 2024-08-17T02:49:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4cea00640 1 -- 172.21.15.2:0/2509447851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c0032440 con 0x7fe4d00afca0 2024-08-17T02:49:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4cea00640 1 -- 172.21.15.2:0/2509447851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0032820 con 0x7fe4d00afca0 2024-08-17T02:49:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4d6000640 1 -- 172.21.15.2:0/2509447851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 msgr2=0x7fe4d00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4d6000640 1 --2- 172.21.15.2:0/2509447851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00b0070 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009850 tx=0x7fe4c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4d6000640 1 -- 172.21.15.2:0/2509447851 shutdown_connections 2024-08-17T02:49:25.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4d6000640 1 --2- 172.21.15.2:0/2509447851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00b0070 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4d6000640 1 -- 172.21.15.2:0/2509447851 >> 172.21.15.2:0/2509447851 conn(0x7fe4d0066e60 msgr2=0x7fe4d0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:25.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4d6000640 1 -- 172.21.15.2:0/2509447851 shutdown_connections 2024-08-17T02:49:25.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.779+0000 7fe4d6000640 1 -- 172.21.15.2:0/2509447851 wait complete. 2024-08-17T02:49:25.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.781+0000 7fe4d6000640 1 Processor -- start 2024-08-17T02:49:25.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.781+0000 7fe4d6000640 1 -- start start 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4d6000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00acf10 0x7fe4d00c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4d6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4d6000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4d01590b0 0x7fe4d015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4d6000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0155df0 con 0x7fe4d00afca0 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4d6000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d01551e0 con 0x7fe4d00acf10 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4d6000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d01554c0 con 0x7fe4d01590b0 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4c7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4c7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32824/0 (socket says 172.21.15.2:32824) 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4c7e00640 1 -- 172.21.15.2:0/3692969164 learned_addr learned my addr 172.21.15.2:0/3692969164 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4cf400640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00acf10 0x7fe4d00c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4cfe00640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4d01590b0 0x7fe4d015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4c7e00640 1 -- 172.21.15.2:0/3692969164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4d01590b0 msgr2=0x7fe4d015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4c7e00640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4d01590b0 0x7fe4d015bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4c7e00640 1 -- 172.21.15.2:0/3692969164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00acf10 msgr2=0x7fe4d00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4c7e00640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00acf10 0x7fe4d00c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.782+0000 7fe4c7e00640 1 -- 172.21.15.2:0/3692969164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0009390 con 0x7fe4d00afca0 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.783+0000 7fe4c7e00640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00c7080 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c590 tx=0x7fe4b8007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.783+0000 7fe4c6a00640 1 -- 172.21.15.2:0/3692969164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8005aa0 con 0x7fe4d00afca0 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.783+0000 7fe4c6a00640 1 -- 172.21.15.2:0/3692969164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b8005c20 con 0x7fe4d00afca0 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.783+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d01557a0 con 0x7fe4d00afca0 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.783+0000 7fe4c6a00640 1 -- 172.21.15.2:0/3692969164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80070f0 con 0x7fe4d00afca0 2024-08-17T02:49:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.783+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d00c75c0 con 0x7fe4d00afca0 2024-08-17T02:49:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.784+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d0155f60 con 0x7fe4d00afca0 2024-08-17T02:49:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.785+0000 7fe4c6a00640 1 -- 172.21.15.2:0/3692969164 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe4b8007540 con 0x7fe4d00afca0 2024-08-17T02:49:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.786+0000 7fe4c6a00640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe4ac065150 0x7fe4ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.786+0000 7fe4c6a00640 1 -- 172.21.15.2:0/3692969164 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe4b8081c20 con 0x7fe4d00afca0 2024-08-17T02:49:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.786+0000 7fe4cf400640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe4ac065150 0x7fe4ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.786+0000 7fe4cf400640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe4ac065150 0x7fe4ac067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0034000 tx=0x7fe4c0032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:25.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.789+0000 7fe4c6a00640 1 -- 172.21.15.2:0/3692969164 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe4b804f940 con 0x7fe4d00afca0 2024-08-17T02:49:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.972+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4d0063fb0 con 0x7fe4d00afca0 2024-08-17T02:49:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.973+0000 7fe4c6a00640 1 -- 172.21.15.2:0/3692969164 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18503 (secure 0 0 0) 0x7fe4b8052f60 con 0x7fe4d00afca0 2024-08-17T02:49:25.975 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:25.975 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:47:24.539782+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:07.966246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:08.880865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000943317.meta","create_time":"2024-08-17T02:47:20.701176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000943317"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000943317.data","create_time":"2024-08-17T02:47:21.560605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000943317"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe4ac065150 msgr2=0x7fe4ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe4ac065150 0x7fe4ac067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0034000 tx=0x7fe4c0032000 comp rx=0 tx=0).stop 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 msgr2=0x7fe4d00c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00c7080 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c590 tx=0x7fe4b8007ee0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 shutdown_connections 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe4ac065150 0x7fe4ac067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe4d01590b0 0x7fe4d015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d00afca0 0x7fe4d00c7080 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 --2- 172.21.15.2:0/3692969164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d00acf10 0x7fe4d00c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:25.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 >> 172.21.15.2:0/3692969164 conn(0x7fe4d0066e60 msgr2=0x7fe4d015d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:25.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 shutdown_connections 2024-08-17T02:49:25.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:25.976+0000 7fe4d6000640 1 -- 172.21.15.2:0/3692969164 wait complete. 2024-08-17T02:49:25.993 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:47:07.966246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:47:08.880865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000943317.meta', 'create_time': '2024-08-17T02:47:20.701176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000943317'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000943317.data', 'create_time': '2024-08-17T02:47:21.560605+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000943317'}}}] 2024-08-17T02:49:25.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:49:26.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.147+0000 7fbaf3c00640 1 Processor -- start 2024-08-17T02:49:26.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.147+0000 7fbaf3c00640 1 -- start start 2024-08-17T02:49:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaf3c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbaec0b1280 0x7fbaec0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaf3c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec0adf90 0x7fbaec0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaf3c00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec0ac040 con 0x7fbaec156bd0 2024-08-17T02:49:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaf3c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec067810 con 0x7fbaec0b1280 2024-08-17T02:49:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaf3c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0ab150 con 0x7fbaec0adf90 2024-08-17T02:49:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaebe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbaec0b1280 0x7fbaec0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaebe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbaec0b1280 0x7fbaec0c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32828/0 (socket says 172.21.15.2:32828) 2024-08-17T02:49:26.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaebe00640 1 -- 172.21.15.2:0/1925611238 learned_addr learned my addr 172.21.15.2:0/1925611238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:26.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.148+0000 7fbaf1c00640 1 --2- 172.21.15.2:0/1925611238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec0adf90 0x7fbaec0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.149+0000 7fbaebe00640 1 -- 172.21.15.2:0/1925611238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec0adf90 msgr2=0x7fbaec0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:26.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.149+0000 7fbaebe00640 1 --2- 172.21.15.2:0/1925611238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec0adf90 0x7fbaec0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.149+0000 7fbaebe00640 1 -- 172.21.15.2:0/1925611238 >> v1:172.21.15.26:6789/0 conn(0x7fbaec156bd0 legacy=0x7fbaec0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.149+0000 7fbaebe00640 1 -- 172.21.15.2:0/1925611238 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec0ab430 con 0x7fbaec0b1280 2024-08-17T02:49:26.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.150+0000 7fbaebe00640 1 --2- 172.21.15.2:0/1925611238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec0c9ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009910 tx=0x7fbad80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2819d3cd4ed9ccb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.150+0000 7fbaeb400640 1 -- 172.21.15.2:0/1925611238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad802ae40 con 0x7fbaec0b1280 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.150+0000 7fbaeb400640 1 -- 172.21.15.2:0/1925611238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad8032440 con 0x7fbaec0b1280 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.150+0000 7fbaeb400640 1 -- 172.21.15.2:0/1925611238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8032820 con 0x7fbaec0b1280 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.151+0000 7fbaf3c00640 1 -- 172.21.15.2:0/1925611238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 msgr2=0x7fbaec0c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.151+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/1925611238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec0c9ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009910 tx=0x7fbad80091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.151+0000 7fbaf3c00640 1 -- 172.21.15.2:0/1925611238 shutdown_connections 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.151+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/1925611238 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec0adf90 0x7fbaec0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.151+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/1925611238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec0c9ee0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.151+0000 7fbaf3c00640 1 -- 172.21.15.2:0/1925611238 >> 172.21.15.2:0/1925611238 conn(0x7fbaec0cc390 msgr2=0x7fbaec066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.151+0000 7fbaf3c00640 1 -- 172.21.15.2:0/1925611238 shutdown_connections 2024-08-17T02:49:26.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.151+0000 7fbaf3c00640 1 -- 172.21.15.2:0/1925611238 wait complete. 2024-08-17T02:49:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.152+0000 7fbaf3c00640 1 Processor -- start 2024-08-17T02:49:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.153+0000 7fbaf3c00640 1 -- start start 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.153+0000 7fbaf3c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbaec0adf90 0x7fbaec1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.153+0000 7fbaf3c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.153+0000 7fbaf3c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec156bd0 0x7fbaec143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.153+0000 7fbaf3c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec15a130 con 0x7fbaec0b1280 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.153+0000 7fbaf3c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec143940 con 0x7fbaec0adf90 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.153+0000 7fbaf3c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0aa0e0 con 0x7fbaec156bd0 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32830/0 (socket says 172.21.15.2:32830) 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaebe00640 1 -- 172.21.15.2:0/3387198001 learned_addr learned my addr 172.21.15.2:0/3387198001 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaf1c00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec156bd0 0x7fbaec143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaf1200640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbaec0adf90 0x7fbaec1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaebe00640 1 -- 172.21.15.2:0/3387198001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec156bd0 msgr2=0x7fbaec143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaebe00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec156bd0 0x7fbaec143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaebe00640 1 -- 172.21.15.2:0/3387198001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbaec0adf90 msgr2=0x7fbaec1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaebe00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbaec0adf90 0x7fbaec1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.154+0000 7fbaebe00640 1 -- 172.21.15.2:0/3387198001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8009450 con 0x7fbaec0b1280 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.155+0000 7fbaebe00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec150f40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbad8035040 tx=0x7fbad8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.155+0000 7fbadfe00640 1 -- 172.21.15.2:0/3387198001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8031bb0 con 0x7fbaec0b1280 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.155+0000 7fbadfe00640 1 -- 172.21.15.2:0/3387198001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad8031d70 con 0x7fbaec0b1280 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.155+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec1504b0 con 0x7fbaec0b1280 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.155+0000 7fbadfe00640 1 -- 172.21.15.2:0/3387198001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad803d670 con 0x7fbaec0b1280 2024-08-17T02:49:26.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.155+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec0a9a90 con 0x7fbaec0b1280 2024-08-17T02:49:26.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.156+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec063fb0 con 0x7fbaec0b1280 2024-08-17T02:49:26.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.157+0000 7fbadfe00640 1 -- 172.21.15.2:0/3387198001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbad8039040 con 0x7fbaec0b1280 2024-08-17T02:49:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.158+0000 7fbadfe00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbacc065150 0x7fbacc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.158+0000 7fbadfe00640 1 -- 172.21.15.2:0/3387198001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fbad802ae40 con 0x7fbaec0b1280 2024-08-17T02:49:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.158+0000 7fbaf1200640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbacc065150 0x7fbacc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.159+0000 7fbaf1200640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbacc065150 0x7fbacc067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbaec15a2d0 tx=0x7fbae0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.162+0000 7fbadfe00640 1 -- 172.21.15.2:0/3387198001 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbad80705f0 con 0x7fbaec0b1280 2024-08-17T02:49:26.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.345+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbaec06a080 con 0x7fbaec0b1280 2024-08-17T02:49:26.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.346+0000 7fbadfe00640 1 -- 172.21.15.2:0/3387198001 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbad8073c10 con 0x7fbaec0b1280 2024-08-17T02:49:26.347 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:49:26.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbacc065150 msgr2=0x7fbacc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbacc065150 0x7fbacc067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbaec15a2d0 tx=0x7fbae0009040 comp rx=0 tx=0).stop 2024-08-17T02:49:26.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 msgr2=0x7fbaec150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec150f40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbad8035040 tx=0x7fbad8032000 comp rx=0 tx=0).stop 2024-08-17T02:49:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 shutdown_connections 2024-08-17T02:49:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fbacc065150 0x7fbacc067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fbaec156bd0 0x7fbaec143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaec0b1280 0x7fbaec150f40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 --2- 172.21.15.2:0/3387198001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbaec0adf90 0x7fbaec1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 >> 172.21.15.2:0/3387198001 conn(0x7fbaec0cc390 msgr2=0x7fbaec153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 shutdown_connections 2024-08-17T02:49:26.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.348+0000 7fbaf3c00640 1 -- 172.21.15.2:0/3387198001 wait complete. 2024-08-17T02:49:26.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:49:26.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.520+0000 7f97a0600640 1 Processor -- start 2024-08-17T02:49:26.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.520+0000 7f97a0600640 1 -- start start 2024-08-17T02:49:26.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.521+0000 7f97a0600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f97980afca0 0x7f97980b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.521+0000 7f97a0600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980c92b0 con 0x7f97981590b0 2024-08-17T02:49:26.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f97a0600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980ad480 con 0x7f97980acf10 2024-08-17T02:49:26.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f97a0600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980b0980 con 0x7f97980afca0 2024-08-17T02:49:26.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f979e600640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f97981590b0 0x7f97980c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52252/0 (socket says 172.21.15.2:52252) 2024-08-17T02:49:26.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f979e600640 1 -- 172.21.15.2:0/4261479764 learned_addr learned my addr 172.21.15.2:0/4261479764 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:26.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f979dc00640 1 --2- 172.21.15.2:0/4261479764 >> v2:172.21.15.26:3300/0 conn(0x7f97980afca0 0x7f97980b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f9797e00640 1 -- 172.21.15.2:0/4261479764 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68137105 0 0) 0x7f97980c92b0 con 0x7f97981590b0 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f9797e00640 1 -- 172.21.15.2:0/4261479764 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97800034e0 con 0x7f97981590b0 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f979dc00640 1 -- 172.21.15.2:0/4261479764 >> v1:172.21.15.26:6789/0 conn(0x7f97980acf10 legacy=0x7f97981589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f979dc00640 1 -- 172.21.15.2:0/4261479764 >> v1:172.21.15.2:6789/0 conn(0x7f97981590b0 legacy=0x7f97980c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.522+0000 7f979dc00640 1 -- 172.21.15.2:0/4261479764 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980ad760 con 0x7f97980afca0 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.524+0000 7f979dc00640 1 --2- 172.21.15.2:0/4261479764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97980afca0 0x7f97980b0070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f978c009850 tx=0x7f978c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34d6c712adf4fdfe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.524+0000 7f9797e00640 1 -- 172.21.15.2:0/4261479764 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c02ae20 con 0x7f97980afca0 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.524+0000 7f9797e00640 1 -- 172.21.15.2:0/4261479764 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c032440 con 0x7f97980afca0 2024-08-17T02:49:26.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.524+0000 7f9797e00640 1 -- 172.21.15.2:0/4261479764 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c0327e0 con 0x7f97980afca0 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.524+0000 7f97a0600640 1 -- 172.21.15.2:0/4261479764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97980afca0 msgr2=0x7f97980b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.524+0000 7f97a0600640 1 --2- 172.21.15.2:0/4261479764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97980afca0 0x7f97980b0070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f978c009850 tx=0x7f978c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.525+0000 7f97a0600640 1 -- 172.21.15.2:0/4261479764 shutdown_connections 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.525+0000 7f97a0600640 1 --2- 172.21.15.2:0/4261479764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97980afca0 0x7f97980b0070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.525+0000 7f97a0600640 1 -- 172.21.15.2:0/4261479764 >> 172.21.15.2:0/4261479764 conn(0x7f9798066e60 msgr2=0x7f9798067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.525+0000 7f97a0600640 1 -- 172.21.15.2:0/4261479764 shutdown_connections 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.525+0000 7f97a0600640 1 -- 172.21.15.2:0/4261479764 wait complete. 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.526+0000 7f97a0600640 1 Processor -- start 2024-08-17T02:49:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.526+0000 7f97a0600640 1 -- start start 2024-08-17T02:49:26.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f97a0600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97980acf10 0x7f979814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f97a0600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97980afca0 0x7f979814c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f97a0600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97981590b0 0x7f979814dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f97a0600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979814c9a0 con 0x7f97980afca0 2024-08-17T02:49:26.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f97a0600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979815a240 con 0x7f97981590b0 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f97a0600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9798169170 con 0x7f97980acf10 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f979d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97980afca0 0x7f979814c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f979d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97980afca0 0x7f979814c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32838/0 (socket says 172.21.15.2:32838) 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f979d200640 1 -- 172.21.15.2:0/1703331668 learned_addr learned my addr 172.21.15.2:0/1703331668 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f979e600640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97981590b0 0x7f979814dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.527+0000 7f979dc00640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97980acf10 0x7f979814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f979d200640 1 -- 172.21.15.2:0/1703331668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97980acf10 msgr2=0x7f979814bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f979d200640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97980acf10 0x7f979814bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f979d200640 1 -- 172.21.15.2:0/1703331668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97981590b0 msgr2=0x7f979814dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f979d200640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97981590b0 0x7f979814dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f979d200640 1 -- 172.21.15.2:0/1703331668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c009390 con 0x7f97980afca0 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f979d200640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97980afca0 0x7f979814c460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f978400c590 tx=0x7f9784007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f9794c00640 1 -- 172.21.15.2:0/1703331668 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784012630 con 0x7f97980afca0 2024-08-17T02:49:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f9794c00640 1 -- 172.21.15.2:0/1703331668 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840127b0 con 0x7f97980afca0 2024-08-17T02:49:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f9794c00640 1 -- 172.21.15.2:0/1703331668 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784012b70 con 0x7f97980afca0 2024-08-17T02:49:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9798156970 con 0x7f97980afca0 2024-08-17T02:49:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.528+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9798159ed0 con 0x7f97980afca0 2024-08-17T02:49:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.529+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979815a3b0 con 0x7f97980afca0 2024-08-17T02:49:26.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.530+0000 7f9794c00640 1 -- 172.21.15.2:0/1703331668 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f978401b400 con 0x7f97980afca0 2024-08-17T02:49:26.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.531+0000 7f9794c00640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9778065150 0x7f9778067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.532+0000 7f9794c00640 1 -- 172.21.15.2:0/1703331668 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f97840821e0 con 0x7f97980afca0 2024-08-17T02:49:26.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.532+0000 7f979dc00640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9778065150 0x7f9778067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.532+0000 7f979dc00640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9778065150 0x7f9778067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f978c034000 tx=0x7f978c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.535+0000 7f9794c00640 1 -- 172.21.15.2:0/1703331668 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f978404ff30 con 0x7f97980afca0 2024-08-17T02:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.718+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9798063fb0 con 0x7f97980afca0 2024-08-17T02:49:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.718+0000 7f9794c00640 1 -- 172.21.15.2:0/1703331668 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9784053550 con 0x7f97980afca0 2024-08-17T02:49:26.719 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:49:26.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.720+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9778065150 msgr2=0x7f9778067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.720+0000 7f97a0600640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9778065150 0x7f9778067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f978c034000 tx=0x7f978c032000 comp rx=0 tx=0).stop 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.720+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97980afca0 msgr2=0x7f979814c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.720+0000 7f97a0600640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97980afca0 0x7f979814c460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f978400c590 tx=0x7f9784007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.720+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 shutdown_connections 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.721+0000 7f97a0600640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f97981590b0 0x7f979814dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.721+0000 7f97a0600640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97980afca0 0x7f979814c460 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.721+0000 7f97a0600640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9778065150 0x7f9778067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.721+0000 7f97a0600640 1 --2- 172.21.15.2:0/1703331668 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f97980acf10 0x7f979814bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.721+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 >> 172.21.15.2:0/1703331668 conn(0x7f9798066e60 msgr2=0x7f9798069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.721+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 shutdown_connections 2024-08-17T02:49:26.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.721+0000 7f97a0600640 1 -- 172.21.15.2:0/1703331668 wait complete. 2024-08-17T02:49:26.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:49:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.889+0000 7ff91f800640 1 Processor -- start 2024-08-17T02:49:26.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.889+0000 7ff91f800640 1 -- start start 2024-08-17T02:49:26.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.890+0000 7ff91f800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9181590b0 0x7ff9180b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.890+0000 7ff91f800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180c92b0 con 0x7ff9180afca0 2024-08-17T02:49:26.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.890+0000 7ff91f800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180ad480 con 0x7ff9180acf10 2024-08-17T02:49:26.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.890+0000 7ff91f800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180b0980 con 0x7ff9181590b0 2024-08-17T02:49:26.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.890+0000 7ff917e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9181590b0 0x7ff9180b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.891+0000 7ff917e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9181590b0 0x7ff9180b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32842/0 (socket says 172.21.15.2:32842) 2024-08-17T02:49:26.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.891+0000 7ff91ce00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff9180afca0 0x7ff9181589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52268/0 (socket says 172.21.15.2:52268) 2024-08-17T02:49:26.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.891+0000 7ff917e00640 1 -- 172.21.15.2:0/1987600256 learned_addr learned my addr 172.21.15.2:0/1987600256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:26.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.891+0000 7ff917e00640 1 -- 172.21.15.2:0/1987600256 >> v1:172.21.15.26:6789/0 conn(0x7ff9180acf10 legacy=0x7ff9180c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.891+0000 7ff917e00640 1 -- 172.21.15.2:0/1987600256 >> v1:172.21.15.2:6789/0 conn(0x7ff9180afca0 legacy=0x7ff9181589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.891+0000 7ff917e00640 1 -- 172.21.15.2:0/1987600256 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180ad760 con 0x7ff9181590b0 2024-08-17T02:49:26.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.891+0000 7ff917400640 1 -- 172.21.15.2:0/1987600256 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994439585 0 0) 0x7ff9180c92b0 con 0x7ff9180afca0 2024-08-17T02:49:26.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.892+0000 7ff917e00640 1 --2- 172.21.15.2:0/1987600256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9181590b0 0x7ff9180b0070 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff904009910 tx=0x7ff9040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a161cf8db382763 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.892+0000 7ff917400640 1 -- 172.21.15.2:0/1987600256 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904032440 con 0x7ff9181590b0 2024-08-17T02:49:26.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.892+0000 7ff917400640 1 -- 172.21.15.2:0/1987600256 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9040325a0 con 0x7ff9181590b0 2024-08-17T02:49:26.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.893+0000 7ff917400640 1 -- 172.21.15.2:0/1987600256 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904032940 con 0x7ff9181590b0 2024-08-17T02:49:26.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.893+0000 7ff91f800640 1 -- 172.21.15.2:0/1987600256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9181590b0 msgr2=0x7ff9180b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.893+0000 7ff91f800640 1 --2- 172.21.15.2:0/1987600256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9181590b0 0x7ff9180b0070 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff904009910 tx=0x7ff9040091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.893+0000 7ff91f800640 1 -- 172.21.15.2:0/1987600256 shutdown_connections 2024-08-17T02:49:26.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.893+0000 7ff91f800640 1 --2- 172.21.15.2:0/1987600256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9181590b0 0x7ff9180b0070 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.893+0000 7ff91f800640 1 -- 172.21.15.2:0/1987600256 >> 172.21.15.2:0/1987600256 conn(0x7ff918066e60 msgr2=0x7ff918067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:26.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.893+0000 7ff91f800640 1 -- 172.21.15.2:0/1987600256 shutdown_connections 2024-08-17T02:49:26.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.893+0000 7ff91f800640 1 -- 172.21.15.2:0/1987600256 wait complete. 2024-08-17T02:49:26.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.895+0000 7ff91f800640 1 Processor -- start 2024-08-17T02:49:26.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.895+0000 7ff91f800640 1 -- start start 2024-08-17T02:49:26.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff91f800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9180acf10 0x7ff9180a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff91f800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9180afca0 0x7ff91806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff91f800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9181590b0 0x7ff918154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff91f800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180a7d80 con 0x7ff9180afca0 2024-08-17T02:49:26.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff91f800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180a8a60 con 0x7ff9181590b0 2024-08-17T02:49:26.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff91f800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180a7200 con 0x7ff9180acf10 2024-08-17T02:49:26.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff917e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9180afca0 0x7ff91806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff917e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9180afca0 0x7ff91806a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32858/0 (socket says 172.21.15.2:32858) 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff917e00640 1 -- 172.21.15.2:0/636038696 learned_addr learned my addr 172.21.15.2:0/636038696 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff91ce00640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9180acf10 0x7ff9180a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.896+0000 7ff91d800640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9181590b0 0x7ff918154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff917e00640 1 -- 172.21.15.2:0/636038696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9180acf10 msgr2=0x7ff9180a6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff917e00640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9180acf10 0x7ff9180a6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff917e00640 1 -- 172.21.15.2:0/636038696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9181590b0 msgr2=0x7ff918154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff917e00640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9181590b0 0x7ff918154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff917e00640 1 -- 172.21.15.2:0/636038696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff904009450 con 0x7ff9180afca0 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff917e00640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9180afca0 0x7ff91806a8b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff904009910 tx=0x7ff904032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff90be00640 1 -- 172.21.15.2:0/636038696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff904031de0 con 0x7ff9180afca0 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff90be00640 1 -- 172.21.15.2:0/636038696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90403d420 con 0x7ff9180afca0 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9180a74e0 con 0x7ff9180afca0 2024-08-17T02:49:26.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.897+0000 7ff90be00640 1 -- 172.21.15.2:0/636038696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90403d820 con 0x7ff9180afca0 2024-08-17T02:49:26.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.898+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180a7b20 con 0x7ff9180afca0 2024-08-17T02:49:26.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.899+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff918063fb0 con 0x7ff9180afca0 2024-08-17T02:49:26.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.899+0000 7ff90be00640 1 -- 172.21.15.2:0/636038696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff904039040 con 0x7ff9180afca0 2024-08-17T02:49:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.900+0000 7ff90be00640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f8065150 0x7ff8f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.900+0000 7ff90be00640 1 -- 172.21.15.2:0/636038696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff9040a2d30 con 0x7ff9180afca0 2024-08-17T02:49:26.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.900+0000 7ff91ce00640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f8065150 0x7ff8f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.901+0000 7ff91ce00640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f8065150 0x7ff8f8067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0011e0 tx=0x7ff90c007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:26.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:26.904+0000 7ff90be00640 1 -- 172.21.15.2:0/636038696 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff904070a80 con 0x7ff9180afca0 2024-08-17T02:49:27.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.089+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff91806ae50 con 0x7ff9180afca0 2024-08-17T02:49:27.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.090+0000 7ff90be00640 1 -- 172.21.15.2:0/636038696 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9040370a0 con 0x7ff9180afca0 2024-08-17T02:49:27.091 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-08-17T02:49:27.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f8065150 msgr2=0x7ff8f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f8065150 0x7ff8f8067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0011e0 tx=0x7ff90c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9180afca0 msgr2=0x7ff91806a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9180afca0 0x7ff91806a8b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff904009910 tx=0x7ff904032000 comp rx=0 tx=0).stop 2024-08-17T02:49:27.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 shutdown_connections 2024-08-17T02:49:27.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9181590b0 0x7ff918154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9180afca0 0x7ff91806a8b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f8065150 0x7ff8f8067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 --2- 172.21.15.2:0/636038696 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9180acf10 0x7ff9180a6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 >> 172.21.15.2:0/636038696 conn(0x7ff918066e60 msgr2=0x7ff9180ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:27.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 shutdown_connections 2024-08-17T02:49:27.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.092+0000 7ff91f800640 1 -- 172.21.15.2:0/636038696 wait complete. 2024-08-17T02:49:27.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000943317.meta pg_num 2024-08-17T02:49:27.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.263+0000 7f616f200640 1 Processor -- start 2024-08-17T02:49:27.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.263+0000 7f616f200640 1 -- start start 2024-08-17T02:49:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.264+0000 7f616f200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f61680ad960 0x7f616815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.264+0000 7f616f200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61680ca050 0x7f6168156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.264+0000 7f616f200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680add30 0x7f6168156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.264+0000 7f616f200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616815b5e0 con 0x7f61680ad960 2024-08-17T02:49:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.264+0000 7f616f200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680cb160 con 0x7f61680ca050 2024-08-17T02:49:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.264+0000 7f616f200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680b0d10 con 0x7f61680add30 2024-08-17T02:49:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.264+0000 7f6167e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f61680ad960 0x7f616815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f61680ad960 0x7f616815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32872/0 (socket says 172.21.15.2:32872) 2024-08-17T02:49:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167e00640 1 -- 172.21.15.2:0/1978489651 learned_addr learned my addr 172.21.15.2:0/1978489651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167400640 1 --2- 172.21.15.2:0/1978489651 >> v2:172.21.15.26:3300/0 conn(0x7f61680ca050 0x7f6168156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f616d200640 1 --2- 172.21.15.2:0/1978489651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680add30 0x7f6168156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167e00640 1 -- 172.21.15.2:0/1978489651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680add30 msgr2=0x7f6168156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:27.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167e00640 1 --2- 172.21.15.2:0/1978489651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680add30 0x7f6168156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167e00640 1 -- 172.21.15.2:0/1978489651 >> v2:172.21.15.26:3300/0 conn(0x7f61680ca050 msgr2=0x7f6168156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:27.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167e00640 1 --2- 172.21.15.2:0/1978489651 >> v2:172.21.15.26:3300/0 conn(0x7f61680ca050 0x7f6168156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167e00640 1 -- 172.21.15.2:0/1978489651 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680ca550 con 0x7f61680ad960 2024-08-17T02:49:27.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.265+0000 7f6167400640 1 --2- 172.21.15.2:0/1978489651 >> v2:172.21.15.26:3300/0 conn(0x7f61680ca050 0x7f6168156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:27.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.266+0000 7f6167e00640 1 --2- 172.21.15.2:0/1978489651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680ad960 0x7f616815b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6168063600 tx=0x7f61580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8562dfe02a9707 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:27.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.266+0000 7f6166a00640 1 -- 172.21.15.2:0/1978489651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615802ae60 con 0x7f61680ad960 2024-08-17T02:49:27.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.266+0000 7f6166a00640 1 -- 172.21.15.2:0/1978489651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158032440 con 0x7f61680ad960 2024-08-17T02:49:27.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.266+0000 7f6166a00640 1 -- 172.21.15.2:0/1978489651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580327e0 con 0x7f61680ad960 2024-08-17T02:49:27.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 -- 172.21.15.2:0/1978489651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680ad960 msgr2=0x7f616815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 --2- 172.21.15.2:0/1978489651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680ad960 0x7f616815b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6168063600 tx=0x7f61580091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 -- 172.21.15.2:0/1978489651 shutdown_connections 2024-08-17T02:49:27.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 --2- 172.21.15.2:0/1978489651 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680add30 0x7f6168156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 --2- 172.21.15.2:0/1978489651 >> v2:172.21.15.26:3300/0 conn(0x7f61680ca050 0x7f6168156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 --2- 172.21.15.2:0/1978489651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680ad960 0x7f616815b0a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 -- 172.21.15.2:0/1978489651 >> 172.21.15.2:0/1978489651 conn(0x7f6168066e60 msgr2=0x7f6168067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:27.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 -- 172.21.15.2:0/1978489651 shutdown_connections 2024-08-17T02:49:27.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.267+0000 7f616f200640 1 -- 172.21.15.2:0/1978489651 wait complete. 2024-08-17T02:49:27.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.268+0000 7f616f200640 1 Processor -- start 2024-08-17T02:49:27.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.269+0000 7f616f200640 1 -- start start 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.269+0000 7f616f200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680ad960 0x7f616806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.269+0000 7f616f200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680add30 0x7f616806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.269+0000 7f616f200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61680ca050 0x7f61680ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.269+0000 7f616f200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168157650 con 0x7f61680add30 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.269+0000 7f616f200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680a9b50 con 0x7f61680ca050 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.269+0000 7f616f200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680a9e30 con 0x7f61680ad960 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680add30 0x7f616806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680add30 0x7f616806dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32884/0 (socket says 172.21.15.2:32884) 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167400640 1 -- 172.21.15.2:0/1342004061 learned_addr learned my addr 172.21.15.2:0/1342004061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f616d200640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61680ca050 0x7f61680ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167e00640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680ad960 0x7f616806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167400640 1 -- 172.21.15.2:0/1342004061 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680ad960 msgr2=0x7f616806d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167400640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680ad960 0x7f616806d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167400640 1 -- 172.21.15.2:0/1342004061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61680ca050 msgr2=0x7f61680ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167400640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61680ca050 0x7f61680ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.270+0000 7f6167400640 1 -- 172.21.15.2:0/1342004061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009450 con 0x7f61680add30 2024-08-17T02:49:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.271+0000 7f6167400640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680add30 0x7f616806dd10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f615400d890 tx=0x7f6154008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.271+0000 7f615f400640 1 -- 172.21.15.2:0/1342004061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400de80 con 0x7f61680add30 2024-08-17T02:49:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.271+0000 7f615f400640 1 -- 172.21.15.2:0/1342004061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615400b8d0 con 0x7f61680add30 2024-08-17T02:49:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.271+0000 7f615f400640 1 -- 172.21.15.2:0/1342004061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400bc90 con 0x7f61680add30 2024-08-17T02:49:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.271+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680aa110 con 0x7f61680add30 2024-08-17T02:49:27.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.271+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61681467e0 con 0x7f61680add30 2024-08-17T02:49:27.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.272+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61680a99c0 con 0x7f61680add30 2024-08-17T02:49:27.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.273+0000 7f615f400640 1 -- 172.21.15.2:0/1342004061 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f615401e460 con 0x7f61680add30 2024-08-17T02:49:27.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.274+0000 7f615f400640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6148065150 0x7f6148067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.274+0000 7f615f400640 1 -- 172.21.15.2:0/1342004061 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6154082dd0 con 0x7f61680add30 2024-08-17T02:49:27.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.274+0000 7f6167e00640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6148065150 0x7f6148067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.275+0000 7f6167e00640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6148065150 0x7f6148067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6158034000 tx=0x7f6158032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:27.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.278+0000 7f615f400640 1 -- 172.21.15.2:0/1342004061 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61540545b0 con 0x7f61680add30 2024-08-17T02:49:27.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.459+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000943317.meta", "var": "pg_num"} v 0) v1 -- 0x7f6168158cb0 con 0x7f61680add30 2024-08-17T02:49:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.460+0000 7f615f400640 1 -- 172.21.15.2:0/1342004061 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000943317.meta", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7f6154054140 con 0x7f61680add30 2024-08-17T02:49:27.461 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:49:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6148065150 msgr2=0x7f6148067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6148065150 0x7f6148067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6158034000 tx=0x7f6158032000 comp rx=0 tx=0).stop 2024-08-17T02:49:27.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680add30 msgr2=0x7f616806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680add30 0x7f616806dd10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f615400d890 tx=0x7f6154008040 comp rx=0 tx=0).stop 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 shutdown_connections 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61680ca050 0x7f61680ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61680add30 0x7f616806dd10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6148065150 0x7f6148067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 --2- 172.21.15.2:0/1342004061 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f61680ad960 0x7f616806d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 >> 172.21.15.2:0/1342004061 conn(0x7f6168066e60 msgr2=0x7f6168155680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 shutdown_connections 2024-08-17T02:49:27.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.462+0000 7f616f200640 1 -- 172.21.15.2:0/1342004061 wait complete. 2024-08-17T02:49:27.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000943317.data pg_num 2024-08-17T02:49:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.632+0000 7f4315600640 1 Processor -- start 2024-08-17T02:49:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.632+0000 7f4315600640 1 -- start start 2024-08-17T02:49:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.633+0000 7f4315600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43100afca0 0x7f43100b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.633+0000 7f4315600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43101590b0 0x7f4310159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.633+0000 7f4315600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431015a4e0 con 0x7f43100acf10 2024-08-17T02:49:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.633+0000 7f4315600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100b0980 con 0x7f43101590b0 2024-08-17T02:49:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.633+0000 7f4315600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100c92b0 con 0x7f43100afca0 2024-08-17T02:49:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.633+0000 7f430f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43101590b0 0x7f4310159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.634+0000 7f430f400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f43101590b0 0x7f4310159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32896/0 (socket says 172.21.15.2:32896) 2024-08-17T02:49:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.634+0000 7f430f400640 1 -- 172.21.15.2:0/4200382723 learned_addr learned my addr 172.21.15.2:0/4200382723 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.634+0000 7f430ea00640 1 --2- 172.21.15.2:0/4200382723 >> v2:172.21.15.26:3300/0 conn(0x7f43100afca0 0x7f43100b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.634+0000 7f430f400640 1 -- 172.21.15.2:0/4200382723 >> v2:172.21.15.26:3300/0 conn(0x7f43100afca0 msgr2=0x7f43100b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:27.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.634+0000 7f430f400640 1 --2- 172.21.15.2:0/4200382723 >> v2:172.21.15.26:3300/0 conn(0x7f43100afca0 0x7f43100b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.634+0000 7f430f400640 1 -- 172.21.15.2:0/4200382723 >> v1:172.21.15.26:6789/0 conn(0x7f43100acf10 legacy=0x7f43101589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:27.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.634+0000 7f430f400640 1 -- 172.21.15.2:0/4200382723 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43100ad480 con 0x7f43101590b0 2024-08-17T02:49:27.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.635+0000 7f430f400640 1 --2- 172.21.15.2:0/4200382723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43101590b0 0x7f4310159fa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4310067e40 tx=0x7f4308009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cb26b05585da94 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.635+0000 7f430d600640 1 -- 172.21.15.2:0/4200382723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308007400 con 0x7f43101590b0 2024-08-17T02:49:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.635+0000 7f430d600640 1 -- 172.21.15.2:0/4200382723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4308007560 con 0x7f43101590b0 2024-08-17T02:49:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.635+0000 7f430d600640 1 -- 172.21.15.2:0/4200382723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308007940 con 0x7f43101590b0 2024-08-17T02:49:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.636+0000 7f4315600640 1 -- 172.21.15.2:0/4200382723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43101590b0 msgr2=0x7f4310159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.636+0000 7f4315600640 1 --2- 172.21.15.2:0/4200382723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43101590b0 0x7f4310159fa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4310067e40 tx=0x7f4308009840 comp rx=0 tx=0).stop 2024-08-17T02:49:27.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.636+0000 7f4315600640 1 -- 172.21.15.2:0/4200382723 shutdown_connections 2024-08-17T02:49:27.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.636+0000 7f4315600640 1 --2- 172.21.15.2:0/4200382723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43101590b0 0x7f4310159fa0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.636+0000 7f4315600640 1 --2- 172.21.15.2:0/4200382723 >> v2:172.21.15.26:3300/0 conn(0x7f43100afca0 0x7f43100b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.636+0000 7f4315600640 1 -- 172.21.15.2:0/4200382723 >> 172.21.15.2:0/4200382723 conn(0x7f4310066e60 msgr2=0x7f4310067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:27.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.636+0000 7f4315600640 1 -- 172.21.15.2:0/4200382723 shutdown_connections 2024-08-17T02:49:27.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.636+0000 7f4315600640 1 -- 172.21.15.2:0/4200382723 wait complete. 2024-08-17T02:49:27.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.637+0000 7f4315600640 1 Processor -- start 2024-08-17T02:49:27.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.638+0000 7f4315600640 1 -- start start 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.638+0000 7f4315600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43100acf10 0x7f431014b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f4315600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43100afca0 0x7f4310155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f4315600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43101590b0 0x7f4310150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f4315600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43100c7d00 con 0x7f43100afca0 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f4315600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43100c7fe0 con 0x7f43101590b0 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f4315600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431014d260 con 0x7f43100acf10 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43100afca0 0x7f4310155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43100afca0 0x7f4310155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32910/0 (socket says 172.21.15.2:32910) 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430e000640 1 -- 172.21.15.2:0/591515513 learned_addr learned my addr 172.21.15.2:0/591515513 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430ea00640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43100acf10 0x7f431014b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430f400640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43101590b0 0x7f4310150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430e000640 1 -- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43100acf10 msgr2=0x7f431014b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430e000640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43100acf10 0x7f431014b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430e000640 1 -- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43101590b0 msgr2=0x7f4310150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430e000640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43101590b0 0x7f4310150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430e000640 1 -- 172.21.15.2:0/591515513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4308009ae0 con 0x7f43100afca0 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.639+0000 7f430f400640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43101590b0 0x7f4310150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.640+0000 7f430e000640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43100afca0 0x7f4310155b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00b4f0 tx=0x7f42fc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.640+0000 7f4306000640 1 -- 172.21.15.2:0/591515513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00f510 con 0x7f43100afca0 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.640+0000 7f4306000640 1 -- 172.21.15.2:0/591515513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc00f670 con 0x7f43100afca0 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.640+0000 7f4306000640 1 -- 172.21.15.2:0/591515513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00fa70 con 0x7f43100afca0 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.640+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431014d540 con 0x7f43100afca0 2024-08-17T02:49:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.640+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431014b920 con 0x7f43100afca0 2024-08-17T02:49:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.641+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4310063fb0 con 0x7f43100afca0 2024-08-17T02:49:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.642+0000 7f4306000640 1 -- 172.21.15.2:0/591515513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f42fc01a400 con 0x7f43100afca0 2024-08-17T02:49:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.643+0000 7f4306000640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f42f0065150 0x7f42f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.643+0000 7f4306000640 1 -- 172.21.15.2:0/591515513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f42fc0822b0 con 0x7f43100afca0 2024-08-17T02:49:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.643+0000 7f430ea00640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f42f0065150 0x7f42f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.644+0000 7f430ea00640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f42f0065150 0x7f42f0067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4300007ba0 tx=0x7f4300008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.647+0000 7f4306000640 1 -- 172.21.15.2:0/591515513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f42fc04ffd0 con 0x7f43100afca0 2024-08-17T02:49:27.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.827+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000943317.data", "var": "pg_num"} v 0) v1 -- 0x7f4310067b70 con 0x7f43100afca0 2024-08-17T02:49:27.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.828+0000 7f4306000640 1 -- 172.21.15.2:0/591515513 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000943317.data", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7f42fc0535f0 con 0x7f43100afca0 2024-08-17T02:49:27.829 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:49:27.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f42f0065150 msgr2=0x7f42f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f42f0065150 0x7f42f0067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4300007ba0 tx=0x7f4300008040 comp rx=0 tx=0).stop 2024-08-17T02:49:27.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43100afca0 msgr2=0x7f4310155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:27.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43100afca0 0x7f4310155b00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00b4f0 tx=0x7f42fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 shutdown_connections 2024-08-17T02:49:27.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43101590b0 0x7f4310150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43100afca0 0x7f4310155b00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f42f0065150 0x7f42f0067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 --2- 172.21.15.2:0/591515513 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f43100acf10 0x7f431014b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:27.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 >> 172.21.15.2:0/591515513 conn(0x7f4310066e60 msgr2=0x7f43100ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:27.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 shutdown_connections 2024-08-17T02:49:27.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.830+0000 7f4315600640 1 -- 172.21.15.2:0/591515513 wait complete. 2024-08-17T02:49:27.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.996+0000 7f93c2600640 1 Processor -- start 2024-08-17T02:49:27.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.996+0000 7f93c2600640 1 -- start start 2024-08-17T02:49:27.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.997+0000 7f93c2600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f93bc0afca0 0x7f93bc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.997+0000 7f93c2600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93bc0acf10 0x7f93bc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93c2600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 0x7f93bc158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:27.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93c2600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc0b0980 con 0x7f93bc0acf10 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93c2600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc15a4e0 con 0x7f93bc0afca0 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93c2600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0c92b0 con 0x7f93bc1589a0 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93b3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93bc0acf10 0x7f93bc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93b3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93bc0acf10 0x7f93bc159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32916/0 (socket says 172.21.15.2:32916) 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93b3e00640 1 -- 172.21.15.2:0/2402568366 learned_addr learned my addr 172.21.15.2:0/2402568366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93bb400640 1 --2- 172.21.15.2:0/2402568366 >> v2:172.21.15.26:3300/0 conn(0x7f93bc0afca0 0x7f93bc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93bbe00640 1 --2- 172.21.15.2:0/2402568366 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 0x7f93bc158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93b3e00640 1 -- 172.21.15.2:0/2402568366 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 msgr2=0x7f93bc158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93b3e00640 1 --2- 172.21.15.2:0/2402568366 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 0x7f93bc158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93b3e00640 1 -- 172.21.15.2:0/2402568366 >> v2:172.21.15.26:3300/0 conn(0x7f93bc0afca0 msgr2=0x7f93bc0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93b3e00640 1 --2- 172.21.15.2:0/2402568366 >> v2:172.21.15.26:3300/0 conn(0x7f93bc0afca0 0x7f93bc0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.998+0000 7f93b3e00640 1 -- 172.21.15.2:0/2402568366 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc159360 con 0x7f93bc0acf10 2024-08-17T02:49:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:27.999+0000 7f93b3e00640 1 --2- 172.21.15.2:0/2402568366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0acf10 0x7f93bc159fa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f93bc067e40 tx=0x7f93a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440f9f10aaeab8ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93baa00640 1 -- 172.21.15.2:0/2402568366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a402add0 con 0x7f93bc0acf10 2024-08-17T02:49:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93baa00640 1 -- 172.21.15.2:0/2402568366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4032440 con 0x7f93bc0acf10 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93baa00640 1 -- 172.21.15.2:0/2402568366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4032820 con 0x7f93bc0acf10 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93c2600640 1 -- 172.21.15.2:0/2402568366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0acf10 msgr2=0x7f93bc159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93c2600640 1 --2- 172.21.15.2:0/2402568366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0acf10 0x7f93bc159fa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f93bc067e40 tx=0x7f93a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93c2600640 1 -- 172.21.15.2:0/2402568366 shutdown_connections 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93c2600640 1 --2- 172.21.15.2:0/2402568366 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 0x7f93bc158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93c2600640 1 --2- 172.21.15.2:0/2402568366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0acf10 0x7f93bc159fa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93c2600640 1 --2- 172.21.15.2:0/2402568366 >> v2:172.21.15.26:3300/0 conn(0x7f93bc0afca0 0x7f93bc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93c2600640 1 -- 172.21.15.2:0/2402568366 >> 172.21.15.2:0/2402568366 conn(0x7f93bc066e60 msgr2=0x7f93bc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.000+0000 7f93c2600640 1 -- 172.21.15.2:0/2402568366 shutdown_connections 2024-08-17T02:49:28.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.001+0000 7f93c2600640 1 -- 172.21.15.2:0/2402568366 wait complete. 2024-08-17T02:49:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.002+0000 7f93c2600640 1 Processor -- start 2024-08-17T02:49:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.002+0000 7f93c2600640 1 -- start start 2024-08-17T02:49:28.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93c2600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93bc0acf10 0x7f93bc16a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93c2600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0afca0 0x7f93bc13b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93c2600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 0x7f93bc14b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93c2600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc06b080 con 0x7f93bc0afca0 2024-08-17T02:49:28.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93c2600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1522d0 con 0x7f93bc0acf10 2024-08-17T02:49:28.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93c2600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc151a20 con 0x7f93bc1589a0 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93b3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0afca0 0x7f93bc13b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93b3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0afca0 0x7f93bc13b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32922/0 (socket says 172.21.15.2:32922) 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93b3e00640 1 -- 172.21.15.2:0/3669083199 learned_addr learned my addr 172.21.15.2:0/3669083199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93bb400640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93bc0acf10 0x7f93bc16a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.003+0000 7f93bbe00640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 0x7f93bc14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b3e00640 1 -- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 msgr2=0x7f93bc14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b3e00640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 0x7f93bc14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b3e00640 1 -- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93bc0acf10 msgr2=0x7f93bc16a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b3e00640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93bc0acf10 0x7f93bc16a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b3e00640 1 -- 172.21.15.2:0/3669083199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009450 con 0x7f93bc0afca0 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93bb400640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93bc0acf10 0x7f93bc16a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b3e00640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0afca0 0x7f93bc13b270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009210 tx=0x7f93a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b2a00640 1 -- 172.21.15.2:0/3669083199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4031de0 con 0x7f93bc0afca0 2024-08-17T02:49:28.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b2a00640 1 -- 172.21.15.2:0/3669083199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4000c40 con 0x7f93bc0afca0 2024-08-17T02:49:28.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93b2a00640 1 -- 172.21.15.2:0/3669083199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a403d670 con 0x7f93bc0afca0 2024-08-17T02:49:28.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.004+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc151cc0 con 0x7f93bc0afca0 2024-08-17T02:49:28.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.005+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc151f60 con 0x7f93bc0afca0 2024-08-17T02:49:28.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.006+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc152480 con 0x7f93bc0afca0 2024-08-17T02:49:28.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.006+0000 7f93b2a00640 1 -- 172.21.15.2:0/3669083199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f93a4039040 con 0x7f93bc0afca0 2024-08-17T02:49:28.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.007+0000 7f93b2a00640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9398065150 0x7f9398067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.007+0000 7f93b2a00640 1 -- 172.21.15.2:0/3669083199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f93a40a29e0 con 0x7f93bc0afca0 2024-08-17T02:49:28.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.007+0000 7f93bb400640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9398065150 0x7f9398067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.008+0000 7f93bb400640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9398065150 0x7f9398067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00bb80 tx=0x7f93ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.011+0000 7f93b2a00640 1 -- 172.21.15.2:0/3669083199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f93bc152480 con 0x7f93bc0afca0 2024-08-17T02:49:28.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.230+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93bc152440 con 0x7f93bc0afca0 2024-08-17T02:49:28.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.230+0000 7f93b2a00640 1 -- 172.21.15.2:0/3669083199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5678 (secure 0 0 0) 0x7f93a4037090 con 0x7f93bc0afca0 2024-08-17T02:49:28.232 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:28.232 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:09.888633+0000","modified":"2024-08-17T02:47:13.482114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.2:6837/1889487336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1889487336},{"type":"v1","addr":"172.21.15.2:6837","nonce":1889487336}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:22.521281+0000","modified":"2024-08-17T02:47:24.261416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4953},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4953":{"gid":4953,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000943317","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:28.232 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-08-17T02:49:28.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9398065150 msgr2=0x7f9398067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9398065150 0x7f9398067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00bb80 tx=0x7f93ac008040 comp rx=0 tx=0).stop 2024-08-17T02:49:28.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0afca0 msgr2=0x7f93bc13b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0afca0 0x7f93bc13b270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009210 tx=0x7f93a4032000 comp rx=0 tx=0).stop 2024-08-17T02:49:28.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 shutdown_connections 2024-08-17T02:49:28.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9398065150 0x7f9398067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f93bc1589a0 0x7f93bc14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93bc0afca0 0x7f93bc13b270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 --2- 172.21.15.2:0/3669083199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93bc0acf10 0x7f93bc16a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 >> 172.21.15.2:0/3669083199 conn(0x7f93bc066e60 msgr2=0x7f93bc14c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:28.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 shutdown_connections 2024-08-17T02:49:28.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.233+0000 7f93c2600640 1 -- 172.21.15.2:0/3669083199 wait complete. 2024-08-17T02:49:28.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.398+0000 7f6c3c600640 1 Processor -- start 2024-08-17T02:49:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.398+0000 7f6c3c600640 1 -- start start 2024-08-17T02:49:28.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.399+0000 7f6c3c600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c340add30 0x7f6c34156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.399+0000 7f6c3c600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340cb160 con 0x7f6c340ad960 2024-08-17T02:49:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.399+0000 7f6c3c600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340b0d10 con 0x7f6c340ca050 2024-08-17T02:49:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.399+0000 7f6c3c600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340ca550 con 0x7f6c340add30 2024-08-17T02:49:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.400+0000 7f6c39c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c340ad960 0x7f6c34156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52276/0 (socket says 172.21.15.2:52276) 2024-08-17T02:49:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.400+0000 7f6c39c00640 1 -- 172.21.15.2:0/3680561725 learned_addr learned my addr 172.21.15.2:0/3680561725 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:28.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.400+0000 7f6c3a600640 1 --2- 172.21.15.2:0/3680561725 >> v2:172.21.15.26:3300/0 conn(0x7f6c340add30 0x7f6c34156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.400+0000 7f6c33e00640 1 -- 172.21.15.2:0/3680561725 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189406999 0 0) 0x7f6c340cb160 con 0x7f6c340ad960 2024-08-17T02:49:28.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.400+0000 7f6c33e00640 1 -- 172.21.15.2:0/3680561725 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c1c0034e0 con 0x7f6c340ad960 2024-08-17T02:49:28.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.400+0000 7f6c3a600640 1 -- 172.21.15.2:0/3680561725 >> v1:172.21.15.26:6789/0 conn(0x7f6c340ca050 legacy=0x7f6c340aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.400+0000 7f6c3a600640 1 -- 172.21.15.2:0/3680561725 >> v1:172.21.15.2:6789/0 conn(0x7f6c340ad960 legacy=0x7f6c34156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.400+0000 7f6c3a600640 1 -- 172.21.15.2:0/3680561725 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340ca830 con 0x7f6c340add30 2024-08-17T02:49:28.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.401+0000 7f6c3a600640 1 --2- 172.21.15.2:0/3680561725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340add30 0x7f6c34156b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009e60 tx=0x7f6c2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffddcd4cf62f97d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c33e00640 1 -- 172.21.15.2:0/3680561725 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c030550 con 0x7f6c340add30 2024-08-17T02:49:28.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c33e00640 1 -- 172.21.15.2:0/3680561725 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0306b0 con 0x7f6c340add30 2024-08-17T02:49:28.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c33e00640 1 -- 172.21.15.2:0/3680561725 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c030a50 con 0x7f6c340add30 2024-08-17T02:49:28.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c3c600640 1 -- 172.21.15.2:0/3680561725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340add30 msgr2=0x7f6c34156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c3c600640 1 --2- 172.21.15.2:0/3680561725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340add30 0x7f6c34156b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009e60 tx=0x7f6c2c009780 comp rx=0 tx=0).stop 2024-08-17T02:49:28.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c3c600640 1 -- 172.21.15.2:0/3680561725 shutdown_connections 2024-08-17T02:49:28.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c3c600640 1 --2- 172.21.15.2:0/3680561725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340add30 0x7f6c34156b30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c3c600640 1 -- 172.21.15.2:0/3680561725 >> 172.21.15.2:0/3680561725 conn(0x7f6c34066e60 msgr2=0x7f6c34067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:28.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c3c600640 1 -- 172.21.15.2:0/3680561725 shutdown_connections 2024-08-17T02:49:28.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.402+0000 7f6c3c600640 1 -- 172.21.15.2:0/3680561725 wait complete. 2024-08-17T02:49:28.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.404+0000 7f6c3c600640 1 Processor -- start 2024-08-17T02:49:28.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.404+0000 7f6c3c600640 1 -- start start 2024-08-17T02:49:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3c600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340ad960 0x7f6c3415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3c600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c340add30 0x7f6c3415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3c600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c340ca050 0x7f6c3415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3c600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34159ff0 con 0x7f6c340ca050 2024-08-17T02:49:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3c600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340a90d0 con 0x7f6c340ad960 2024-08-17T02:49:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3c600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34159d10 con 0x7f6c340add30 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c340ca050 0x7f6c3415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c340ca050 0x7f6c3415c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32938/0 (socket says 172.21.15.2:32938) 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3a600640 1 -- 172.21.15.2:0/2265404112 learned_addr learned my addr 172.21.15.2:0/2265404112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c39c00640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340ad960 0x7f6c3415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c39200640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c340add30 0x7f6c3415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3a600640 1 -- 172.21.15.2:0/2265404112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c340add30 msgr2=0x7f6c3415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3a600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c340add30 0x7f6c3415c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3a600640 1 -- 172.21.15.2:0/2265404112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340ad960 msgr2=0x7f6c3415bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3a600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340ad960 0x7f6c3415bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.405+0000 7f6c3a600640 1 -- 172.21.15.2:0/2265404112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009a20 con 0x7f6c340ca050 2024-08-17T02:49:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.406+0000 7f6c3a600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c340ca050 0x7f6c3415c760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0099f0 tx=0x7f6c2c038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.406+0000 7f6c30c00640 1 -- 172.21.15.2:0/2265404112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c032c70 con 0x7f6c340ca050 2024-08-17T02:49:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.406+0000 7f6c30c00640 1 -- 172.21.15.2:0/2265404112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c041070 con 0x7f6c340ca050 2024-08-17T02:49:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.406+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c340a8a80 con 0x7f6c340ca050 2024-08-17T02:49:28.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.406+0000 7f6c30c00640 1 -- 172.21.15.2:0/2265404112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c046430 con 0x7f6c340ca050 2024-08-17T02:49:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.406+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c34157100 con 0x7f6c340ca050 2024-08-17T02:49:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.407+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c340a88e0 con 0x7f6c340ca050 2024-08-17T02:49:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.408+0000 7f6c30c00640 1 -- 172.21.15.2:0/2265404112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6c2c043030 con 0x7f6c340ca050 2024-08-17T02:49:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.409+0000 7f6c30c00640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c14065150 0x7f6c14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.409+0000 7f6c30c00640 1 -- 172.21.15.2:0/2265404112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6c2c0a4500 con 0x7f6c340ca050 2024-08-17T02:49:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.409+0000 7f6c39c00640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c14065150 0x7f6c14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.410+0000 7f6c39c00640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c14065150 0x7f6c14067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6c28005840 tx=0x7f6c28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.413+0000 7f6c30c00640 1 -- 172.21.15.2:0/2265404112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6c340a88e0 con 0x7f6c340ca050 2024-08-17T02:49:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.594+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c340a88e0 con 0x7f6c340ca050 2024-08-17T02:49:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.595+0000 7f6c30c00640 1 -- 172.21.15.2:0/2265404112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18503 (secure 0 0 0) 0x7f6c340a88e0 con 0x7f6c340ca050 2024-08-17T02:49:28.596 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:28.597 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:47:24.539782+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:07.966246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:08.880865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000943317.meta","create_time":"2024-08-17T02:47:20.701176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000943317"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000943317.data","create_time":"2024-08-17T02:47:21.560605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000943317"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.597+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c14065150 msgr2=0x7f6c14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.597+0000 7f6c3c600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c14065150 0x7f6c14067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6c28005840 tx=0x7f6c28009040 comp rx=0 tx=0).stop 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.597+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c340ca050 msgr2=0x7f6c3415c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.597+0000 7f6c3c600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c340ca050 0x7f6c3415c760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0099f0 tx=0x7f6c2c038000 comp rx=0 tx=0).stop 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.598+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 shutdown_connections 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.598+0000 7f6c3c600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c340ca050 0x7f6c3415c760 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.598+0000 7f6c3c600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6c14065150 0x7f6c14067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.598+0000 7f6c3c600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6c340add30 0x7f6c3415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.598+0000 7f6c3c600640 1 --2- 172.21.15.2:0/2265404112 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c340ad960 0x7f6c3415bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.598+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 >> 172.21.15.2:0/2265404112 conn(0x7f6c34066e60 msgr2=0x7f6c340ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:28.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.598+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 shutdown_connections 2024-08-17T02:49:28.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.598+0000 7f6c3c600640 1 -- 172.21.15.2:0/2265404112 wait complete. 2024-08-17T02:49:28.613 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:49:28.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.765+0000 7f2447200640 1 Processor -- start 2024-08-17T02:49:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.765+0000 7f2447200640 1 -- start start 2024-08-17T02:49:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.766+0000 7f2447200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2448158b10 0x7f24480b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.766+0000 7f2447200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24480b25c0 0x7f2448066e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.766+0000 7f2447200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24480a9620 con 0x7f2448158ee0 2024-08-17T02:49:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.766+0000 7f2447200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480aa420 con 0x7f24480b25c0 2024-08-17T02:49:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.766+0000 7f2447200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480a9850 con 0x7f2448158b10 2024-08-17T02:49:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.766+0000 7f243fe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24480b25c0 0x7f2448066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.766+0000 7f2445e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2448158b10 0x7f24480b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f243fe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f24480b25c0 0x7f2448066e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:34214/0 (socket says 172.21.15.2:34214) 2024-08-17T02:49:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f2446800640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2448158ee0 0x7f24480aa8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.2:43282/0 (socket says 172.21.15.2:43282) 2024-08-17T02:49:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f243fe00640 1 -- 172.21.15.2:0/4037311276 learned_addr learned my addr 172.21.15.2:0/4037311276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:28.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f2445e00640 1 -- 172.21.15.2:0/4037311276 >> v2:172.21.15.26:3300/0 conn(0x7f24480b25c0 msgr2=0x7f2448066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:28.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f2445e00640 1 --2- 172.21.15.2:0/4037311276 >> v2:172.21.15.26:3300/0 conn(0x7f24480b25c0 0x7f2448066e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f2445400640 1 -- 172.21.15.2:0/4037311276 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242216682 0 0) 0x7f24480a9620 con 0x7f2448158ee0 2024-08-17T02:49:28.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f2445e00640 1 -- 172.21.15.2:0/4037311276 >> v1:172.21.15.26:6789/0 conn(0x7f2448158ee0 legacy=0x7f24480aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f2445e00640 1 -- 172.21.15.2:0/4037311276 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448067c40 con 0x7f2448158b10 2024-08-17T02:49:28.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.767+0000 7f243fe00640 1 --2- 172.21.15.2:0/4037311276 >> v2:172.21.15.26:3300/0 conn(0x7f24480b25c0 0x7f2448066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.768+0000 7f2445e00640 1 --2- 172.21.15.2:0/4037311276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2448158b10 0x7f24480b2080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2438009880 tx=0x7f24380090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a105b9d27b949e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.768+0000 7f2445400640 1 -- 172.21.15.2:0/4037311276 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243802ace0 con 0x7f2448158b10 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2445400640 1 -- 172.21.15.2:0/4037311276 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243802ae40 con 0x7f2448158b10 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2445400640 1 -- 172.21.15.2:0/4037311276 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438032670 con 0x7f2448158b10 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2447200640 1 -- 172.21.15.2:0/4037311276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2448158b10 msgr2=0x7f24480b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2447200640 1 --2- 172.21.15.2:0/4037311276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2448158b10 0x7f24480b2080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2438009880 tx=0x7f24380090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2447200640 1 -- 172.21.15.2:0/4037311276 shutdown_connections 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2447200640 1 --2- 172.21.15.2:0/4037311276 >> v2:172.21.15.26:3300/0 conn(0x7f24480b25c0 0x7f2448066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2447200640 1 --2- 172.21.15.2:0/4037311276 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2448158b10 0x7f24480b2080 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2447200640 1 -- 172.21.15.2:0/4037311276 >> 172.21.15.2:0/4037311276 conn(0x7f2448095a70 msgr2=0x7f2448095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2447200640 1 -- 172.21.15.2:0/4037311276 shutdown_connections 2024-08-17T02:49:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.769+0000 7f2447200640 1 -- 172.21.15.2:0/4037311276 wait complete. 2024-08-17T02:49:28.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.770+0000 7f2447200640 1 Processor -- start 2024-08-17T02:49:28.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.771+0000 7f2447200640 1 -- start start 2024-08-17T02:49:28.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.771+0000 7f2447200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24480b25c0 0x7f2448169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.771+0000 7f2447200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2448158b10 0x7f244814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.771+0000 7f2447200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2448158ee0 0x7f244814fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2447200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24480b05a0 con 0x7f2448158ee0 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2447200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24480af990 con 0x7f2448158b10 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2447200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480afc70 con 0x7f24480b25c0 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2446800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2448158ee0 0x7f244814fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2446800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2448158ee0 0x7f244814fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32954/0 (socket says 172.21.15.2:32954) 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2446800640 1 -- 172.21.15.2:0/888919869 learned_addr learned my addr 172.21.15.2:0/888919869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f243fe00640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2448158b10 0x7f244814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2445e00640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24480b25c0 0x7f2448169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2446800640 1 -- 172.21.15.2:0/888919869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24480b25c0 msgr2=0x7f2448169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2446800640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24480b25c0 0x7f2448169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2446800640 1 -- 172.21.15.2:0/888919869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2448158b10 msgr2=0x7f244814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:28.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2446800640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2448158b10 0x7f244814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:28.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.772+0000 7f2446800640 1 -- 172.21.15.2:0/888919869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430009450 con 0x7f2448158ee0 2024-08-17T02:49:28.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.773+0000 7f2446800640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2448158ee0 0x7f244814fbb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f244000c860 tx=0x7f24400015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.773+0000 7f243d600640 1 -- 172.21.15.2:0/888919869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000ce50 con 0x7f2448158ee0 2024-08-17T02:49:28.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.773+0000 7f243d600640 1 -- 172.21.15.2:0/888919869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440005d60 con 0x7f2448158ee0 2024-08-17T02:49:28.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.773+0000 7f243d600640 1 -- 172.21.15.2:0/888919869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000a870 con 0x7f2448158ee0 2024-08-17T02:49:28.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.773+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2438009390 con 0x7f2448158ee0 2024-08-17T02:49:28.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.773+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244816a220 con 0x7f2448158ee0 2024-08-17T02:49:28.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.774+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24480b0750 con 0x7f2448158ee0 2024-08-17T02:49:28.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.775+0000 7f243d600640 1 -- 172.21.15.2:0/888919869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f244000ac60 con 0x7f2448158ee0 2024-08-17T02:49:28.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.776+0000 7f243d600640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2424065150 0x7f2424067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:28.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.776+0000 7f243d600640 1 -- 172.21.15.2:0/888919869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2440082580 con 0x7f2448158ee0 2024-08-17T02:49:28.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.777+0000 7f2445e00640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2424065150 0x7f2424067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:28.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.777+0000 7f2445e00640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2424065150 0x7f2424067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2438034000 tx=0x7f2438032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:28.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:28.780+0000 7f243d600640 1 -- 172.21.15.2:0/888919869 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f24480b0750 con 0x7f2448158ee0 2024-08-17T02:49:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.004+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2448070720 con 0x7f2448158ee0 2024-08-17T02:49:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.004+0000 7f243d600640 1 -- 172.21.15.2:0/888919869 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5678 (secure 0 0 0) 0x7f24400502a0 con 0x7f2448158ee0 2024-08-17T02:49:29.006 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:29.006 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:09.888633+0000","modified":"2024-08-17T02:47:13.482114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.2:6837/1889487336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1889487336},{"type":"v1","addr":"172.21.15.2:6837","nonce":1889487336}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:22.521281+0000","modified":"2024-08-17T02:47:24.261416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4953},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4953":{"gid":4953,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000943317","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2424065150 msgr2=0x7f2424067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2424065150 0x7f2424067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2438034000 tx=0x7f2438032000 comp rx=0 tx=0).stop 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2448158ee0 msgr2=0x7f244814fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2448158ee0 0x7f244814fbb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f244000c860 tx=0x7f24400015f0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 shutdown_connections 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2448158ee0 0x7f244814fbb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2448158b10 0x7f244814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2424065150 0x7f2424067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 --2- 172.21.15.2:0/888919869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f24480b25c0 0x7f2448169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 >> 172.21.15.2:0/888919869 conn(0x7f2448095a70 msgr2=0x7f2448066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 shutdown_connections 2024-08-17T02:49:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.007+0000 7f2447200640 1 -- 172.21.15.2:0/888919869 wait complete. 2024-08-17T02:49:29.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.174+0000 7f88fac00640 1 Processor -- start 2024-08-17T02:49:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.174+0000 7f88fac00640 1 -- start start 2024-08-17T02:49:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.175+0000 7f88fac00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88f40afca0 0x7f88f40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.175+0000 7f88fac00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88f41590b0 0x7f88f4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88fac00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f415a4e0 con 0x7f88f40acf10 2024-08-17T02:49:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88fac00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40b0980 con 0x7f88f40afca0 2024-08-17T02:49:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88fac00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40c92b0 con 0x7f88f41590b0 2024-08-17T02:49:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88f40afca0 0x7f88f40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88f40afca0 0x7f88f40b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32964/0 (socket says 172.21.15.2:32964) 2024-08-17T02:49:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f3e00640 1 -- 172.21.15.2:0/2302184397 learned_addr learned my addr 172.21.15.2:0/2302184397 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f8c00640 1 --2- 172.21.15.2:0/2302184397 >> v2:172.21.15.26:3300/0 conn(0x7f88f41590b0 0x7f88f4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f3e00640 1 -- 172.21.15.2:0/2302184397 >> v2:172.21.15.26:3300/0 conn(0x7f88f41590b0 msgr2=0x7f88f4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f3e00640 1 --2- 172.21.15.2:0/2302184397 >> v2:172.21.15.26:3300/0 conn(0x7f88f41590b0 0x7f88f4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f3e00640 1 -- 172.21.15.2:0/2302184397 >> v1:172.21.15.26:6789/0 conn(0x7f88f40acf10 legacy=0x7f88f41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f3e00640 1 -- 172.21.15.2:0/2302184397 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40ad480 con 0x7f88f40afca0 2024-08-17T02:49:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.176+0000 7f88f8c00640 1 --2- 172.21.15.2:0/2302184397 >> v2:172.21.15.26:3300/0 conn(0x7f88f41590b0 0x7f88f4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:29.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.177+0000 7f88f3e00640 1 --2- 172.21.15.2:0/2302184397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f40b0070 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f88f40cb4a0 tx=0x7f88e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c82b5e000db87d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88f3400640 1 -- 172.21.15.2:0/2302184397 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e402ae80 con 0x7f88f40afca0 2024-08-17T02:49:29.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88f3400640 1 -- 172.21.15.2:0/2302184397 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4032440 con 0x7f88f40afca0 2024-08-17T02:49:29.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88f3400640 1 -- 172.21.15.2:0/2302184397 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4032800 con 0x7f88f40afca0 2024-08-17T02:49:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88fac00640 1 -- 172.21.15.2:0/2302184397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 msgr2=0x7f88f40b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88fac00640 1 --2- 172.21.15.2:0/2302184397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f40b0070 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f88f40cb4a0 tx=0x7f88e40091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88fac00640 1 -- 172.21.15.2:0/2302184397 shutdown_connections 2024-08-17T02:49:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88fac00640 1 --2- 172.21.15.2:0/2302184397 >> v2:172.21.15.26:3300/0 conn(0x7f88f41590b0 0x7f88f4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88fac00640 1 --2- 172.21.15.2:0/2302184397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f40b0070 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88fac00640 1 -- 172.21.15.2:0/2302184397 >> 172.21.15.2:0/2302184397 conn(0x7f88f4066e60 msgr2=0x7f88f4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88fac00640 1 -- 172.21.15.2:0/2302184397 shutdown_connections 2024-08-17T02:49:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.178+0000 7f88fac00640 1 -- 172.21.15.2:0/2302184397 wait complete. 2024-08-17T02:49:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.180+0000 7f88fac00640 1 Processor -- start 2024-08-17T02:49:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.180+0000 7f88fac00640 1 -- start start 2024-08-17T02:49:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88fac00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88f40acf10 0x7f88f4140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88fac00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f41416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88fac00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f41590b0 0x7f88f415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88fac00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f4141440 con 0x7f88f40afca0 2024-08-17T02:49:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88fac00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40c4f60 con 0x7f88f41590b0 2024-08-17T02:49:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88fac00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40c5240 con 0x7f88f40acf10 2024-08-17T02:49:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88ebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f41416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88ebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f41416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32976/0 (socket says 172.21.15.2:32976) 2024-08-17T02:49:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88ebe00640 1 -- 172.21.15.2:0/3299292190 learned_addr learned my addr 172.21.15.2:0/3299292190 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88f8c00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f41590b0 0x7f88f415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.181+0000 7f88f3e00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88f40acf10 0x7f88f4140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88ebe00640 1 -- 172.21.15.2:0/3299292190 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88f40acf10 msgr2=0x7f88f4140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88ebe00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88f40acf10 0x7f88f4140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88ebe00640 1 -- 172.21.15.2:0/3299292190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f41590b0 msgr2=0x7f88f415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88ebe00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f41590b0 0x7f88f415e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88ebe00640 1 -- 172.21.15.2:0/3299292190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4009450 con 0x7f88f40afca0 2024-08-17T02:49:29.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88ebe00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f41416f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00c4c0 tx=0x7f88dc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88eb400640 1 -- 172.21.15.2:0/3299292190 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011590 con 0x7f88f40afca0 2024-08-17T02:49:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88eb400640 1 -- 172.21.15.2:0/3299292190 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc011710 con 0x7f88f40afca0 2024-08-17T02:49:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88eb400640 1 -- 172.21.15.2:0/3299292190 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc011ad0 con 0x7f88f40afca0 2024-08-17T02:49:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f40c5520 con 0x7f88f40afca0 2024-08-17T02:49:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.182+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f40c5ae0 con 0x7f88f40afca0 2024-08-17T02:49:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.183+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f40c5d30 con 0x7f88f40afca0 2024-08-17T02:49:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.184+0000 7f88eb400640 1 -- 172.21.15.2:0/3299292190 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f88dc01b3b0 con 0x7f88f40afca0 2024-08-17T02:49:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.185+0000 7f88eb400640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f88d0065150 0x7f88d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.185+0000 7f88eb400640 1 -- 172.21.15.2:0/3299292190 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f88dc081ad0 con 0x7f88f40afca0 2024-08-17T02:49:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.185+0000 7f88f3e00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f88d0065150 0x7f88d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.186+0000 7f88f3e00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f88d0065150 0x7f88d0067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f88e4034000 tx=0x7f88e4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.189+0000 7f88eb400640 1 -- 172.21.15.2:0/3299292190 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f88dc04f820 con 0x7f88f40afca0 2024-08-17T02:49:29.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.414+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88f415a4e0 con 0x7f88f40afca0 2024-08-17T02:49:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.415+0000 7f88eb400640 1 -- 172.21.15.2:0/3299292190 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5678 (secure 0 0 0) 0x7f88f415a4e0 con 0x7f88f40afca0 2024-08-17T02:49:29.416 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:29.416 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:09.888633+0000","modified":"2024-08-17T02:47:13.482114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.2:6837/1889487336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":1889487336},{"type":"v1","addr":"172.21.15.2:6837","nonce":1889487336}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:22.521281+0000","modified":"2024-08-17T02:47:24.261416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4953},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4953":{"gid":4953,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000943317","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:29.416 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-08-17T02:49:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f88d0065150 msgr2=0x7f88d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f88d0065150 0x7f88d0067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f88e4034000 tx=0x7f88e4032000 comp rx=0 tx=0).stop 2024-08-17T02:49:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 msgr2=0x7f88f41416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f41416f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f88dc00c4c0 tx=0x7f88dc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 shutdown_connections 2024-08-17T02:49:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88f41590b0 0x7f88f415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f40afca0 0x7f88f41416f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f88d0065150 0x7f88d0067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 --2- 172.21.15.2:0/3299292190 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f88f40acf10 0x7f88f4140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 >> 172.21.15.2:0/3299292190 conn(0x7f88f4066e60 msgr2=0x7f88f40cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 shutdown_connections 2024-08-17T02:49:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.417+0000 7f88fac00640 1 -- 172.21.15.2:0/3299292190 wait complete. 2024-08-17T02:49:29.434 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:29.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.586+0000 7fb90ec00640 1 Processor -- start 2024-08-17T02:49:29.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.586+0000 7fb90ec00640 1 -- start start 2024-08-17T02:49:29.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.587+0000 7fb90ec00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb9080ad960 0x7fb90815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.587+0000 7fb90ec00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9080ca050 0x7fb908156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.587+0000 7fb90ec00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90815b5e0 con 0x7fb9080add30 2024-08-17T02:49:29.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.587+0000 7fb90ec00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9080cb160 con 0x7fb9080ad960 2024-08-17T02:49:29.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.587+0000 7fb90ec00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080b0d10 con 0x7fb9080ca050 2024-08-17T02:49:29.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.587+0000 7fb90cc00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb9080add30 0x7fb908156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52278/0 (socket says 172.21.15.2:52278) 2024-08-17T02:49:29.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.587+0000 7fb90cc00640 1 -- 172.21.15.2:0/943648928 learned_addr learned my addr 172.21.15.2:0/943648928 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:29.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb907e00640 1 --2- 172.21.15.2:0/943648928 >> v2:172.21.15.26:3300/0 conn(0x7fb9080ad960 0x7fb90815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb907400640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9080ca050 0x7fb908156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363948142 0 0) 0x7fb900001490 con 0x7fb9080add30 2024-08-17T02:49:29.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ec0034e0 con 0x7fb9080add30 2024-08-17T02:49:29.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4059688778 0 0) 0x7fb8ec0034e0 con 0x7fb9080add30 2024-08-17T02:49:29.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9080ca050 msgr2=0x7fb908156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:29.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9080ca050 0x7fb908156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 >> v2:172.21.15.26:3300/0 conn(0x7fb9080ad960 msgr2=0x7fb90815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:29.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 --2- 172.21.15.2:0/943648928 >> v2:172.21.15.26:3300/0 conn(0x7fb9080ad960 0x7fb90815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9080ca550 con 0x7fb9080add30 2024-08-17T02:49:29.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7fb900001980 con 0x7fb9080add30 2024-08-17T02:49:29.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 >> v1:172.21.15.2:6789/0 conn(0x7fb9080add30 legacy=0x7fb908156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8ec0039d0 0x7fb8ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004780 0x7fb8ec004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9080ca050 0x7fb8ec005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080cb160 con 0x7fb8ec0039d0 2024-08-17T02:49:29.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080b0d10 con 0x7fb8ec004780 2024-08-17T02:49:29.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.588+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec00b9d0 con 0x7fb9080ca050 2024-08-17T02:49:29.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.589+0000 7fb907e00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8ec0039d0 0x7fb8ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.589+0000 7fb907400640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004780 0x7fb8ec004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.589+0000 7fb90cc00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9080ca050 0x7fb8ec005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.589+0000 7fb907e00640 1 -- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9080ca050 msgr2=0x7fb8ec005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:29.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.589+0000 7fb907e00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9080ca050 0x7fb8ec005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.589+0000 7fb907e00640 1 -- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004780 msgr2=0x7fb8ec004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:29.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.589+0000 7fb907e00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004780 0x7fb8ec004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.589+0000 7fb907e00640 1 -- 172.21.15.2:0/943648928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0034e0 con 0x7fb8ec0039d0 2024-08-17T02:49:29.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.590+0000 7fb907e00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8ec0039d0 0x7fb8ec003de0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009ba0 tx=0x7fb8f80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a603aa935d5b3ef8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.590+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8031400 con 0x7fb8ec0039d0 2024-08-17T02:49:29.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.590+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f802d050 con 0x7fb8ec0039d0 2024-08-17T02:49:29.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.590+0000 7fb906a00640 1 -- 172.21.15.2:0/943648928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8031790 con 0x7fb8ec0039d0 2024-08-17T02:49:29.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.591+0000 7fb90ec00640 1 -- 172.21.15.2:0/943648928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8ec0039d0 msgr2=0x7fb8ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.591+0000 7fb90ec00640 1 --2- 172.21.15.2:0/943648928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8ec0039d0 0x7fb8ec003de0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009ba0 tx=0x7fb8f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.591+0000 7fb90cc00640 1 -- 172.21.15.2:0/943648928 reap_dead start 2024-08-17T02:49:29.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.591+0000 7fb90ec00640 1 -- 172.21.15.2:0/943648928 shutdown_connections 2024-08-17T02:49:29.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.591+0000 7fb90ec00640 1 -- 172.21.15.2:0/943648928 >> 172.21.15.2:0/943648928 conn(0x7fb908066e60 msgr2=0x7fb908067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:29.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.591+0000 7fb90ec00640 1 -- 172.21.15.2:0/943648928 shutdown_connections 2024-08-17T02:49:29.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.591+0000 7fb90ec00640 1 -- 172.21.15.2:0/943648928 wait complete. 2024-08-17T02:49:29.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.592+0000 7fb90ec00640 1 Processor -- start 2024-08-17T02:49:29.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.593+0000 7fb90ec00640 1 -- start start 2024-08-17T02:49:29.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.593+0000 7fb90ec00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec0039d0 0x7fb9081530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.593+0000 7fb90ec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908169d70 0x7fb90814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.593+0000 7fb90ec00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9081561f0 0x7fb908156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.593+0000 7fb90ec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90816c8f0 con 0x7fb908169d70 2024-08-17T02:49:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.593+0000 7fb90ec00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb908156bb0 con 0x7fb8ec0039d0 2024-08-17T02:49:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.593+0000 7fb90ec00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9081537c0 con 0x7fb9081561f0 2024-08-17T02:49:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908169d70 0x7fb90814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908169d70 0x7fb90814b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32986/0 (socket says 172.21.15.2:32986) 2024-08-17T02:49:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 -- 172.21.15.2:0/2080437422 learned_addr learned my addr 172.21.15.2:0/2080437422 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb90cc00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9081561f0 0x7fb908156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907e00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec0039d0 0x7fb9081530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 -- 172.21.15.2:0/2080437422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9081561f0 msgr2=0x7fb908156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9081561f0 0x7fb908156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 -- 172.21.15.2:0/2080437422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec0039d0 msgr2=0x7fb9081530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec0039d0 0x7fb9081530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 -- 172.21.15.2:0/2080437422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90816cb00 con 0x7fb908169d70 2024-08-17T02:49:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.594+0000 7fb907400640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908169d70 0x7fb90814b020 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4011990 tx=0x7fb8f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.595+0000 7fb8ff400640 1 -- 172.21.15.2:0/2080437422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4009e20 con 0x7fb908169d70 2024-08-17T02:49:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.595+0000 7fb8ff400640 1 -- 172.21.15.2:0/2080437422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f400f9d0 con 0x7fb908169d70 2024-08-17T02:49:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.595+0000 7fb8ff400640 1 -- 172.21.15.2:0/2080437422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f400fd90 con 0x7fb908169d70 2024-08-17T02:49:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.595+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90816cde0 con 0x7fb908169d70 2024-08-17T02:49:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.595+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90816a1e0 con 0x7fb908169d70 2024-08-17T02:49:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.596+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb908063fb0 con 0x7fb908169d70 2024-08-17T02:49:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.597+0000 7fb8ff400640 1 -- 172.21.15.2:0/2080437422 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb8f4015670 con 0x7fb908169d70 2024-08-17T02:49:29.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.597+0000 7fb8ff400640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb8e8065180 0x7fb8e8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.598+0000 7fb8ff400640 1 -- 172.21.15.2:0/2080437422 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb8f4082aa0 con 0x7fb908169d70 2024-08-17T02:49:29.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.598+0000 7fb907e00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb8e8065180 0x7fb8e8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.598+0000 7fb907e00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb8e8065180 0x7fb8e8067630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8034000 tx=0x7fb8f8035000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.602+0000 7fb8ff400640 1 -- 172.21.15.2:0/2080437422 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb8f4050740 con 0x7fb908169d70 2024-08-17T02:49:29.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.784+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb908152080 con 0x7fb908169d70 2024-08-17T02:49:29.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.785+0000 7fb8ff400640 1 -- 172.21.15.2:0/2080437422 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18503 (secure 0 0 0) 0x7fb8f4053d60 con 0x7fb908169d70 2024-08-17T02:49:29.787 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:29.787 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:47:24.539782+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:47:07.966246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:47:08.880865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000943317.meta","create_time":"2024-08-17T02:47:20.701176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000943317"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000943317.data","create_time":"2024-08-17T02:47:21.560605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000943317"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb8e8065180 msgr2=0x7fb8e8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb8e8065180 0x7fb8e8067630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8034000 tx=0x7fb8f8035000 comp rx=0 tx=0).stop 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908169d70 msgr2=0x7fb90814b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908169d70 0x7fb90814b020 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4011990 tx=0x7fb8f4008040 comp rx=0 tx=0).stop 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 shutdown_connections 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fb8e8065180 0x7fb8e8067630 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fb9081561f0 0x7fb908156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908169d70 0x7fb90814b020 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 --2- 172.21.15.2:0/2080437422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec0039d0 0x7fb9081530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.787+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 >> 172.21.15.2:0/2080437422 conn(0x7fb908066e60 msgr2=0x7fb908154d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:29.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.788+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 shutdown_connections 2024-08-17T02:49:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.788+0000 7fb90ec00640 1 -- 172.21.15.2:0/2080437422 wait complete. 2024-08-17T02:49:29.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:49:29.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.955+0000 7f8342400640 1 Processor -- start 2024-08-17T02:49:29.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.955+0000 7f8342400640 1 -- start start 2024-08-17T02:49:29.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.956+0000 7f8342400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f833c06eca0 0x7f833c1638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.956+0000 7f8342400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c0cbc50 con 0x7f833c158dd0 2024-08-17T02:49:29.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.956+0000 7f8342400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c0cbf30 con 0x7f833c158a00 2024-08-17T02:49:29.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.956+0000 7f8342400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c159230 con 0x7f833c06eca0 2024-08-17T02:49:29.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.956+0000 7f833be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f833c158dd0 0x7f833c06e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52280/0 (socket says 172.21.15.2:52280) 2024-08-17T02:49:29.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.956+0000 7f833be00640 1 -- 172.21.15.2:0/147954946 learned_addr learned my addr 172.21.15.2:0/147954946 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:29.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.956+0000 7f8341a00640 1 --2- 172.21.15.2:0/147954946 >> v2:172.21.15.26:3300/0 conn(0x7f833c06eca0 0x7f833c1638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.957+0000 7f833b400640 1 -- 172.21.15.2:0/147954946 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726280835 0 0) 0x7f833c0cbc50 con 0x7f833c158dd0 2024-08-17T02:49:29.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.957+0000 7f833b400640 1 -- 172.21.15.2:0/147954946 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83240034e0 con 0x7f833c158dd0 2024-08-17T02:49:29.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.957+0000 7f8341a00640 1 -- 172.21.15.2:0/147954946 >> v1:172.21.15.26:6789/0 conn(0x7f833c158a00 legacy=0x7f833c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.957+0000 7f8341a00640 1 -- 172.21.15.2:0/147954946 >> v1:172.21.15.2:6789/0 conn(0x7f833c158dd0 legacy=0x7f833c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.957+0000 7f8341a00640 1 -- 172.21.15.2:0/147954946 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0cc210 con 0x7f833c06eca0 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.958+0000 7f8341a00640 1 --2- 172.21.15.2:0/147954946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c06eca0 0x7f833c1638c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8334009e60 tx=0x7f8334009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf72374ec956cbf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.958+0000 7f833b400640 1 -- 172.21.15.2:0/147954946 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334007550 con 0x7f833c06eca0 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.958+0000 7f833b400640 1 -- 172.21.15.2:0/147954946 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833402d050 con 0x7f833c06eca0 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.958+0000 7f833b400640 1 -- 172.21.15.2:0/147954946 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334007900 con 0x7f833c06eca0 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.959+0000 7f8342400640 1 -- 172.21.15.2:0/147954946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c06eca0 msgr2=0x7f833c1638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.959+0000 7f8342400640 1 --2- 172.21.15.2:0/147954946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c06eca0 0x7f833c1638c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8334009e60 tx=0x7f8334009780 comp rx=0 tx=0).stop 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.959+0000 7f8342400640 1 -- 172.21.15.2:0/147954946 shutdown_connections 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.959+0000 7f8342400640 1 --2- 172.21.15.2:0/147954946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c06eca0 0x7f833c1638c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.959+0000 7f8342400640 1 -- 172.21.15.2:0/147954946 >> 172.21.15.2:0/147954946 conn(0x7f833c0cfb80 msgr2=0x7f833c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:29.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.959+0000 7f8342400640 1 -- 172.21.15.2:0/147954946 shutdown_connections 2024-08-17T02:49:29.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.959+0000 7f8342400640 1 -- 172.21.15.2:0/147954946 wait complete. 2024-08-17T02:49:29.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.960+0000 7f8342400640 1 Processor -- start 2024-08-17T02:49:29.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.961+0000 7f8342400640 1 -- start start 2024-08-17T02:49:29.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.961+0000 7f8342400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06eca0 0x7f833c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.961+0000 7f8342400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c158a00 0x7f833c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.961+0000 7f8342400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f833c158dd0 0x7f833c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.961+0000 7f8342400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c168c00 con 0x7f833c06eca0 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.961+0000 7f8342400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c0c9110 con 0x7f833c158a00 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.961+0000 7f8342400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c0c93f0 con 0x7f833c158dd0 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06eca0 0x7f833c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06eca0 0x7f833c15bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32990/0 (socket says 172.21.15.2:32990) 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 -- 172.21.15.2:0/710860466 learned_addr learned my addr 172.21.15.2:0/710860466 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341a00640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f833c158dd0 0x7f833c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f833be00640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c158a00 0x7f833c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 -- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f833c158dd0 msgr2=0x7f833c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f833c158dd0 0x7f833c157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 -- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c158a00 msgr2=0x7f833c0c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c158a00 0x7f833c0c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 -- 172.21.15.2:0/710860466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8334009a20 con 0x7f833c06eca0 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f833be00640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c158a00 0x7f833c0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.962+0000 7f8341000640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06eca0 0x7f833c15bac0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f833000c560 tx=0x7f8330007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.963+0000 7f832fe00640 1 -- 172.21.15.2:0/710860466 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330011590 con 0x7f833c06eca0 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.963+0000 7f832fe00640 1 -- 172.21.15.2:0/710860466 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8330011710 con 0x7f833c06eca0 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.963+0000 7f832fe00640 1 -- 172.21.15.2:0/710860466 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330011ad0 con 0x7f833c06eca0 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.963+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c0c96d0 con 0x7f833c06eca0 2024-08-17T02:49:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.963+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c0c80f0 con 0x7f833c06eca0 2024-08-17T02:49:29.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.964+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c0c8310 con 0x7f833c06eca0 2024-08-17T02:49:29.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.964+0000 7f832fe00640 1 -- 172.21.15.2:0/710860466 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f833001b3b0 con 0x7f833c06eca0 2024-08-17T02:49:29.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.965+0000 7f832fe00640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f831c065150 0x7f831c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:29.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.965+0000 7f832fe00640 1 -- 172.21.15.2:0/710860466 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8330081d60 con 0x7f833c06eca0 2024-08-17T02:49:29.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.966+0000 7f833be00640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f831c065150 0x7f831c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:29.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.966+0000 7f833be00640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f831c065150 0x7f831c067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f833c0c86e0 tx=0x7f8328009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:29.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:29.969+0000 7f832fe00640 1 -- 172.21.15.2:0/710860466 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f833c0c8310 con 0x7f833c06eca0 2024-08-17T02:49:30.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.193+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f833c0c8310 con 0x7f833c06eca0 2024-08-17T02:49:30.195 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-08-17T02:49:30.193+0000 7fa73ce00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:49:30.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.198+0000 7f832fe00640 1 -- 172.21.15.2:0/710860466 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f833c0c8310 con 0x7f833c06eca0 2024-08-17T02:49:30.199 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:49:30.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f831c065150 msgr2=0x7f831c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f831c065150 0x7f831c067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f833c0c86e0 tx=0x7f8328009040 comp rx=0 tx=0).stop 2024-08-17T02:49:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06eca0 msgr2=0x7f833c15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06eca0 0x7f833c15bac0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f833000c560 tx=0x7f8330007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 shutdown_connections 2024-08-17T02:49:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f831c065150 0x7f831c067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f833c158dd0 0x7f833c157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f833c158a00 0x7f833c0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 --2- 172.21.15.2:0/710860466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06eca0 0x7f833c15bac0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 >> 172.21.15.2:0/710860466 conn(0x7f833c0cfb80 msgr2=0x7f833c0cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 shutdown_connections 2024-08-17T02:49:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.201+0000 7f8342400640 1 -- 172.21.15.2:0/710860466 wait complete. 2024-08-17T02:49:30.211 INFO:tasks.ceph.mds.a.smithi002.stderr: -7278> 2024-08-17T02:47:12.353+0000 7fbef1c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:49:30.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:49:30.258 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-08-17T02:49:30.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.373+0000 7fa629e00640 1 Processor -- start 2024-08-17T02:49:30.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.373+0000 7fa629e00640 1 -- start start 2024-08-17T02:49:30.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa629e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa629e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa6240ca050 0x7fa624156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa629e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62415b5e0 con 0x7fa6240add30 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa629e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6240cb160 con 0x7fa6240ca050 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa629e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240b0d10 con 0x7fa6240ad960 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa623400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa6240add30 0x7fa624156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52310/0 (socket says 172.21.15.2:52310) 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa623400640 1 -- 172.21.15.2:0/3230497543 learned_addr learned my addr 172.21.15.2:0/3230497543 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa622a00640 1 --2- 172.21.15.2:0/3230497543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.374+0000 7fa622000640 1 --2- 172.21.15.2:0/3230497543 >> v2:172.21.15.26:3300/0 conn(0x7fa6240ca050 0x7fa624156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.375+0000 7fa621600640 1 -- 172.21.15.2:0/3230497543 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022534048 0 0) 0x7fa61c001490 con 0x7fa6240add30 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.375+0000 7fa621600640 1 -- 172.21.15.2:0/3230497543 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6080034e0 con 0x7fa6240add30 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.375+0000 7fa622a00640 1 -- 172.21.15.2:0/3230497543 >> v2:172.21.15.26:3300/0 conn(0x7fa6240ca050 msgr2=0x7fa624156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.375+0000 7fa622a00640 1 --2- 172.21.15.2:0/3230497543 >> v2:172.21.15.26:3300/0 conn(0x7fa6240ca050 0x7fa624156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.375+0000 7fa622a00640 1 -- 172.21.15.2:0/3230497543 >> v1:172.21.15.2:6789/0 conn(0x7fa6240add30 legacy=0x7fa624156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:30.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.375+0000 7fa622a00640 1 -- 172.21.15.2:0/3230497543 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6240ca550 con 0x7fa6240ad960 2024-08-17T02:49:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.376+0000 7fa622a00640 1 --2- 172.21.15.2:0/3230497543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62415b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa614009850 tx=0x7fa6140090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=845732205fdd308a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.376+0000 7fa621600640 1 -- 172.21.15.2:0/3230497543 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61402ae10 con 0x7fa6240ad960 2024-08-17T02:49:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.376+0000 7fa621600640 1 -- 172.21.15.2:0/3230497543 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614032440 con 0x7fa6240ad960 2024-08-17T02:49:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.376+0000 7fa621600640 1 -- 172.21.15.2:0/3230497543 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614032820 con 0x7fa6240ad960 2024-08-17T02:49:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.377+0000 7fa629e00640 1 -- 172.21.15.2:0/3230497543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 msgr2=0x7fa62415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:30.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.377+0000 7fa629e00640 1 --2- 172.21.15.2:0/3230497543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62415b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa614009850 tx=0x7fa6140090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.377+0000 7fa629e00640 1 -- 172.21.15.2:0/3230497543 shutdown_connections 2024-08-17T02:49:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.377+0000 7fa629e00640 1 --2- 172.21.15.2:0/3230497543 >> v2:172.21.15.26:3300/0 conn(0x7fa6240ca050 0x7fa624156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.377+0000 7fa629e00640 1 --2- 172.21.15.2:0/3230497543 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62415b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.377+0000 7fa629e00640 1 -- 172.21.15.2:0/3230497543 >> 172.21.15.2:0/3230497543 conn(0x7fa624066e60 msgr2=0x7fa624067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.377+0000 7fa629e00640 1 -- 172.21.15.2:0/3230497543 shutdown_connections 2024-08-17T02:49:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.377+0000 7fa629e00640 1 -- 172.21.15.2:0/3230497543 wait complete. 2024-08-17T02:49:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.378+0000 7fa629e00640 1 Processor -- start 2024-08-17T02:49:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.379+0000 7fa629e00640 1 -- start start 2024-08-17T02:49:30.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.379+0000 7fa629e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:30.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.379+0000 7fa629e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6240add30 0x7fa62414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.379+0000 7fa629e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6240ca050 0x7fa624154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.379+0000 7fa629e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62406b7f0 con 0x7fa6240ca050 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.379+0000 7fa629e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624151870 con 0x7fa6240add30 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.379+0000 7fa629e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa624151b50 con 0x7fa6240ad960 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6240ca050 0x7fa624154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6240ca050 0x7fa624154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33026/0 (socket says 172.21.15.2:33026) 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 -- 172.21.15.2:0/537523097 learned_addr learned my addr 172.21.15.2:0/537523097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa622a00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa622000640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6240add30 0x7fa62414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 -- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 msgr2=0x7fa62406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 -- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6240add30 msgr2=0x7fa62414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6240add30 0x7fa62414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 -- 172.21.15.2:0/537523097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614009390 con 0x7fa6240ca050 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa622000640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6240add30 0x7fa62414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.380+0000 7fa623400640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6240ca050 0x7fa624154bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00cd00 tx=0x7fa61c001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.381+0000 7fa61a000640 1 -- 172.21.15.2:0/537523097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00a850 con 0x7fa6240ca050 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.381+0000 7fa61a000640 1 -- 172.21.15.2:0/537523097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00a9b0 con 0x7fa6240ca050 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.381+0000 7fa61a000640 1 -- 172.21.15.2:0/537523097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00ad70 con 0x7fa6240ca050 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.381+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa624151e30 con 0x7fa6240ca050 2024-08-17T02:49:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.381+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62414b4e0 con 0x7fa6240ca050 2024-08-17T02:49:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.382+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa624152020 con 0x7fa6240ca050 2024-08-17T02:49:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.383+0000 7fa61a000640 1 -- 172.21.15.2:0/537523097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa61c007300 con 0x7fa6240ca050 2024-08-17T02:49:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.384+0000 7fa61a000640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa604065150 0x7fa604067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.384+0000 7fa61a000640 1 -- 172.21.15.2:0/537523097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fa61c082970 con 0x7fa6240ca050 2024-08-17T02:49:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.384+0000 7fa622a00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa604065150 0x7fa604067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.385+0000 7fa622a00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa604065150 0x7fa604067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa614034000 tx=0x7fa614032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.388+0000 7fa61a000640 1 -- 172.21.15.2:0/537523097 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa61c0505a0 con 0x7fa6240ca050 2024-08-17T02:49:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:30.609+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa62415b5e0 con 0x7fa6240ca050 2024-08-17T02:49:31.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.200+0000 7fa61a000640 1 -- 172.21.15.2:0/537523097 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa62415b5e0 con 0x7fa6240ca050 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa604065150 msgr2=0x7fa604067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa604065150 0x7fa604067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa614034000 tx=0x7fa614032000 comp rx=0 tx=0).stop 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6240ca050 msgr2=0x7fa624154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6240ca050 0x7fa624154bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00cd00 tx=0x7fa61c001ad0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 shutdown_connections 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6240ca050 0x7fa624154bf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6240add30 0x7fa62414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa604065150 0x7fa604067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 --2- 172.21.15.2:0/537523097 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa6240ad960 0x7fa62406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 >> 172.21.15.2:0/537523097 conn(0x7fa624066e60 msgr2=0x7fa6240affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:31.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 shutdown_connections 2024-08-17T02:49:31.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.203+0000 7fa629e00640 1 -- 172.21.15.2:0/537523097 wait complete. 2024-08-17T02:49:31.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:49:31.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.419+0000 7f7737200640 1 Processor -- start 2024-08-17T02:49:31.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.420+0000 7f7737200640 1 -- start start 2024-08-17T02:49:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.421+0000 7f7737200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300cae20 0x7f77300adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.421+0000 7f7737200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77300ca060 con 0x7f77300ae6e0 2024-08-17T02:49:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.421+0000 7f7737200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77300ca340 con 0x7f77300ad780 2024-08-17T02:49:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.421+0000 7f7737200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77300ca620 con 0x7f77300cae20 2024-08-17T02:49:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.421+0000 7f7736800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f77300ae6e0 0x7f7730157100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52318/0 (socket says 172.21.15.2:52318) 2024-08-17T02:49:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.421+0000 7f7736800640 1 -- 172.21.15.2:0/4286729709 learned_addr learned my addr 172.21.15.2:0/4286729709 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:31.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.421+0000 7f7735400640 1 --2- 172.21.15.2:0/4286729709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300cae20 0x7f77300adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.421+0000 7f7734a00640 1 -- 172.21.15.2:0/4286729709 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928489605 0 0) 0x7f77300ca060 con 0x7f77300ae6e0 2024-08-17T02:49:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.422+0000 7f7734a00640 1 -- 172.21.15.2:0/4286729709 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77180034e0 con 0x7f77300ae6e0 2024-08-17T02:49:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.422+0000 7f7734a00640 1 -- 172.21.15.2:0/4286729709 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243877887 0 0) 0x7f77300ca340 con 0x7f77300ad780 2024-08-17T02:49:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.422+0000 7f7735400640 1 -- 172.21.15.2:0/4286729709 >> v1:172.21.15.26:6789/0 conn(0x7f77300ad780 legacy=0x7f77300af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.422+0000 7f7735400640 1 -- 172.21.15.2:0/4286729709 >> v1:172.21.15.2:6789/0 conn(0x7f77300ae6e0 legacy=0x7f7730157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.422+0000 7f7735400640 1 -- 172.21.15.2:0/4286729709 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77300ca900 con 0x7f77300cae20 2024-08-17T02:49:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.423+0000 7f7735400640 1 --2- 172.21.15.2:0/4286729709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300cae20 0x7f77300adb50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7720009880 tx=0x7f77200090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72eeaa815a3f4c12 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.423+0000 7f7734a00640 1 -- 172.21.15.2:0/4286729709 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772002ae10 con 0x7f77300cae20 2024-08-17T02:49:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.423+0000 7f7734a00640 1 -- 172.21.15.2:0/4286729709 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7720032440 con 0x7f77300cae20 2024-08-17T02:49:31.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.423+0000 7f7734a00640 1 -- 172.21.15.2:0/4286729709 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200327c0 con 0x7f77300cae20 2024-08-17T02:49:31.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.424+0000 7f7737200640 1 -- 172.21.15.2:0/4286729709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300cae20 msgr2=0x7f77300adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.424+0000 7f7737200640 1 --2- 172.21.15.2:0/4286729709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300cae20 0x7f77300adb50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7720009880 tx=0x7f77200090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.424+0000 7f7737200640 1 -- 172.21.15.2:0/4286729709 shutdown_connections 2024-08-17T02:49:31.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.424+0000 7f7737200640 1 --2- 172.21.15.2:0/4286729709 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300cae20 0x7f77300adb50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.424+0000 7f7737200640 1 -- 172.21.15.2:0/4286729709 >> 172.21.15.2:0/4286729709 conn(0x7f7730066e60 msgr2=0x7f7730067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:31.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.424+0000 7f7737200640 1 -- 172.21.15.2:0/4286729709 shutdown_connections 2024-08-17T02:49:31.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.424+0000 7f7737200640 1 -- 172.21.15.2:0/4286729709 wait complete. 2024-08-17T02:49:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.425+0000 7f7737200640 1 Processor -- start 2024-08-17T02:49:31.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.425+0000 7f7737200640 1 -- start start 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7737200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300ad780 0x7f773013a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7737200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77300ae6e0 0x7f7730155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7737200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77300cae20 0x7f77301562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7737200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773013a9c0 con 0x7f77300cae20 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7737200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773013b540 con 0x7f77300ae6e0 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7737200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773013a6b0 con 0x7f77300ad780 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7736800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77300cae20 0x7f77301562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7736800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77300cae20 0x7f77301562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33032/0 (socket says 172.21.15.2:33032) 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7736800640 1 -- 172.21.15.2:0/1905083103 learned_addr learned my addr 172.21.15.2:0/1905083103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.426+0000 7f7735400640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77300ae6e0 0x7f7730155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7735e00640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300ad780 0x7f773013a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7736800640 1 -- 172.21.15.2:0/1905083103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300ad780 msgr2=0x7f773013a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7736800640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300ad780 0x7f773013a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7736800640 1 -- 172.21.15.2:0/1905083103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77300ae6e0 msgr2=0x7f7730155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7736800640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77300ae6e0 0x7f7730155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7736800640 1 -- 172.21.15.2:0/1905083103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7720009390 con 0x7f77300cae20 2024-08-17T02:49:31.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7736800640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77300cae20 0x7f77301562a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f772c00cca0 tx=0x7f772c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7729600640 1 -- 172.21.15.2:0/1905083103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00a850 con 0x7f77300cae20 2024-08-17T02:49:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7729600640 1 -- 172.21.15.2:0/1905083103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c00a9b0 con 0x7f77300cae20 2024-08-17T02:49:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.427+0000 7f7729600640 1 -- 172.21.15.2:0/1905083103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c00ad70 con 0x7f77300cae20 2024-08-17T02:49:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.428+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773013ac10 con 0x7f77300cae20 2024-08-17T02:49:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.428+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773013b1d0 con 0x7f77300cae20 2024-08-17T02:49:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.429+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773013b6d0 con 0x7f77300cae20 2024-08-17T02:49:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.430+0000 7f7729600640 1 -- 172.21.15.2:0/1905083103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f772c007300 con 0x7f77300cae20 2024-08-17T02:49:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.430+0000 7f7729600640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7714065180 0x7f7714067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.431+0000 7f7729600640 1 -- 172.21.15.2:0/1905083103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f772c082820 con 0x7f77300cae20 2024-08-17T02:49:31.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.431+0000 7f7735e00640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7714065180 0x7f7714067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:31.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.431+0000 7f7735e00640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7714065180 0x7f7714067630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7724007fd0 tx=0x7f7724007c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:31.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.434+0000 7f7729600640 1 -- 172.21.15.2:0/1905083103 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f772c050630 con 0x7f77300cae20 2024-08-17T02:49:31.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:31.618+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7730063f10 con 0x7f77300cae20 2024-08-17T02:49:32.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.325+0000 7f7729600640 1 -- 172.21.15.2:0/1905083103 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f772c053c50 con 0x7f77300cae20 2024-08-17T02:49:32.327 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7714065180 msgr2=0x7f7714067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7714065180 0x7f7714067630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7724007fd0 tx=0x7f7724007c50 comp rx=0 tx=0).stop 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77300cae20 msgr2=0x7f77301562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77300cae20 0x7f77301562a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f772c00cca0 tx=0x7f772c001ae0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 shutdown_connections 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77300cae20 0x7f77301562a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77300ae6e0 0x7f7730155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7714065180 0x7f7714067630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 --2- 172.21.15.2:0/1905083103 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f77300ad780 0x7f773013a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 >> 172.21.15.2:0/1905083103 conn(0x7f7730066e60 msgr2=0x7f773006dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 shutdown_connections 2024-08-17T02:49:32.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.329+0000 7f7737200640 1 -- 172.21.15.2:0/1905083103 wait complete. 2024-08-17T02:49:32.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:49:32.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.515+0000 7f60b6000640 1 Processor -- start 2024-08-17T02:49:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.516+0000 7f60b6000640 1 -- start start 2024-08-17T02:49:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b6000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60b00ad780 0x7f60b00adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b6000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00ae6e0 0x7f60b0157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b6000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b00ca060 con 0x7f60b00cae20 2024-08-17T02:49:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b6000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b00aead0 con 0x7f60b00ad780 2024-08-17T02:49:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b6000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00ca340 con 0x7f60b00ae6e0 2024-08-17T02:49:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b4c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60b00ad780 0x7f60b00adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b4c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60b00ad780 0x7f60b00adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33036/0 (socket says 172.21.15.2:33036) 2024-08-17T02:49:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b4c00640 1 -- 172.21.15.2:0/3066783785 learned_addr learned my addr 172.21.15.2:0/3066783785 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.517+0000 7f60b5600640 1 --2- 172.21.15.2:0/3066783785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00ae6e0 0x7f60b0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.518+0000 7f60b4c00640 1 -- 172.21.15.2:0/3066783785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00ae6e0 msgr2=0x7f60b0157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.518+0000 7f60b4c00640 1 --2- 172.21.15.2:0/3066783785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00ae6e0 0x7f60b0157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.518+0000 7f60b4c00640 1 -- 172.21.15.2:0/3066783785 >> v1:172.21.15.26:6789/0 conn(0x7f60b00cae20 legacy=0x7f60b00af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.518+0000 7f60b4c00640 1 -- 172.21.15.2:0/3066783785 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b00ca620 con 0x7f60b00ad780 2024-08-17T02:49:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.519+0000 7f60b4c00640 1 --2- 172.21.15.2:0/3066783785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ad780 0x7f60b00adb50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009910 tx=0x7f60a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8313805cdf138d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.519+0000 7f60af400640 1 -- 172.21.15.2:0/3066783785 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a402ae40 con 0x7f60b00ad780 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.519+0000 7f60af400640 1 -- 172.21.15.2:0/3066783785 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4032440 con 0x7f60b00ad780 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.519+0000 7f60af400640 1 -- 172.21.15.2:0/3066783785 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4032820 con 0x7f60b00ad780 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.520+0000 7f60b6000640 1 -- 172.21.15.2:0/3066783785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ad780 msgr2=0x7f60b00adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.520+0000 7f60b6000640 1 --2- 172.21.15.2:0/3066783785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ad780 0x7f60b00adb50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009910 tx=0x7f60a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.520+0000 7f60b6000640 1 -- 172.21.15.2:0/3066783785 shutdown_connections 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.520+0000 7f60b6000640 1 --2- 172.21.15.2:0/3066783785 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00ae6e0 0x7f60b0157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.520+0000 7f60b6000640 1 --2- 172.21.15.2:0/3066783785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ad780 0x7f60b00adb50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.520+0000 7f60b6000640 1 -- 172.21.15.2:0/3066783785 >> 172.21.15.2:0/3066783785 conn(0x7f60b0066e60 msgr2=0x7f60b0067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:32.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.520+0000 7f60b6000640 1 -- 172.21.15.2:0/3066783785 shutdown_connections 2024-08-17T02:49:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.520+0000 7f60b6000640 1 -- 172.21.15.2:0/3066783785 wait complete. 2024-08-17T02:49:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.521+0000 7f60b6000640 1 Processor -- start 2024-08-17T02:49:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.521+0000 7f60b6000640 1 -- start start 2024-08-17T02:49:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.522+0000 7f60b6000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b00ad780 0x7f60b016a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.522+0000 7f60b6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ae6e0 0x7f60b0169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.522+0000 7f60b6000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00cae20 0x7f60b016beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.522+0000 7f60b6000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00a88e0 con 0x7f60b00ae6e0 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.522+0000 7f60b6000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00a9140 con 0x7f60b00ad780 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.522+0000 7f60b6000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00c0920 con 0x7f60b00cae20 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ae6e0 0x7f60b0169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60b4c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b00ad780 0x7f60b016a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ae6e0 0x7f60b0169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33048/0 (socket says 172.21.15.2:33048) 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60b5600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00cae20 0x7f60b016beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60b4c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b00ad780 0x7f60b016a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:34336/0 (socket says 172.21.15.2:34336) 2024-08-17T02:49:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 -- 172.21.15.2:0/931571058 learned_addr learned my addr 172.21.15.2:0/931571058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:32.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 -- 172.21.15.2:0/931571058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00cae20 msgr2=0x7f60b016beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:32.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00cae20 0x7f60b016beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 -- 172.21.15.2:0/931571058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b00ad780 msgr2=0x7f60b016a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b00ad780 0x7f60b016a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 -- 172.21.15.2:0/931571058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4009450 con 0x7f60b00ae6e0 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.523+0000 7f60afe00640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ae6e0 0x7f60b0169b30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c4f0 tx=0x7f609c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.524+0000 7f60a3e00640 1 -- 172.21.15.2:0/931571058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c011590 con 0x7f60b00ae6e0 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.524+0000 7f60a3e00640 1 -- 172.21.15.2:0/931571058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c011710 con 0x7f60b00ae6e0 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.524+0000 7f60a3e00640 1 -- 172.21.15.2:0/931571058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c011ad0 con 0x7f60b00ae6e0 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.524+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b016a070 con 0x7f60b00ae6e0 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.524+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b00a8af0 con 0x7f60b00ae6e0 2024-08-17T02:49:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.525+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b00a92f0 con 0x7f60b00ae6e0 2024-08-17T02:49:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.525+0000 7f60a3e00640 1 -- 172.21.15.2:0/931571058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f609c01a360 con 0x7f60b00ae6e0 2024-08-17T02:49:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.526+0000 7f60a3e00640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6090065180 0x7f6090067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.526+0000 7f60a3e00640 1 -- 172.21.15.2:0/931571058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f609c0815d0 con 0x7f60b00ae6e0 2024-08-17T02:49:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.527+0000 7f60b4c00640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6090065180 0x7f6090067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.527+0000 7f60b4c00640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6090065180 0x7f6090067630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60a4034000 tx=0x7f60a4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:32.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.530+0000 7f60a3e00640 1 -- 172.21.15.2:0/931571058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f60b00a92f0 con 0x7f60b00ae6e0 2024-08-17T02:49:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:32.710+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f60b00a92f0 con 0x7f60b00ae6e0 2024-08-17T02:49:33.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.339+0000 7f60a3e00640 1 -- 172.21.15.2:0/931571058 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f60b00a92f0 con 0x7f60b00ae6e0 2024-08-17T02:49:33.341 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-08-17T02:49:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6090065180 msgr2=0x7f6090067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6090065180 0x7f6090067630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60a4034000 tx=0x7f60a4032000 comp rx=0 tx=0).stop 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ae6e0 msgr2=0x7f60b0169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ae6e0 0x7f60b0169b30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c4f0 tx=0x7f609c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 shutdown_connections 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6090065180 0x7f6090067630 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f60b00cae20 0x7f60b016beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60b00ae6e0 0x7f60b0169b30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 --2- 172.21.15.2:0/931571058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f60b00ad780 0x7f60b016a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.343+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 >> 172.21.15.2:0/931571058 conn(0x7f60b0066e60 msgr2=0x7f60b0069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.344+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 shutdown_connections 2024-08-17T02:49:33.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.344+0000 7f60b6000640 1 -- 172.21.15.2:0/931571058 wait complete. 2024-08-17T02:49:33.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.518+0000 7f2883200640 1 Processor -- start 2024-08-17T02:49:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.518+0000 7f2883200640 1 -- start start 2024-08-17T02:49:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2883200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2884158c60 0x7f288415a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2883200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28840b1920 0x7f28840b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2883200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288415b6b0 con 0x7f2884159030 2024-08-17T02:49:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2883200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840b0540 con 0x7f2884158c60 2024-08-17T02:49:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2883200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288415aac0 con 0x7f28840b1920 2024-08-17T02:49:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2881400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2884159030 0x7f28840ca8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47034/0 (socket says 172.21.15.2:47034) 2024-08-17T02:49:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2881400640 1 -- 172.21.15.2:0/1506912575 learned_addr learned my addr 172.21.15.2:0/1506912575 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2882800640 1 --2- 172.21.15.2:0/1506912575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28840b1920 0x7f28840b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.519+0000 7f2881e00640 1 --2- 172.21.15.2:0/1506912575 >> v2:172.21.15.26:3300/0 conn(0x7f2884158c60 0x7f288415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.520+0000 7f2880a00640 1 -- 172.21.15.2:0/1506912575 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579719958 0 0) 0x7f288415b6b0 con 0x7f2884159030 2024-08-17T02:49:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.520+0000 7f2880a00640 1 -- 172.21.15.2:0/1506912575 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28680034e0 con 0x7f2884159030 2024-08-17T02:49:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.520+0000 7f2882800640 1 -- 172.21.15.2:0/1506912575 >> v2:172.21.15.26:3300/0 conn(0x7f2884158c60 msgr2=0x7f288415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.520+0000 7f2882800640 1 --2- 172.21.15.2:0/1506912575 >> v2:172.21.15.26:3300/0 conn(0x7f2884158c60 0x7f288415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.520+0000 7f2882800640 1 -- 172.21.15.2:0/1506912575 >> v1:172.21.15.2:6789/0 conn(0x7f2884159030 legacy=0x7f28840ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.520+0000 7f2882800640 1 -- 172.21.15.2:0/1506912575 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288415ad80 con 0x7f28840b1920 2024-08-17T02:49:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.521+0000 7f2882800640 1 --2- 172.21.15.2:0/1506912575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28840b1920 0x7f28840b1d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f287c009e60 tx=0x7f287c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=add54f24672b4d8d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.521+0000 7f2880a00640 1 -- 172.21.15.2:0/1506912575 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c007550 con 0x7f28840b1920 2024-08-17T02:49:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.521+0000 7f2880a00640 1 -- 172.21.15.2:0/1506912575 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c02d050 con 0x7f28840b1920 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.521+0000 7f2880a00640 1 -- 172.21.15.2:0/1506912575 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c007920 con 0x7f28840b1920 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.522+0000 7f2883200640 1 -- 172.21.15.2:0/1506912575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28840b1920 msgr2=0x7f28840b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.522+0000 7f2883200640 1 --2- 172.21.15.2:0/1506912575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28840b1920 0x7f28840b1d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f287c009e60 tx=0x7f287c009780 comp rx=0 tx=0).stop 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.522+0000 7f2883200640 1 -- 172.21.15.2:0/1506912575 shutdown_connections 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.522+0000 7f2883200640 1 --2- 172.21.15.2:0/1506912575 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f28840b1920 0x7f28840b1d40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.522+0000 7f2883200640 1 --2- 172.21.15.2:0/1506912575 >> v2:172.21.15.26:3300/0 conn(0x7f2884158c60 0x7f288415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.522+0000 7f2883200640 1 -- 172.21.15.2:0/1506912575 >> 172.21.15.2:0/1506912575 conn(0x7f288406e590 msgr2=0x7f288406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.522+0000 7f2883200640 1 -- 172.21.15.2:0/1506912575 shutdown_connections 2024-08-17T02:49:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.522+0000 7f2883200640 1 -- 172.21.15.2:0/1506912575 wait complete. 2024-08-17T02:49:33.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.524+0000 7f2883200640 1 Processor -- start 2024-08-17T02:49:33.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.524+0000 7f2883200640 1 -- start start 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2883200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28840b1920 0x7f28841555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2883200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2884158c60 0x7f288416c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2883200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884159030 0x7f288416c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2883200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c7870 con 0x7f28840b1920 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2883200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c6c60 con 0x7f2884159030 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2883200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c6f40 con 0x7f2884158c60 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28840b1920 0x7f28841555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28840b1920 0x7f28841555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55866/0 (socket says 172.21.15.2:55866) 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881e00640 1 -- 172.21.15.2:0/4240411689 learned_addr learned my addr 172.21.15.2:0/4240411689 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2882800640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884159030 0x7f288416c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881400640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2884158c60 0x7f288416c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881e00640 1 -- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2884158c60 msgr2=0x7f288416c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881e00640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2884158c60 0x7f288416c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881e00640 1 -- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884159030 msgr2=0x7f288416c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881e00640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884159030 0x7f288416c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2881e00640 1 -- 172.21.15.2:0/4240411689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c009a20 con 0x7f28840b1920 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.525+0000 7f2882800640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884159030 0x7f288416c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.526+0000 7f2881e00640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28840b1920 0x7f28841555e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f287400ea20 tx=0x7f28740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.526+0000 7f2879600640 1 -- 172.21.15.2:0/4240411689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400ca10 con 0x7f28840b1920 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.526+0000 7f2879600640 1 -- 172.21.15.2:0/4240411689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400cb70 con 0x7f28840b1920 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.526+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840c7220 con 0x7f28840b1920 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.526+0000 7f2879600640 1 -- 172.21.15.2:0/4240411689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874013470 con 0x7f28840b1920 2024-08-17T02:49:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.526+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28841566e0 con 0x7f28840b1920 2024-08-17T02:49:33.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.527+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288415a5f0 con 0x7f28840b1920 2024-08-17T02:49:33.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.528+0000 7f2879600640 1 -- 172.21.15.2:0/4240411689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2874013860 con 0x7f28840b1920 2024-08-17T02:49:33.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.529+0000 7f2879600640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2864065180 0x7f2864067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.529+0000 7f2879600640 1 -- 172.21.15.2:0/4240411689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2874082850 con 0x7f28840b1920 2024-08-17T02:49:33.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.529+0000 7f2881400640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2864065180 0x7f2864067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.530+0000 7f2881400640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2864065180 0x7f2864067630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f288415a450 tx=0x7f2870009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.533+0000 7f2879600640 1 -- 172.21.15.2:0/4240411689 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f288415a5f0 con 0x7f28840b1920 2024-08-17T02:49:33.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.728+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28840cdab0 con 0x7f28840b1920 2024-08-17T02:49:33.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.729+0000 7f2879600640 1 -- 172.21.15.2:0/4240411689 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15414 (secure 0 0 0) 0x7f28840cdab0 con 0x7f28840b1920 2024-08-17T02:49:33.730 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:33.730 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:49:33.332178+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000943317.meta","create_time":"2024-08-17T02:47:20.701176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000943317"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000943317.data","create_time":"2024-08-17T02:47:21.560605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000943317"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6837/1889487336":"2024-08-18T02:49:30.194821+0000","172.21.15.2:6835/1889487336":"2024-08-18T02:49:30.194821+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2864065180 msgr2=0x7f2864067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2864065180 0x7f2864067630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f288415a450 tx=0x7f2870009040 comp rx=0 tx=0).stop 2024-08-17T02:49:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28840b1920 msgr2=0x7f28841555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28840b1920 0x7f28841555e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f287400ea20 tx=0x7f28740090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 shutdown_connections 2024-08-17T02:49:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2884159030 0x7f288416c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2864065180 0x7f2864067630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2884158c60 0x7f288416c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 --2- 172.21.15.2:0/4240411689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28840b1920 0x7f28841555e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 >> 172.21.15.2:0/4240411689 conn(0x7f288406e590 msgr2=0x7f28840b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 shutdown_connections 2024-08-17T02:49:33.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.731+0000 7f2883200640 1 -- 172.21.15.2:0/4240411689 wait complete. 2024-08-17T02:49:33.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:46:07.068392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000943317.meta', 'create_time': '2024-08-17T02:47:20.701176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000943317'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000943317.data', 'create_time': '2024-08-17T02:47:21.560605+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000943317'}}}] 2024-08-17T02:49:33.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:49:33.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.902+0000 7fe306000640 1 Processor -- start 2024-08-17T02:49:33.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.902+0000 7fe306000640 1 -- start start 2024-08-17T02:49:33.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.903+0000 7fe306000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 0x7fe3000b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.903+0000 7fe306000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3000adf90 0x7fe3000b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.903+0000 7fe306000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3000ac040 con 0x7fe300156fa0 2024-08-17T02:49:33.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.903+0000 7fe306000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe300067810 con 0x7fe3000adf90 2024-08-17T02:49:33.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.903+0000 7fe306000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000ab150 con 0x7fe300156bd0 2024-08-17T02:49:33.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.904+0000 7fe2fea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3000adf90 0x7fe3000b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.904+0000 7fe2fea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3000adf90 0x7fe3000b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55878/0 (socket says 172.21.15.2:55878) 2024-08-17T02:49:33.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.904+0000 7fe2fea00640 1 -- 172.21.15.2:0/1906477399 learned_addr learned my addr 172.21.15.2:0/1906477399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:33.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.904+0000 7fe2ff400640 1 --2- 172.21.15.2:0/1906477399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 0x7fe3000b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.904+0000 7fe2fea00640 1 -- 172.21.15.2:0/1906477399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 msgr2=0x7fe3000b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:33.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.904+0000 7fe2fea00640 1 --2- 172.21.15.2:0/1906477399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 0x7fe3000b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.904+0000 7fe2fea00640 1 -- 172.21.15.2:0/1906477399 >> v1:172.21.15.26:6789/0 conn(0x7fe300156fa0 legacy=0x7fe3000ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.904+0000 7fe2fea00640 1 -- 172.21.15.2:0/1906477399 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000ab430 con 0x7fe3000adf90 2024-08-17T02:49:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.905+0000 7fe2fea00640 1 --2- 172.21.15.2:0/1906477399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000b10b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009910 tx=0x7fe2ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d33dd3edb378d98 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.905+0000 7fe2fe000640 1 -- 172.21.15.2:0/1906477399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec02ae40 con 0x7fe3000adf90 2024-08-17T02:49:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.905+0000 7fe2fe000640 1 -- 172.21.15.2:0/1906477399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec032440 con 0x7fe3000adf90 2024-08-17T02:49:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe2fe000640 1 -- 172.21.15.2:0/1906477399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec032820 con 0x7fe3000adf90 2024-08-17T02:49:33.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe306000640 1 -- 172.21.15.2:0/1906477399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 msgr2=0x7fe3000b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe306000640 1 --2- 172.21.15.2:0/1906477399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000b10b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009910 tx=0x7fe2ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe306000640 1 -- 172.21.15.2:0/1906477399 shutdown_connections 2024-08-17T02:49:33.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe306000640 1 --2- 172.21.15.2:0/1906477399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000b10b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe306000640 1 --2- 172.21.15.2:0/1906477399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 0x7fe3000b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe306000640 1 -- 172.21.15.2:0/1906477399 >> 172.21.15.2:0/1906477399 conn(0x7fe3000cc390 msgr2=0x7fe300066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:33.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe306000640 1 -- 172.21.15.2:0/1906477399 shutdown_connections 2024-08-17T02:49:33.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.906+0000 7fe306000640 1 -- 172.21.15.2:0/1906477399 wait complete. 2024-08-17T02:49:33.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.907+0000 7fe306000640 1 Processor -- start 2024-08-17T02:49:33.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.908+0000 7fe306000640 1 -- start start 2024-08-17T02:49:33.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.908+0000 7fe306000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.908+0000 7fe306000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 0x7fe3000a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.908+0000 7fe306000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300156fa0 0x7fe3001472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe306000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000aff80 con 0x7fe3000adf90 2024-08-17T02:49:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe306000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000a94d0 con 0x7fe300156fa0 2024-08-17T02:49:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe306000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000af650 con 0x7fe300156bd0 2024-08-17T02:49:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ff400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ff400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000aab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55880/0 (socket says 172.21.15.2:55880) 2024-08-17T02:49:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ff400640 1 -- 172.21.15.2:0/133418765 learned_addr learned my addr 172.21.15.2:0/133418765 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2fea00640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 0x7fe3000a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ffe00640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300156fa0 0x7fe3001472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ff400640 1 -- 172.21.15.2:0/133418765 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 msgr2=0x7fe3000a8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ff400640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 0x7fe3000a8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ff400640 1 -- 172.21.15.2:0/133418765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300156fa0 msgr2=0x7fe3001472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ff400640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300156fa0 0x7fe3001472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.909+0000 7fe2ff400640 1 -- 172.21.15.2:0/133418765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec009450 con 0x7fe3000adf90 2024-08-17T02:49:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.910+0000 7fe2ff400640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000aab40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000ea20 tx=0x7fe2f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.910+0000 7fe2f6a00640 1 -- 172.21.15.2:0/133418765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f000ca10 con 0x7fe3000adf90 2024-08-17T02:49:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.910+0000 7fe2f6a00640 1 -- 172.21.15.2:0/133418765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f000cb70 con 0x7fe3000adf90 2024-08-17T02:49:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.910+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3000af930 con 0x7fe3000adf90 2024-08-17T02:49:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.910+0000 7fe2f6a00640 1 -- 172.21.15.2:0/133418765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0013470 con 0x7fe3000adf90 2024-08-17T02:49:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.910+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3000af310 con 0x7fe3000adf90 2024-08-17T02:49:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.911+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe300063fb0 con 0x7fe3000adf90 2024-08-17T02:49:33.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.912+0000 7fe2f6a00640 1 -- 172.21.15.2:0/133418765 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2f0013860 con 0x7fe3000adf90 2024-08-17T02:49:33.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.913+0000 7fe2f6a00640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2e0065150 0x7fe2e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:33.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.913+0000 7fe2f6a00640 1 -- 172.21.15.2:0/133418765 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fe2f00827b0 con 0x7fe3000adf90 2024-08-17T02:49:33.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.913+0000 7fe2fea00640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2e0065150 0x7fe2e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:33.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.914+0000 7fe2fea00640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2e0065150 0x7fe2e0067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec034000 tx=0x7fe2ec032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:33.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:33.917+0000 7fe2f6a00640 1 -- 172.21.15.2:0/133418765 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2f0050800 con 0x7fe3000adf90 2024-08-17T02:49:34.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.100+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3000cb520 con 0x7fe3000adf90 2024-08-17T02:49:34.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.101+0000 7fe2f6a00640 1 -- 172.21.15.2:0/133418765 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2f0053e20 con 0x7fe3000adf90 2024-08-17T02:49:34.102 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-08-17T02:49:34.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2e0065150 msgr2=0x7fe2e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2e0065150 0x7fe2e0067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec034000 tx=0x7fe2ec032000 comp rx=0 tx=0).stop 2024-08-17T02:49:34.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 msgr2=0x7fe3000aab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000aab40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000ea20 tx=0x7fe2f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 shutdown_connections 2024-08-17T02:49:34.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe300156fa0 0x7fe3001472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe2e0065150 0x7fe2e0067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe300156bd0 0x7fe3000a8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 --2- 172.21.15.2:0/133418765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3000adf90 0x7fe3000aab40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 >> 172.21.15.2:0/133418765 conn(0x7fe3000cc390 msgr2=0x7fe3001548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 shutdown_connections 2024-08-17T02:49:34.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.103+0000 7fe306000640 1 -- 172.21.15.2:0/133418765 wait complete. 2024-08-17T02:49:34.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000943317.meta pg_num 2024-08-17T02:49:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.274+0000 7faa62200640 1 Processor -- start 2024-08-17T02:49:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.274+0000 7faa62200640 1 -- start start 2024-08-17T02:49:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.275+0000 7faa62200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c0afca0 0x7faa5c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.275+0000 7faa62200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faa5c1590b0 0x7faa5c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.275+0000 7faa62200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5c15a4e0 con 0x7faa5c0acf10 2024-08-17T02:49:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.275+0000 7faa62200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5c0b0980 con 0x7faa5c1590b0 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.275+0000 7faa62200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0c92b0 con 0x7faa5c0afca0 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5aa00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faa5c0acf10 0x7faa5c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47048/0 (socket says 172.21.15.2:47048) 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5aa00640 1 -- 172.21.15.2:0/4291998290 learned_addr learned my addr 172.21.15.2:0/4291998290 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5b400640 1 --2- 172.21.15.2:0/4291998290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c0afca0 0x7faa5c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5be00640 1 --2- 172.21.15.2:0/4291998290 >> v2:172.21.15.26:3300/0 conn(0x7faa5c1590b0 0x7faa5c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5a000640 1 -- 172.21.15.2:0/4291998290 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919488289 0 0) 0x7faa48001110 con 0x7faa5c0acf10 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5a000640 1 -- 172.21.15.2:0/4291998290 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa400034e0 con 0x7faa5c0acf10 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5b400640 1 -- 172.21.15.2:0/4291998290 >> v2:172.21.15.26:3300/0 conn(0x7faa5c1590b0 msgr2=0x7faa5c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5b400640 1 --2- 172.21.15.2:0/4291998290 >> v2:172.21.15.26:3300/0 conn(0x7faa5c1590b0 0x7faa5c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5b400640 1 -- 172.21.15.2:0/4291998290 >> v1:172.21.15.2:6789/0 conn(0x7faa5c0acf10 legacy=0x7faa5c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.276+0000 7faa5b400640 1 -- 172.21.15.2:0/4291998290 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c0ad480 con 0x7faa5c0afca0 2024-08-17T02:49:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.277+0000 7faa5b400640 1 --2- 172.21.15.2:0/4291998290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c0afca0 0x7faa5c0b0070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009850 tx=0x7faa4c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee87724042c9d02 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa5a000640 1 -- 172.21.15.2:0/4291998290 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c02ad90 con 0x7faa5c0afca0 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa5a000640 1 -- 172.21.15.2:0/4291998290 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c032440 con 0x7faa5c0afca0 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa5a000640 1 -- 172.21.15.2:0/4291998290 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c032800 con 0x7faa5c0afca0 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa62200640 1 -- 172.21.15.2:0/4291998290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c0afca0 msgr2=0x7faa5c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa62200640 1 --2- 172.21.15.2:0/4291998290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c0afca0 0x7faa5c0b0070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009850 tx=0x7faa4c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa62200640 1 -- 172.21.15.2:0/4291998290 shutdown_connections 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa62200640 1 --2- 172.21.15.2:0/4291998290 >> v2:172.21.15.26:3300/0 conn(0x7faa5c1590b0 0x7faa5c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa62200640 1 --2- 172.21.15.2:0/4291998290 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c0afca0 0x7faa5c0b0070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa62200640 1 -- 172.21.15.2:0/4291998290 >> 172.21.15.2:0/4291998290 conn(0x7faa5c066e60 msgr2=0x7faa5c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.278+0000 7faa62200640 1 -- 172.21.15.2:0/4291998290 shutdown_connections 2024-08-17T02:49:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.279+0000 7faa62200640 1 -- 172.21.15.2:0/4291998290 wait complete. 2024-08-17T02:49:34.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.280+0000 7faa62200640 1 Processor -- start 2024-08-17T02:49:34.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.280+0000 7faa62200640 1 -- start start 2024-08-17T02:49:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa62200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa5c0acf10 0x7faa5c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa62200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa5c0afca0 0x7faa5c154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa62200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c1590b0 0x7faa5c168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa62200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0cc1e0 con 0x7faa5c0acf10 2024-08-17T02:49:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa62200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c155250 con 0x7faa5c0afca0 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa62200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c155530 con 0x7faa5c1590b0 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa5b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa5c0acf10 0x7faa5c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa5b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa5c0acf10 0x7faa5c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55890/0 (socket says 172.21.15.2:55890) 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa5b400640 1 -- 172.21.15.2:0/997126307 learned_addr learned my addr 172.21.15.2:0/997126307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa5be00640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c1590b0 0x7faa5c168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.281+0000 7faa5aa00640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa5c0afca0 0x7faa5c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa5b400640 1 -- 172.21.15.2:0/997126307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c1590b0 msgr2=0x7faa5c168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa5b400640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c1590b0 0x7faa5c168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa5b400640 1 -- 172.21.15.2:0/997126307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa5c0afca0 msgr2=0x7faa5c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa5b400640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa5c0afca0 0x7faa5c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa5b400640 1 -- 172.21.15.2:0/997126307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009390 con 0x7faa5c0acf10 2024-08-17T02:49:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa5b400640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa5c0acf10 0x7faa5c0c5ca0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009130 tx=0x7faa4c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa52a00640 1 -- 172.21.15.2:0/997126307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c03e660 con 0x7faa5c0acf10 2024-08-17T02:49:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa52a00640 1 -- 172.21.15.2:0/997126307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c03e800 con 0x7faa5c0acf10 2024-08-17T02:49:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa52a00640 1 -- 172.21.15.2:0/997126307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c03ebc0 con 0x7faa5c0acf10 2024-08-17T02:49:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c155810 con 0x7faa5c0acf10 2024-08-17T02:49:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.282+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c154880 con 0x7faa5c0acf10 2024-08-17T02:49:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.283+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c063fb0 con 0x7faa5c0acf10 2024-08-17T02:49:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.284+0000 7faa52a00640 1 -- 172.21.15.2:0/997126307 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faa4c031420 con 0x7faa5c0acf10 2024-08-17T02:49:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.285+0000 7faa52a00640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa3c065150 0x7faa3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.285+0000 7faa52a00640 1 -- 172.21.15.2:0/997126307 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7faa4c0a2420 con 0x7faa5c0acf10 2024-08-17T02:49:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.285+0000 7faa5aa00640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa3c065150 0x7faa3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.286+0000 7faa5aa00640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa3c065150 0x7faa3c067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0ca1f0 tx=0x7faa48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:34.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.289+0000 7faa52a00640 1 -- 172.21.15.2:0/997126307 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faa4c070470 con 0x7faa5c0acf10 2024-08-17T02:49:34.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.470+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000943317.meta", "var": "pg_num"} v 0) v1 -- 0x7faa5c067b70 con 0x7faa5c0acf10 2024-08-17T02:49:34.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.470+0000 7faa52a00640 1 -- 172.21.15.2:0/997126307 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000943317.meta", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7faa4c073a90 con 0x7faa5c0acf10 2024-08-17T02:49:34.472 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:49:34.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa3c065150 msgr2=0x7faa3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa3c065150 0x7faa3c067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0ca1f0 tx=0x7faa48009040 comp rx=0 tx=0).stop 2024-08-17T02:49:34.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa5c0acf10 msgr2=0x7faa5c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa5c0acf10 0x7faa5c0c5ca0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009130 tx=0x7faa4c032000 comp rx=0 tx=0).stop 2024-08-17T02:49:34.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 shutdown_connections 2024-08-17T02:49:34.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7faa3c065150 0x7faa3c067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7faa5c1590b0 0x7faa5c168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faa5c0afca0 0x7faa5c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 --2- 172.21.15.2:0/997126307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa5c0acf10 0x7faa5c0c5ca0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 >> 172.21.15.2:0/997126307 conn(0x7faa5c066e60 msgr2=0x7faa5c157720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:34.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 shutdown_connections 2024-08-17T02:49:34.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.473+0000 7faa62200640 1 -- 172.21.15.2:0/997126307 wait complete. 2024-08-17T02:49:34.489 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000943317.data pg_num 2024-08-17T02:49:34.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.643+0000 7f29d2e00640 1 Processor -- start 2024-08-17T02:49:34.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.643+0000 7f29d2e00640 1 -- start start 2024-08-17T02:49:34.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.644+0000 7f29d2e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc0afca0 0x7f29cc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.644+0000 7f29d2e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29cc0acf10 0x7f29cc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.644+0000 7f29d2e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29cc1589a0 0x7f29cc158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.644+0000 7f29d2e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0b0980 con 0x7f29cc0acf10 2024-08-17T02:49:34.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.644+0000 7f29d2e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc15a4e0 con 0x7f29cc1589a0 2024-08-17T02:49:34.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.644+0000 7f29d2e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c92b0 con 0x7f29cc0afca0 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.644+0000 7f29c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29cc0acf10 0x7f29cc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29c3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f29cc0acf10 0x7f29cc159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55904/0 (socket says 172.21.15.2:55904) 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29c3e00640 1 -- 172.21.15.2:0/196675417 learned_addr learned my addr 172.21.15.2:0/196675417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29cbe00640 1 --2- 172.21.15.2:0/196675417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc0afca0 0x7f29cc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29d0e00640 1 --2- 172.21.15.2:0/196675417 >> v2:172.21.15.26:3300/0 conn(0x7f29cc1589a0 0x7f29cc158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29c3e00640 1 -- 172.21.15.2:0/196675417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc0afca0 msgr2=0x7f29cc0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29c3e00640 1 --2- 172.21.15.2:0/196675417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc0afca0 0x7f29cc0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29c3e00640 1 -- 172.21.15.2:0/196675417 >> v2:172.21.15.26:3300/0 conn(0x7f29cc1589a0 msgr2=0x7f29cc158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29c3e00640 1 --2- 172.21.15.2:0/196675417 >> v2:172.21.15.26:3300/0 conn(0x7f29cc1589a0 0x7f29cc158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.645+0000 7f29c3e00640 1 -- 172.21.15.2:0/196675417 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc159360 con 0x7f29cc0acf10 2024-08-17T02:49:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.646+0000 7f29c3e00640 1 --2- 172.21.15.2:0/196675417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0acf10 0x7f29cc159fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009910 tx=0x7f29b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4019aedfac1ec57 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.646+0000 7f29cb400640 1 -- 172.21.15.2:0/196675417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b402adb0 con 0x7f29cc0acf10 2024-08-17T02:49:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.646+0000 7f29cb400640 1 -- 172.21.15.2:0/196675417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4032440 con 0x7f29cc0acf10 2024-08-17T02:49:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.646+0000 7f29cb400640 1 -- 172.21.15.2:0/196675417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4032820 con 0x7f29cc0acf10 2024-08-17T02:49:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 -- 172.21.15.2:0/196675417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0acf10 msgr2=0x7f29cc159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 --2- 172.21.15.2:0/196675417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0acf10 0x7f29cc159fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009910 tx=0x7f29b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 -- 172.21.15.2:0/196675417 shutdown_connections 2024-08-17T02:49:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 --2- 172.21.15.2:0/196675417 >> v2:172.21.15.26:3300/0 conn(0x7f29cc1589a0 0x7f29cc158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 --2- 172.21.15.2:0/196675417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0acf10 0x7f29cc159fa0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 --2- 172.21.15.2:0/196675417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc0afca0 0x7f29cc0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 -- 172.21.15.2:0/196675417 >> 172.21.15.2:0/196675417 conn(0x7f29cc066e60 msgr2=0x7f29cc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 -- 172.21.15.2:0/196675417 shutdown_connections 2024-08-17T02:49:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.647+0000 7f29d2e00640 1 -- 172.21.15.2:0/196675417 wait complete. 2024-08-17T02:49:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.648+0000 7f29d2e00640 1 Processor -- start 2024-08-17T02:49:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.648+0000 7f29d2e00640 1 -- start start 2024-08-17T02:49:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.649+0000 7f29d2e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0acf10 0x7f29cc0c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.649+0000 7f29d2e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0afca0 0x7f29cc15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.649+0000 7f29d2e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc1589a0 0x7f29cc0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.649+0000 7f29d2e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c4bf0 con 0x7f29cc0afca0 2024-08-17T02:49:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.649+0000 7f29d2e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c5730 con 0x7f29cc0acf10 2024-08-17T02:49:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.649+0000 7f29d2e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c4e00 con 0x7f29cc1589a0 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0afca0 0x7f29cc15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0afca0 0x7f29cc15eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55910/0 (socket says 172.21.15.2:55910) 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 -- 172.21.15.2:0/1408754212 learned_addr learned my addr 172.21.15.2:0/1408754212 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29d0e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc1589a0 0x7f29cc0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29cbe00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0acf10 0x7f29cc0c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 -- 172.21.15.2:0/1408754212 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc1589a0 msgr2=0x7f29cc0c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc1589a0 0x7f29cc0c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 -- 172.21.15.2:0/1408754212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0acf10 msgr2=0x7f29cc0c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0acf10 0x7f29cc0c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 -- 172.21.15.2:0/1408754212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4009450 con 0x7f29cc0afca0 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.650+0000 7f29c3e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0afca0 0x7f29cc15eea0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f29b4035040 tx=0x7f29b4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.651+0000 7f29c3400640 1 -- 172.21.15.2:0/1408754212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4031c80 con 0x7f29cc0afca0 2024-08-17T02:49:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.651+0000 7f29c3400640 1 -- 172.21.15.2:0/1408754212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4031e40 con 0x7f29cc0afca0 2024-08-17T02:49:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.651+0000 7f29c3400640 1 -- 172.21.15.2:0/1408754212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b403d670 con 0x7f29cc0afca0 2024-08-17T02:49:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.651+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc0c50e0 con 0x7f29cc0afca0 2024-08-17T02:49:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.651+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc15f3e0 con 0x7f29cc0afca0 2024-08-17T02:49:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.652+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc063fb0 con 0x7f29cc0afca0 2024-08-17T02:49:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.653+0000 7f29c3400640 1 -- 172.21.15.2:0/1408754212 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f29b4039040 con 0x7f29cc0afca0 2024-08-17T02:49:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.654+0000 7f29c3400640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f29a8065150 0x7f29a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.654+0000 7f29c3400640 1 -- 172.21.15.2:0/1408754212 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f29b40a22e0 con 0x7f29cc0afca0 2024-08-17T02:49:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.654+0000 7f29cbe00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f29a8065150 0x7f29a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.655+0000 7f29cbe00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f29a8065150 0x7f29a8067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009d20 tx=0x7f29bc0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.658+0000 7f29c3400640 1 -- 172.21.15.2:0/1408754212 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f29b40703d0 con 0x7f29cc0afca0 2024-08-17T02:49:34.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.843+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000943317.data", "var": "pg_num"} v 0) v1 -- 0x7f29cc0c5870 con 0x7f29cc0afca0 2024-08-17T02:49:34.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.843+0000 7f29c3400640 1 -- 172.21.15.2:0/1408754212 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000943317.data", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7f29b40739f0 con 0x7f29cc0afca0 2024-08-17T02:49:34.844 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f29a8065150 msgr2=0x7f29a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f29a8065150 0x7f29a8067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009d20 tx=0x7f29bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0afca0 msgr2=0x7f29cc15eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0afca0 0x7f29cc15eea0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f29b4035040 tx=0x7f29b4032000 comp rx=0 tx=0).stop 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 shutdown_connections 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f29a8065150 0x7f29a8067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f29cc1589a0 0x7f29cc0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29cc0afca0 0x7f29cc15eea0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 --2- 172.21.15.2:0/1408754212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29cc0acf10 0x7f29cc0c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 >> 172.21.15.2:0/1408754212 conn(0x7f29cc066e60 msgr2=0x7f29cc0ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 shutdown_connections 2024-08-17T02:49:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:34.846+0000 7f29d2e00640 1 -- 172.21.15.2:0/1408754212 wait complete. 2024-08-17T02:49:34.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.013+0000 7f908c400640 1 Processor -- start 2024-08-17T02:49:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.013+0000 7f908c400640 1 -- start start 2024-08-17T02:49:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.014+0000 7f908c400640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f90841590b0 0x7f90840b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.014+0000 7f908c400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840c92b0 con 0x7f90840afca0 2024-08-17T02:49:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.014+0000 7f908c400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840ad480 con 0x7f90840acf10 2024-08-17T02:49:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.014+0000 7f908c400640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90840b0980 con 0x7f90841590b0 2024-08-17T02:49:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.014+0000 7f9089a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f90840afca0 0x7f90841589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47052/0 (socket says 172.21.15.2:47052) 2024-08-17T02:49:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.015+0000 7f9089a00640 1 -- 172.21.15.2:0/2613158825 learned_addr learned my addr 172.21.15.2:0/2613158825 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.015+0000 7f9089000640 1 --2- 172.21.15.2:0/2613158825 >> v2:172.21.15.26:3300/0 conn(0x7f90841590b0 0x7f90840b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.015+0000 7f9083e00640 1 -- 172.21.15.2:0/2613158825 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808800150 0 0) 0x7f90840c92b0 con 0x7f90840afca0 2024-08-17T02:49:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.015+0000 7f9083e00640 1 -- 172.21.15.2:0/2613158825 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906c0034e0 con 0x7f90840afca0 2024-08-17T02:49:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.015+0000 7f9089000640 1 -- 172.21.15.2:0/2613158825 >> v1:172.21.15.26:6789/0 conn(0x7f90840acf10 legacy=0x7f90840c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.015+0000 7f9089000640 1 -- 172.21.15.2:0/2613158825 >> v1:172.21.15.2:6789/0 conn(0x7f90840afca0 legacy=0x7f90841589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.015+0000 7f9089000640 1 -- 172.21.15.2:0/2613158825 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840ad760 con 0x7f90841590b0 2024-08-17T02:49:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.016+0000 7f9089000640 1 --2- 172.21.15.2:0/2613158825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90841590b0 0x7f90840b0070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9070009850 tx=0x7f90700090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf4be51aa22fdc38 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f9083e00640 1 -- 172.21.15.2:0/2613158825 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907002ae20 con 0x7f90841590b0 2024-08-17T02:49:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f9083e00640 1 -- 172.21.15.2:0/2613158825 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070032440 con 0x7f90841590b0 2024-08-17T02:49:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f9083e00640 1 -- 172.21.15.2:0/2613158825 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700327e0 con 0x7f90841590b0 2024-08-17T02:49:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f908c400640 1 -- 172.21.15.2:0/2613158825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90841590b0 msgr2=0x7f90840b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f908c400640 1 --2- 172.21.15.2:0/2613158825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90841590b0 0x7f90840b0070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9070009850 tx=0x7f90700090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f908c400640 1 -- 172.21.15.2:0/2613158825 shutdown_connections 2024-08-17T02:49:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f908c400640 1 --2- 172.21.15.2:0/2613158825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90841590b0 0x7f90840b0070 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f908c400640 1 -- 172.21.15.2:0/2613158825 >> 172.21.15.2:0/2613158825 conn(0x7f9084066e60 msgr2=0x7f9084067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f908c400640 1 -- 172.21.15.2:0/2613158825 shutdown_connections 2024-08-17T02:49:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.017+0000 7f908c400640 1 -- 172.21.15.2:0/2613158825 wait complete. 2024-08-17T02:49:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.019+0000 7f908c400640 1 Processor -- start 2024-08-17T02:49:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.019+0000 7f908c400640 1 -- start start 2024-08-17T02:49:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f908c400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90840acf10 0x7f9084153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f908c400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90840afca0 0x7f90840c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f908c400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90841590b0 0x7f90840c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f908c400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840c1260 con 0x7f90840afca0 2024-08-17T02:49:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f908c400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840c1540 con 0x7f90840acf10 2024-08-17T02:49:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f908c400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840c2330 con 0x7f90841590b0 2024-08-17T02:49:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90840afca0 0x7f90840c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90840afca0 0x7f90840c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55916/0 (socket says 172.21.15.2:55916) 2024-08-17T02:49:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089000640 1 -- 172.21.15.2:0/762069429 learned_addr learned my addr 172.21.15.2:0/762069429 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089a00640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90840acf10 0x7f9084153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089000640 1 -- 172.21.15.2:0/762069429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90841590b0 msgr2=0x7f90840c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089000640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90841590b0 0x7f90840c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089000640 1 -- 172.21.15.2:0/762069429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90840acf10 msgr2=0x7f9084153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089000640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90840acf10 0x7f9084153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.020+0000 7f9089000640 1 -- 172.21.15.2:0/762069429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009390 con 0x7f90840afca0 2024-08-17T02:49:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.021+0000 7f9089000640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90840afca0 0x7f90840c64d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9070035040 tx=0x7f9070032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.021+0000 7f9080c00640 1 -- 172.21.15.2:0/762069429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070031de0 con 0x7f90840afca0 2024-08-17T02:49:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.021+0000 7f9080c00640 1 -- 172.21.15.2:0/762069429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907003e450 con 0x7f90840afca0 2024-08-17T02:49:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.021+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90840c2610 con 0x7f90840afca0 2024-08-17T02:49:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.021+0000 7f9080c00640 1 -- 172.21.15.2:0/762069429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907003e850 con 0x7f90840afca0 2024-08-17T02:49:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.021+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90840c1d60 con 0x7f90840afca0 2024-08-17T02:49:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.022+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90840c2800 con 0x7f90840afca0 2024-08-17T02:49:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.023+0000 7f9080c00640 1 -- 172.21.15.2:0/762069429 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f907003c400 con 0x7f90840afca0 2024-08-17T02:49:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.024+0000 7f9080c00640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9064065150 0x7f9064067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.024+0000 7f9080c00640 1 -- 172.21.15.2:0/762069429 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f90700a30a0 con 0x7f90840afca0 2024-08-17T02:49:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.024+0000 7f9089a00640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9064065150 0x7f9064067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.024+0000 7f9089a00640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9064065150 0x7f9064067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9078005840 tx=0x7f9078009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.028+0000 7f9080c00640 1 -- 172.21.15.2:0/762069429 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9070071040 con 0x7f90840afca0 2024-08-17T02:49:35.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.250+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9084063fb0 con 0x7f90840afca0 2024-08-17T02:49:35.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.251+0000 7f9080c00640 1 -- 172.21.15.2:0/762069429 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f9070074660 con 0x7f90840afca0 2024-08-17T02:49:35.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:35.252 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2028182828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":2028182828},{"type":"v1","addr":"172.21.15.2:6837","nonce":2028182828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:22.521281+0000","modified":"2024-08-17T02:47:24.261416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4953},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4953":{"gid":4953,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000943317","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:35.252 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 22 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9064065150 msgr2=0x7f9064067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9064065150 0x7f9064067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9078005840 tx=0x7f9078009040 comp rx=0 tx=0).stop 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90840afca0 msgr2=0x7f90840c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90840afca0 0x7f90840c64d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9070035040 tx=0x7f9070032000 comp rx=0 tx=0).stop 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 shutdown_connections 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9064065150 0x7f9064067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f90841590b0 0x7f90840c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90840afca0 0x7f90840c64d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 --2- 172.21.15.2:0/762069429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90840acf10 0x7f9084153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 >> 172.21.15.2:0/762069429 conn(0x7f9084066e60 msgr2=0x7f90840c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:35.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 shutdown_connections 2024-08-17T02:49:35.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.253+0000 7f908c400640 1 -- 172.21.15.2:0/762069429 wait complete. 2024-08-17T02:49:35.269 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.421+0000 7fa4a6000640 1 Processor -- start 2024-08-17T02:49:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.422+0000 7fa4a6000640 1 -- start start 2024-08-17T02:49:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa4a6000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cadc0 0x7fa4a00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa4a6000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4a00cca40 0x7fa4a00af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa4a6000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a00cf600 con 0x7fa4a0158c90 2024-08-17T02:49:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa4a6000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00ce890 con 0x7fa4a00cca40 2024-08-17T02:49:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa4a6000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00cea90 con 0x7fa4a00cadc0 2024-08-17T02:49:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa4a5600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4a00cca40 0x7fa4a00af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa4a5600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4a00cca40 0x7fa4a00af8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55918/0 (socket says 172.21.15.2:55918) 2024-08-17T02:49:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa4a5600640 1 -- 172.21.15.2:0/3407391457 learned_addr learned my addr 172.21.15.2:0/3407391457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.423+0000 7fa49fe00640 1 --2- 172.21.15.2:0/3407391457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cadc0 0x7fa4a00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.424+0000 7fa4a5600640 1 -- 172.21.15.2:0/3407391457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cadc0 msgr2=0x7fa4a00cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.424+0000 7fa4a5600640 1 --2- 172.21.15.2:0/3407391457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cadc0 0x7fa4a00cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.424+0000 7fa4a5600640 1 -- 172.21.15.2:0/3407391457 >> v1:172.21.15.26:6789/0 conn(0x7fa4a0158c90 legacy=0x7fa4a00ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.424+0000 7fa4a5600640 1 -- 172.21.15.2:0/3407391457 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00ced30 con 0x7fa4a00cca40 2024-08-17T02:49:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.425+0000 7fa4a5600640 1 --2- 172.21.15.2:0/3407391457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a00cca40 0x7fa4a00af8d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa498009f20 tx=0x7fa498009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da91b7983f158c45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.425+0000 7fa49f400640 1 -- 172.21.15.2:0/3407391457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498031400 con 0x7fa4a00cca40 2024-08-17T02:49:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.425+0000 7fa49f400640 1 -- 172.21.15.2:0/3407391457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49802d050 con 0x7fa4a00cca40 2024-08-17T02:49:35.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.425+0000 7fa49f400640 1 -- 172.21.15.2:0/3407391457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4980317d0 con 0x7fa4a00cca40 2024-08-17T02:49:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.425+0000 7fa4a6000640 1 -- 172.21.15.2:0/3407391457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a00cca40 msgr2=0x7fa4a00af8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.425+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3407391457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a00cca40 0x7fa4a00af8d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa498009f20 tx=0x7fa498009840 comp rx=0 tx=0).stop 2024-08-17T02:49:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.426+0000 7fa4a6000640 1 -- 172.21.15.2:0/3407391457 shutdown_connections 2024-08-17T02:49:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.426+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3407391457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a00cca40 0x7fa4a00af8d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.426+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3407391457 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cadc0 0x7fa4a00cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.426+0000 7fa4a6000640 1 -- 172.21.15.2:0/3407391457 >> 172.21.15.2:0/3407391457 conn(0x7fa4a0087a80 msgr2=0x7fa4a006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.426+0000 7fa4a6000640 1 -- 172.21.15.2:0/3407391457 shutdown_connections 2024-08-17T02:49:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.426+0000 7fa4a6000640 1 -- 172.21.15.2:0/3407391457 wait complete. 2024-08-17T02:49:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.427+0000 7fa4a6000640 1 Processor -- start 2024-08-17T02:49:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.427+0000 7fa4a6000640 1 -- start start 2024-08-17T02:49:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a6000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00cadc0 0x7fa4a00b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a6000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cca40 0x7fa4a00b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a0158c90 0x7fa4a00b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a6000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a01593c0 con 0x7fa4a0158c90 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a6000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00b3050 con 0x7fa4a00cadc0 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a6000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00c80e0 con 0x7fa4a00cca40 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a5600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a0158c90 0x7fa4a00b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a5600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a0158c90 0x7fa4a00b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55930/0 (socket says 172.21.15.2:55930) 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a5600640 1 -- 172.21.15.2:0/3626385679 learned_addr learned my addr 172.21.15.2:0/3626385679 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa49fe00640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cca40 0x7fa4a00b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.428+0000 7fa4a4c00640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00cadc0 0x7fa4a00b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa4a5600640 1 -- 172.21.15.2:0/3626385679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cca40 msgr2=0x7fa4a00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa4a5600640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cca40 0x7fa4a00b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa4a5600640 1 -- 172.21.15.2:0/3626385679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00cadc0 msgr2=0x7fa4a00b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa4a5600640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00cadc0 0x7fa4a00b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa4a5600640 1 -- 172.21.15.2:0/3626385679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498009ae0 con 0x7fa4a0158c90 2024-08-17T02:49:35.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa4a5600640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a0158c90 0x7fa4a00b4af0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa498009f20 tx=0x7fa498036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa493e00640 1 -- 172.21.15.2:0/3626385679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498007170 con 0x7fa4a0158c90 2024-08-17T02:49:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa493e00640 1 -- 172.21.15.2:0/3626385679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498008e50 con 0x7fa4a0158c90 2024-08-17T02:49:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa493e00640 1 -- 172.21.15.2:0/3626385679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498044640 con 0x7fa4a0158c90 2024-08-17T02:49:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.429+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a00c83c0 con 0x7fa4a0158c90 2024-08-17T02:49:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.430+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a00c8980 con 0x7fa4a0158c90 2024-08-17T02:49:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.431+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a0159530 con 0x7fa4a0158c90 2024-08-17T02:49:35.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.431+0000 7fa493e00640 1 -- 172.21.15.2:0/3626385679 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa498038050 con 0x7fa4a0158c90 2024-08-17T02:49:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.432+0000 7fa493e00640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa480065150 0x7fa480067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.432+0000 7fa493e00640 1 -- 172.21.15.2:0/3626385679 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fa4980a3100 con 0x7fa4a0158c90 2024-08-17T02:49:35.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.432+0000 7fa4a4c00640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa480065150 0x7fa480067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.433+0000 7fa4a4c00640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa480065150 0x7fa480067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa494007fd0 tx=0x7fa494007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.436+0000 7fa493e00640 1 -- 172.21.15.2:0/3626385679 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4a0159530 con 0x7fa4a0158c90 2024-08-17T02:49:35.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.620+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4a0159530 con 0x7fa4a0158c90 2024-08-17T02:49:35.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.621+0000 7fa493e00640 1 -- 172.21.15.2:0/3626385679 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15414 (secure 0 0 0) 0x7fa4a0159530 con 0x7fa4a0158c90 2024-08-17T02:49:35.622 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:35.622 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:49:33.332178+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000943317.meta","create_time":"2024-08-17T02:47:20.701176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000943317"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000943317.data","create_time":"2024-08-17T02:47:21.560605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000943317"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6837/1889487336":"2024-08-18T02:49:30.194821+0000","172.21.15.2:6835/1889487336":"2024-08-18T02:49:30.194821+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:35.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa480065150 msgr2=0x7fa480067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa480065150 0x7fa480067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa494007fd0 tx=0x7fa494007e30 comp rx=0 tx=0).stop 2024-08-17T02:49:35.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a0158c90 msgr2=0x7fa4a00b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a0158c90 0x7fa4a00b4af0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa498009f20 tx=0x7fa498036000 comp rx=0 tx=0).stop 2024-08-17T02:49:35.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 shutdown_connections 2024-08-17T02:49:35.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4a0158c90 0x7fa4a00b4af0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa480065150 0x7fa480067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa4a00cca40 0x7fa4a00b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 --2- 172.21.15.2:0/3626385679 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4a00cadc0 0x7fa4a00b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 >> 172.21.15.2:0/3626385679 conn(0x7fa4a0087a80 msgr2=0x7fa4a00cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 shutdown_connections 2024-08-17T02:49:35.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.624+0000 7fa4a6000640 1 -- 172.21.15.2:0/3626385679 wait complete. 2024-08-17T02:49:35.640 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000943317 and related pools 2024-08-17T02:49:35.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.792+0000 7f87d3a00640 1 Processor -- start 2024-08-17T02:49:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.792+0000 7f87d3a00640 1 -- start start 2024-08-17T02:49:35.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87d3a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87cc155040 0x7f87cc158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87d3a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87d3a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87cc0aeeb0 con 0x7f87cc06e5a0 2024-08-17T02:49:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87d3a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc159610 con 0x7f87cc155040 2024-08-17T02:49:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87d3a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc06e9e0 con 0x7f87cc1591c0 2024-08-17T02:49:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87d1000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87cc155040 0x7f87cc158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc06e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:58014/0 (socket says 172.21.15.2:58014) 2024-08-17T02:49:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.794+0000 7f87cbe00640 1 -- 172.21.15.2:0/2808004626 learned_addr learned my addr 172.21.15.2:0/2808004626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.795+0000 7f87cbe00640 1 -- 172.21.15.2:0/2808004626 >> v2:172.21.15.26:3300/0 conn(0x7f87cc155040 msgr2=0x7f87cc158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.795+0000 7f87cbe00640 1 --2- 172.21.15.2:0/2808004626 >> v2:172.21.15.26:3300/0 conn(0x7f87cc155040 0x7f87cc158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.795+0000 7f87cbe00640 1 -- 172.21.15.2:0/2808004626 >> v1:172.21.15.26:6789/0 conn(0x7f87cc06e5a0 legacy=0x7f87cc0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.795+0000 7f87cbe00640 1 -- 172.21.15.2:0/2808004626 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0aadd0 con 0x7f87cc1591c0 2024-08-17T02:49:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.796+0000 7f87cbe00640 1 --2- 172.21.15.2:0/2808004626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc06e060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009910 tx=0x7f87b80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8036a0d4841989fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.796+0000 7f87cb400640 1 -- 172.21.15.2:0/2808004626 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b802adb0 con 0x7f87cc1591c0 2024-08-17T02:49:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.796+0000 7f87cb400640 1 -- 172.21.15.2:0/2808004626 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b8032440 con 0x7f87cc1591c0 2024-08-17T02:49:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.796+0000 7f87cb400640 1 -- 172.21.15.2:0/2808004626 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8032820 con 0x7f87cc1591c0 2024-08-17T02:49:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.797+0000 7f87d3a00640 1 -- 172.21.15.2:0/2808004626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 msgr2=0x7f87cc06e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.797+0000 7f87d3a00640 1 --2- 172.21.15.2:0/2808004626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc06e060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009910 tx=0x7f87b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.797+0000 7f87d3a00640 1 -- 172.21.15.2:0/2808004626 shutdown_connections 2024-08-17T02:49:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.797+0000 7f87d3a00640 1 --2- 172.21.15.2:0/2808004626 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc06e060 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.797+0000 7f87d3a00640 1 --2- 172.21.15.2:0/2808004626 >> v2:172.21.15.26:3300/0 conn(0x7f87cc155040 0x7f87cc158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.797+0000 7f87d3a00640 1 -- 172.21.15.2:0/2808004626 >> 172.21.15.2:0/2808004626 conn(0x7f87cc066e60 msgr2=0x7f87cc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.797+0000 7f87d3a00640 1 -- 172.21.15.2:0/2808004626 shutdown_connections 2024-08-17T02:49:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.797+0000 7f87d3a00640 1 -- 172.21.15.2:0/2808004626 wait complete. 2024-08-17T02:49:35.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.798+0000 7f87d3a00640 1 Processor -- start 2024-08-17T02:49:35.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.798+0000 7f87d3a00640 1 -- start start 2024-08-17T02:49:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.799+0000 7f87d3a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87cc06e5a0 0x7f87cc14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.799+0000 7f87d3a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc155040 0x7f87cc0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.799+0000 7f87d3a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc14fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.799+0000 7f87d3a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0ca5a0 con 0x7f87cc155040 2024-08-17T02:49:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.799+0000 7f87d3a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0ca810 con 0x7f87cc06e5a0 2024-08-17T02:49:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.799+0000 7f87d3a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0caaf0 con 0x7f87cc1591c0 2024-08-17T02:49:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc155040 0x7f87cc0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87d1000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87cc06e5a0 0x7f87cc14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc155040 0x7f87cc0c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55940/0 (socket says 172.21.15.2:55940) 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87cbe00640 1 -- 172.21.15.2:0/1806902615 learned_addr learned my addr 172.21.15.2:0/1806902615 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87d1a00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc14fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87d1000640 1 -- 172.21.15.2:0/1806902615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 msgr2=0x7f87cc14fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87d1000640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc14fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87d1000640 1 -- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc155040 msgr2=0x7f87cc0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87d1000640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc155040 0x7f87cc0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87d1000640 1 -- 172.21.15.2:0/1806902615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009450 con 0x7f87cc06e5a0 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.800+0000 7f87cbe00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc155040 0x7f87cc0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.801+0000 7f87d1000640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87cc06e5a0 0x7f87cc14f680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87c000dc70 tx=0x7f87c000f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.801+0000 7f87bfe00640 1 -- 172.21.15.2:0/1806902615 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0009b30 con 0x7f87cc06e5a0 2024-08-17T02:49:35.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.801+0000 7f87bfe00640 1 -- 172.21.15.2:0/1806902615 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c0009c90 con 0x7f87cc06e5a0 2024-08-17T02:49:35.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.801+0000 7f87bfe00640 1 -- 172.21.15.2:0/1806902615 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0017620 con 0x7f87cc06e5a0 2024-08-17T02:49:35.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.801+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc0c86d0 con 0x7f87cc06e5a0 2024-08-17T02:49:35.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.801+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc14fbc0 con 0x7f87cc06e5a0 2024-08-17T02:49:35.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.802+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc063fb0 con 0x7f87cc06e5a0 2024-08-17T02:49:35.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.803+0000 7f87bfe00640 1 -- 172.21.15.2:0/1806902615 <== mon.1 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f87c0017990 con 0x7f87cc06e5a0 2024-08-17T02:49:35.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.804+0000 7f87bfe00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f87ac065150 0x7f87ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:35.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.804+0000 7f87bfe00640 1 -- 172.21.15.2:0/1806902615 <== mon.1 v2:172.21.15.26:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f87c0082660 con 0x7f87cc06e5a0 2024-08-17T02:49:35.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.804+0000 7f87cbe00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f87ac065150 0x7f87ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:35.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.805+0000 7f87cbe00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f87ac065150 0x7f87ac067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009910 tx=0x7f87b8032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:35.809+0000 7f87bfe00640 1 -- 172.21.15.2:0/1806902615 <== mon.1 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f87c0054140 con 0x7f87cc06e5a0 2024-08-17T02:49:36.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.027+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87cc0ca950 con 0x7f87cc06e5a0 2024-08-17T02:49:36.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.028+0000 7f87bfe00640 1 -- 172.21.15.2:0/1806902615 <== mon.1 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f87cc0ca950 con 0x7f87cc06e5a0 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2028182828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":2028182828},{"type":"v1","addr":"172.21.15.2:6837","nonce":2028182828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:22.521281+0000","modified":"2024-08-17T02:47:24.261416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4953},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4953":{"gid":4953,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000943317","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 22 2024-08-17T02:49:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f87ac065150 msgr2=0x7f87ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f87ac065150 0x7f87ac067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009910 tx=0x7f87b8032000 comp rx=0 tx=0).stop 2024-08-17T02:49:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87cc06e5a0 msgr2=0x7f87cc14f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87cc06e5a0 0x7f87cc14f680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87c000dc70 tx=0x7f87c000f040 comp rx=0 tx=0).stop 2024-08-17T02:49:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 shutdown_connections 2024-08-17T02:49:36.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f87ac065150 0x7f87ac067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f87cc1591c0 0x7f87cc14fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87cc155040 0x7f87cc0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 --2- 172.21.15.2:0/1806902615 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87cc06e5a0 0x7f87cc14f680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 >> 172.21.15.2:0/1806902615 conn(0x7f87cc066e60 msgr2=0x7f87cc0ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:36.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 shutdown_connections 2024-08-17T02:49:36.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.031+0000 7f87d3a00640 1 -- 172.21.15.2:0/1806902615 wait complete. 2024-08-17T02:49:36.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:49:36.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.197+0000 7f7c65800640 1 Processor -- start 2024-08-17T02:49:36.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.197+0000 7f7c65800640 1 -- start start 2024-08-17T02:49:36.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.198+0000 7f7c65800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7c6006dee0 0x7f7c60163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.198+0000 7f7c65800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c600aed90 con 0x7f7c600ae860 2024-08-17T02:49:36.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.198+0000 7f7c65800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c600af070 con 0x7f7c60158a20 2024-08-17T02:49:36.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c65800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c600af350 con 0x7f7c6006dee0 2024-08-17T02:49:36.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c5e000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7c600ae860 0x7f7c6006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47058/0 (socket says 172.21.15.2:47058) 2024-08-17T02:49:36.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c5e000640 1 -- 172.21.15.2:0/3937365546 learned_addr learned my addr 172.21.15.2:0/3937365546 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:36.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c5f400640 1 --2- 172.21.15.2:0/3937365546 >> v2:172.21.15.2:3300/0 conn(0x7f7c6006dee0 0x7f7c60163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c5d600640 1 -- 172.21.15.2:0/3937365546 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146560448 0 0) 0x7f7c600aed90 con 0x7f7c600ae860 2024-08-17T02:49:36.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c5d600640 1 -- 172.21.15.2:0/3937365546 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c440034e0 con 0x7f7c600ae860 2024-08-17T02:49:36.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c5f400640 1 -- 172.21.15.2:0/3937365546 >> v1:172.21.15.26:6789/0 conn(0x7f7c60158a20 legacy=0x7f7c600a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c5f400640 1 -- 172.21.15.2:0/3937365546 >> v1:172.21.15.2:6789/0 conn(0x7f7c600ae860 legacy=0x7f7c6006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.199+0000 7f7c5f400640 1 -- 172.21.15.2:0/3937365546 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600af630 con 0x7f7c6006dee0 2024-08-17T02:49:36.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.200+0000 7f7c5f400640 1 --2- 172.21.15.2:0/3937365546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6006dee0 0x7f7c60163c40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009e60 tx=0x7f7c58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ae2ce2d1527f0d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c5d600640 1 -- 172.21.15.2:0/3937365546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58007550 con 0x7f7c6006dee0 2024-08-17T02:49:36.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c5d600640 1 -- 172.21.15.2:0/3937365546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5802d050 con 0x7f7c6006dee0 2024-08-17T02:49:36.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c5d600640 1 -- 172.21.15.2:0/3937365546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c580078c0 con 0x7f7c6006dee0 2024-08-17T02:49:36.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c65800640 1 -- 172.21.15.2:0/3937365546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6006dee0 msgr2=0x7f7c60163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c65800640 1 --2- 172.21.15.2:0/3937365546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6006dee0 0x7f7c60163c40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009e60 tx=0x7f7c58009780 comp rx=0 tx=0).stop 2024-08-17T02:49:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c65800640 1 -- 172.21.15.2:0/3937365546 shutdown_connections 2024-08-17T02:49:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c65800640 1 --2- 172.21.15.2:0/3937365546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6006dee0 0x7f7c60163c40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c65800640 1 -- 172.21.15.2:0/3937365546 >> 172.21.15.2:0/3937365546 conn(0x7f7c60066e60 msgr2=0x7f7c60067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c65800640 1 -- 172.21.15.2:0/3937365546 shutdown_connections 2024-08-17T02:49:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.201+0000 7f7c65800640 1 -- 172.21.15.2:0/3937365546 wait complete. 2024-08-17T02:49:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.203+0000 7f7c65800640 1 Processor -- start 2024-08-17T02:49:36.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.203+0000 7f7c65800640 1 -- start start 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c65800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c6006dee0 0x7f7c601571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c65800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c600ae860 0x7f7c6016c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c65800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c60158a20 0x7f7c60147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c65800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6016cf50 con 0x7f7c60158a20 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c65800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6016d230 con 0x7f7c6006dee0 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c65800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015a820 con 0x7f7c600ae860 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c60158a20 0x7f7c60147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c60158a20 0x7f7c60147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55950/0 (socket says 172.21.15.2:55950) 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5f400640 1 -- 172.21.15.2:0/3593372315 learned_addr learned my addr 172.21.15.2:0/3593372315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5e000640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c600ae860 0x7f7c6016c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5ea00640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c6006dee0 0x7f7c601571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5f400640 1 -- 172.21.15.2:0/3593372315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c600ae860 msgr2=0x7f7c6016c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5f400640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c600ae860 0x7f7c6016c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5f400640 1 -- 172.21.15.2:0/3593372315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c6006dee0 msgr2=0x7f7c601571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5f400640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c6006dee0 0x7f7c601571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.204+0000 7f7c5f400640 1 -- 172.21.15.2:0/3593372315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58009a20 con 0x7f7c60158a20 2024-08-17T02:49:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.205+0000 7f7c5f400640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c60158a20 0x7f7c60147e50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7c580097c0 tx=0x7f7c58037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.205+0000 7f7c56000640 1 -- 172.21.15.2:0/3593372315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58031b10 con 0x7f7c60158a20 2024-08-17T02:49:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.205+0000 7f7c56000640 1 -- 172.21.15.2:0/3593372315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58031c70 con 0x7f7c60158a20 2024-08-17T02:49:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.205+0000 7f7c56000640 1 -- 172.21.15.2:0/3593372315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5803d430 con 0x7f7c60158a20 2024-08-17T02:49:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.205+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6015ab00 con 0x7f7c60158a20 2024-08-17T02:49:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.205+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c60157720 con 0x7f7c60158a20 2024-08-17T02:49:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.206+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6016d450 con 0x7f7c60158a20 2024-08-17T02:49:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.207+0000 7f7c56000640 1 -- 172.21.15.2:0/3593372315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7c58003040 con 0x7f7c60158a20 2024-08-17T02:49:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.208+0000 7f7c56000640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7c40065150 0x7f7c40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.208+0000 7f7c56000640 1 -- 172.21.15.2:0/3593372315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f7c580a3d90 con 0x7f7c60158a20 2024-08-17T02:49:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.208+0000 7f7c5ea00640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7c40065150 0x7f7c40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.209+0000 7f7c5ea00640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7c40065150 0x7f7c40067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c50000c00 tx=0x7f7c50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.212+0000 7f7c56000640 1 -- 172.21.15.2:0/3593372315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7c58071d30 con 0x7f7c60158a20 2024-08-17T02:49:36.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.434+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c6015ad10 con 0x7f7c60158a20 2024-08-17T02:49:36.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.434+0000 7f7c56000640 1 -- 172.21.15.2:0/3593372315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f7c58075350 con 0x7f7c60158a20 2024-08-17T02:49:36.435 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:36.436 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2028182828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":2028182828},{"type":"v1","addr":"172.21.15.2:6837","nonce":2028182828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:47:22.521281+0000","modified":"2024-08-17T02:47:24.261416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4953},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4953":{"gid":4953,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6836/1036695601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1036695601},{"type":"v1","addr":"172.21.15.2:6836","nonce":1036695601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000943317","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:49:36.436 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 22 2024-08-17T02:49:36.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.436+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7c40065150 msgr2=0x7f7c40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.436+0000 7f7c65800640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7c40065150 0x7f7c40067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c50000c00 tx=0x7f7c50009040 comp rx=0 tx=0).stop 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.436+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c60158a20 msgr2=0x7f7c60147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.436+0000 7f7c65800640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c60158a20 0x7f7c60147e50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7c580097c0 tx=0x7f7c58037000 comp rx=0 tx=0).stop 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.437+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 shutdown_connections 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.437+0000 7f7c65800640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c60158a20 0x7f7c60147e50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.437+0000 7f7c65800640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f7c40065150 0x7f7c40067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.437+0000 7f7c65800640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f7c600ae860 0x7f7c6016c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.437+0000 7f7c65800640 1 --2- 172.21.15.2:0/3593372315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c6006dee0 0x7f7c601571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.437+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 >> 172.21.15.2:0/3593372315 conn(0x7f7c60066e60 msgr2=0x7f7c600afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.437+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 shutdown_connections 2024-08-17T02:49:36.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.437+0000 7f7c65800640 1 -- 172.21.15.2:0/3593372315 wait complete. 2024-08-17T02:49:36.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.603+0000 7f1af2c00640 1 Processor -- start 2024-08-17T02:49:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.603+0000 7f1af2c00640 1 -- start start 2024-08-17T02:49:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.604+0000 7f1af2c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1aec0afca0 0x7f1aec0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.604+0000 7f1af2c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec0acf10 0x7f1aec159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.604+0000 7f1af2c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec15a4e0 con 0x7f1aec1589a0 2024-08-17T02:49:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.604+0000 7f1af2c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0b0980 con 0x7f1aec0afca0 2024-08-17T02:49:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.604+0000 7f1af2c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0c92b0 con 0x7f1aec0acf10 2024-08-17T02:49:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aebe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1aec0afca0 0x7f1aec0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aebe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1aec0afca0 0x7f1aec0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55962/0 (socket says 172.21.15.2:55962) 2024-08-17T02:49:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aebe00640 1 -- 172.21.15.2:0/3239689911 learned_addr learned my addr 172.21.15.2:0/3239689911 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1af0c00640 1 --1- 172.21.15.2:0/3239689911 >> v1:172.21.15.2:6789/0 conn(0x7f1aec1589a0 0x7f1aec06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47068/0 (socket says 172.21.15.2:47068) 2024-08-17T02:49:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aeb400640 1 --2- 172.21.15.2:0/3239689911 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec0acf10 0x7f1aec159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aebe00640 1 -- 172.21.15.2:0/3239689911 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec0acf10 msgr2=0x7f1aec159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aebe00640 1 --2- 172.21.15.2:0/3239689911 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec0acf10 0x7f1aec159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aebe00640 1 -- 172.21.15.2:0/3239689911 >> v1:172.21.15.2:6789/0 conn(0x7f1aec1589a0 legacy=0x7f1aec06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aeaa00640 1 -- 172.21.15.2:0/3239689911 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080789059 0 0) 0x7f1ae4001490 con 0x7f1aec1589a0 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.605+0000 7f1aebe00640 1 -- 172.21.15.2:0/3239689911 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0ad480 con 0x7f1aec0afca0 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.606+0000 7f1aebe00640 1 --2- 172.21.15.2:0/3239689911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec0b0070 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009940 tx=0x7f1adc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439b74a697a23793 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.606+0000 7f1aeaa00640 1 -- 172.21.15.2:0/3239689911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc02ae40 con 0x7f1aec0afca0 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.606+0000 7f1aeaa00640 1 -- 172.21.15.2:0/3239689911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc032440 con 0x7f1aec0afca0 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.606+0000 7f1aeaa00640 1 -- 172.21.15.2:0/3239689911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0327e0 con 0x7f1aec0afca0 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.607+0000 7f1af2c00640 1 -- 172.21.15.2:0/3239689911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 msgr2=0x7f1aec0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.607+0000 7f1af2c00640 1 --2- 172.21.15.2:0/3239689911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec0b0070 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009940 tx=0x7f1adc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.607+0000 7f1af2c00640 1 -- 172.21.15.2:0/3239689911 shutdown_connections 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.607+0000 7f1af2c00640 1 --2- 172.21.15.2:0/3239689911 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec0acf10 0x7f1aec159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.607+0000 7f1af2c00640 1 --2- 172.21.15.2:0/3239689911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec0b0070 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.607+0000 7f1af2c00640 1 -- 172.21.15.2:0/3239689911 >> 172.21.15.2:0/3239689911 conn(0x7f1aec066e60 msgr2=0x7f1aec067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:36.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.607+0000 7f1af2c00640 1 -- 172.21.15.2:0/3239689911 shutdown_connections 2024-08-17T02:49:36.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.607+0000 7f1af2c00640 1 -- 172.21.15.2:0/3239689911 wait complete. 2024-08-17T02:49:36.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.609+0000 7f1af2c00640 1 Processor -- start 2024-08-17T02:49:36.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.609+0000 7f1af2c00640 1 -- start start 2024-08-17T02:49:36.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1af2c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aec0acf10 0x7f1aec149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1af2c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1af2c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec1589a0 0x7f1aec1482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1af2c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec137890 con 0x7f1aec0afca0 2024-08-17T02:49:36.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1af2c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec149960 con 0x7f1aec0acf10 2024-08-17T02:49:36.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1af2c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec148d50 con 0x7f1aec1589a0 2024-08-17T02:49:36.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aeb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aeb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec137350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55964/0 (socket says 172.21.15.2:55964) 2024-08-17T02:49:36.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aeb400640 1 -- 172.21.15.2:0/767177076 learned_addr learned my addr 172.21.15.2:0/767177076 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:36.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1af0c00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec1589a0 0x7f1aec1482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aebe00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aec0acf10 0x7f1aec149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aeb400640 1 -- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec1589a0 msgr2=0x7f1aec1482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aeb400640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec1589a0 0x7f1aec1482e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aeb400640 1 -- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aec0acf10 msgr2=0x7f1aec149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aeb400640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aec0acf10 0x7f1aec149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1aeb400640 1 -- 172.21.15.2:0/767177076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc009450 con 0x7f1aec0afca0 2024-08-17T02:49:36.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.610+0000 7f1af0c00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec1589a0 0x7f1aec1482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:36.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.611+0000 7f1aeb400640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec137350 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800d890 tx=0x7f1ad8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.611+0000 7f1ae3400640 1 -- 172.21.15.2:0/767177076 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800de20 con 0x7f1aec0afca0 2024-08-17T02:49:36.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.611+0000 7f1ae3400640 1 -- 172.21.15.2:0/767177076 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800b8d0 con 0x7f1aec0afca0 2024-08-17T02:49:36.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.611+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec149030 con 0x7f1aec0afca0 2024-08-17T02:49:36.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.611+0000 7f1ae3400640 1 -- 172.21.15.2:0/767177076 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800bc70 con 0x7f1aec0afca0 2024-08-17T02:49:36.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.611+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec1495f0 con 0x7f1aec0afca0 2024-08-17T02:49:36.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.612+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec149af0 con 0x7f1aec0afca0 2024-08-17T02:49:36.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.613+0000 7f1ae3400640 1 -- 172.21.15.2:0/767177076 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1ad8014640 con 0x7f1aec0afca0 2024-08-17T02:49:36.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.614+0000 7f1ae3400640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1acc065150 0x7f1acc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.614+0000 7f1ae3400640 1 -- 172.21.15.2:0/767177076 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f1ad8082bd0 con 0x7f1aec0afca0 2024-08-17T02:49:36.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.614+0000 7f1aebe00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1acc065150 0x7f1acc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.615+0000 7f1aebe00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1acc065150 0x7f1acc067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1adc034000 tx=0x7f1adc032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.618+0000 7f1ae3400640 1 -- 172.21.15.2:0/767177076 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1ad8050c30 con 0x7f1aec0afca0 2024-08-17T02:49:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.800+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aec063fb0 con 0x7f1aec0afca0 2024-08-17T02:49:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.801+0000 7f1ae3400640 1 -- 172.21.15.2:0/767177076 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15414 (secure 0 0 0) 0x7f1ad8054250 con 0x7f1aec0afca0 2024-08-17T02:49:36.802 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:36.802 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:49:33.332178+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000943317.meta","create_time":"2024-08-17T02:47:20.701176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000943317"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000943317.data","create_time":"2024-08-17T02:47:21.560605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000943317"}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6837/1889487336":"2024-08-18T02:49:30.194821+0000","172.21.15.2:6835/1889487336":"2024-08-18T02:49:30.194821+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1acc065150 msgr2=0x7f1acc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1acc065150 0x7f1acc067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1adc034000 tx=0x7f1adc032000 comp rx=0 tx=0).stop 2024-08-17T02:49:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 msgr2=0x7f1aec137350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec137350 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800d890 tx=0x7f1ad8008040 comp rx=0 tx=0).stop 2024-08-17T02:49:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 shutdown_connections 2024-08-17T02:49:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f1acc065150 0x7f1acc067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1aec1589a0 0x7f1aec1482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aec0afca0 0x7f1aec137350 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 --2- 172.21.15.2:0/767177076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aec0acf10 0x7f1aec149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 >> 172.21.15.2:0/767177076 conn(0x7f1aec066e60 msgr2=0x7f1aec069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 shutdown_connections 2024-08-17T02:49:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.803+0000 7f1af2c00640 1 -- 172.21.15.2:0/767177076 wait complete. 2024-08-17T02:49:36.820 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000943317 2024-08-17T02:49:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.971+0000 7f6fbf200640 1 Processor -- start 2024-08-17T02:49:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.971+0000 7f6fbf200640 1 -- start start 2024-08-17T02:49:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.972+0000 7f6fbf200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8068470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.972+0000 7f6fbf200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb80c76f0 con 0x7f6fb806ea70 2024-08-17T02:49:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.972+0000 7f6fbf200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb80c79d0 con 0x7f6fb815bbf0 2024-08-17T02:49:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.972+0000 7f6fbf200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80c8370 con 0x7f6fb80680a0 2024-08-17T02:49:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.972+0000 7f6fbd400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6fb806ea70 0x7f6fb80c9bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47076/0 (socket says 172.21.15.2:47076) 2024-08-17T02:49:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.972+0000 7f6fbd400640 1 -- 172.21.15.2:0/1650694790 learned_addr learned my addr 172.21.15.2:0/1650694790 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.972+0000 7f6fbde00640 1 --2- 172.21.15.2:0/1650694790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8068470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.973+0000 7f6fbca00640 1 -- 172.21.15.2:0/1650694790 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198921899 0 0) 0x7f6fb80c76f0 con 0x7f6fb806ea70 2024-08-17T02:49:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.973+0000 7f6fbca00640 1 -- 172.21.15.2:0/1650694790 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa00034e0 con 0x7f6fb806ea70 2024-08-17T02:49:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.973+0000 7f6fbca00640 1 -- 172.21.15.2:0/1650694790 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164765733 0 0) 0x7f6fb80c79d0 con 0x7f6fb815bbf0 2024-08-17T02:49:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.973+0000 7f6fbca00640 1 -- 172.21.15.2:0/1650694790 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb80c76f0 con 0x7f6fb815bbf0 2024-08-17T02:49:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.973+0000 7f6fbde00640 1 -- 172.21.15.2:0/1650694790 >> v1:172.21.15.26:6789/0 conn(0x7f6fb815bbf0 legacy=0x7f6fb815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.973+0000 7f6fbde00640 1 -- 172.21.15.2:0/1650694790 >> v1:172.21.15.2:6789/0 conn(0x7f6fb806ea70 legacy=0x7f6fb80c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.973+0000 7f6fbde00640 1 -- 172.21.15.2:0/1650694790 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80c7cb0 con 0x7f6fb80680a0 2024-08-17T02:49:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.974+0000 7f6fbde00640 1 --2- 172.21.15.2:0/1650694790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8068470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009880 tx=0x7f6fac0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce5554574f10c22 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.974+0000 7f6fbca00640 1 -- 172.21.15.2:0/1650694790 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac02ad80 con 0x7f6fb80680a0 2024-08-17T02:49:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.974+0000 7f6fbca00640 1 -- 172.21.15.2:0/1650694790 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac032440 con 0x7f6fb80680a0 2024-08-17T02:49:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.974+0000 7f6fbca00640 1 -- 172.21.15.2:0/1650694790 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0327e0 con 0x7f6fb80680a0 2024-08-17T02:49:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.975+0000 7f6fbf200640 1 -- 172.21.15.2:0/1650694790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 msgr2=0x7f6fb8068470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.975+0000 7f6fbf200640 1 --2- 172.21.15.2:0/1650694790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8068470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009880 tx=0x7f6fac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.975+0000 7f6fbf200640 1 -- 172.21.15.2:0/1650694790 shutdown_connections 2024-08-17T02:49:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.975+0000 7f6fbf200640 1 --2- 172.21.15.2:0/1650694790 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8068470 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.975+0000 7f6fbf200640 1 -- 172.21.15.2:0/1650694790 >> 172.21.15.2:0/1650694790 conn(0x7f6fb806ded0 msgr2=0x7f6fb806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.975+0000 7f6fbf200640 1 -- 172.21.15.2:0/1650694790 shutdown_connections 2024-08-17T02:49:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.975+0000 7f6fbf200640 1 -- 172.21.15.2:0/1650694790 wait complete. 2024-08-17T02:49:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.976+0000 7f6fbf200640 1 Processor -- start 2024-08-17T02:49:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.977+0000 7f6fbf200640 1 -- start start 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.977+0000 7f6fbf200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.977+0000 7f6fbf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fb806ea70 0x7f6fb8150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbf200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fb815bbf0 0x7f6fb8151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81518d0 con 0x7f6fb806ea70 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbf200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81568e0 con 0x7f6fb815bbf0 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbf200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8156bc0 con 0x7f6fb80680a0 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fb806ea70 0x7f6fb8150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fb806ea70 0x7f6fb8150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55970/0 (socket says 172.21.15.2:55970) 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbd400640 1 -- 172.21.15.2:0/3479394869 learned_addr learned my addr 172.21.15.2:0/3479394869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbde00640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbe800640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fb815bbf0 0x7f6fb8151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbd400640 1 -- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 msgr2=0x7f6fb8157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbd400640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbd400640 1 -- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fb815bbf0 msgr2=0x7f6fb8151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbd400640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fb815bbf0 0x7f6fb8151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbd400640 1 -- 172.21.15.2:0/3479394869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009390 con 0x7f6fb806ea70 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.978+0000 7f6fbe800640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fb815bbf0 0x7f6fb8151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.979+0000 7f6fbd400640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fb806ea70 0x7f6fb8150e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8005840 tx=0x7f6fa8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.979+0000 7f6fb1600640 1 -- 172.21.15.2:0/3479394869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8005aa0 con 0x7f6fb806ea70 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.979+0000 7f6fb1600640 1 -- 172.21.15.2:0/3479394869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8005c00 con 0x7f6fb806ea70 2024-08-17T02:49:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.979+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb8156ea0 con 0x7f6fb806ea70 2024-08-17T02:49:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.979+0000 7f6fb1600640 1 -- 172.21.15.2:0/3479394869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80070f0 con 0x7f6fb806ea70 2024-08-17T02:49:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.979+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb8157460 con 0x7f6fb806ea70 2024-08-17T02:49:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.980+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb8070720 con 0x7f6fb806ea70 2024-08-17T02:49:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.981+0000 7f6fb1600640 1 -- 172.21.15.2:0/3479394869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6fa8007520 con 0x7f6fb806ea70 2024-08-17T02:49:36.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.982+0000 7f6fb1600640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6f9c065150 0x7f6f9c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:36.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.982+0000 7f6fb1600640 1 -- 172.21.15.2:0/3479394869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f6fa8081f70 con 0x7f6fb806ea70 2024-08-17T02:49:36.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.983+0000 7f6fbde00640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6f9c065150 0x7f6f9c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:36.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.983+0000 7f6fbde00640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6f9c065150 0x7f6f9c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6fac034000 tx=0x7f6fac032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:36.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:36.986+0000 7f6fb1600640 1 -- 172.21.15.2:0/3479394869 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6fa804ff90 con 0x7f6fb806ea70 2024-08-17T02:49:37.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.205+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000943317"} v 0) v1 -- 0x7f6fb806e6e0 con 0x7f6fb806ea70 2024-08-17T02:49:37.207 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-08-17T02:49:37.206+0000 7fa73ce00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:49:37.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.211+0000 7f6fb1600640 1 -- 172.21.15.2:0/3479394869 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000943317"}]=0 volume_0000000000943317 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 195+0+0 (secure 0 0 0) 0x7f6fa80535b0 con 0x7f6fb806ea70 2024-08-17T02:49:37.212 INFO:teuthology.orchestra.run.smithi002.stderr:volume_0000000000943317 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:49:37.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6f9c065150 msgr2=0x7f6f9c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:37.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6f9c065150 0x7f6f9c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6fac034000 tx=0x7f6fac032000 comp rx=0 tx=0).stop 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fb806ea70 msgr2=0x7f6fb8150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fb806ea70 0x7f6fb8150e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8005840 tx=0x7f6fa8007e10 comp rx=0 tx=0).stop 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 shutdown_connections 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6fb815bbf0 0x7f6fb8151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fb806ea70 0x7f6fb8150e50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6f9c065150 0x7f6f9c067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 --2- 172.21.15.2:0/3479394869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f6fb80680a0 0x7f6fb8157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.213+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 >> 172.21.15.2:0/3479394869 conn(0x7f6fb806ded0 msgr2=0x7f6fb80c1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.214+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 shutdown_connections 2024-08-17T02:49:37.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.214+0000 7f6fbf200640 1 -- 172.21.15.2:0/3479394869 wait complete. 2024-08-17T02:49:37.218 INFO:tasks.ceph.mds.c.smithi002.stderr: -3152> 2024-08-17T02:47:26.343+0000 7fead3c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:49:37.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000943317 --yes-i-really-mean-it 2024-08-17T02:49:37.259 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-08-17T02:49:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.387+0000 7f6114000640 1 Processor -- start 2024-08-17T02:49:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.387+0000 7f6114000640 1 -- start start 2024-08-17T02:49:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.388+0000 7f6114000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ad960 0x7f610c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.388+0000 7f6114000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f610c0add30 0x7f610c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.388+0000 7f6114000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c15b5e0 con 0x7f610c0ca050 2024-08-17T02:49:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.388+0000 7f6114000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0cb160 con 0x7f610c0add30 2024-08-17T02:49:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.388+0000 7f6114000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b0d10 con 0x7f610c0ad960 2024-08-17T02:49:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.388+0000 7f6110c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f610c0ca050 0x7f610c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47090/0 (socket says 172.21.15.2:47090) 2024-08-17T02:49:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.388+0000 7f6110c00640 1 -- 172.21.15.2:0/1603138796 learned_addr learned my addr 172.21.15.2:0/1603138796 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f6112000640 1 --2- 172.21.15.2:0/1603138796 >> v2:172.21.15.26:3300/0 conn(0x7f610c0add30 0x7f610c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f6111600640 1 --2- 172.21.15.2:0/1603138796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ad960 0x7f610c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f610be00640 1 -- 172.21.15.2:0/1603138796 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933240256 0 0) 0x7f60f8001110 con 0x7f610c0ca050 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f610be00640 1 -- 172.21.15.2:0/1603138796 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f40034e0 con 0x7f610c0ca050 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f610be00640 1 -- 172.21.15.2:0/1603138796 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729530950 0 0) 0x7f60f40034e0 con 0x7f610c0ca050 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f6111600640 1 -- 172.21.15.2:0/1603138796 >> v2:172.21.15.26:3300/0 conn(0x7f610c0add30 msgr2=0x7f610c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f6111600640 1 --2- 172.21.15.2:0/1603138796 >> v2:172.21.15.26:3300/0 conn(0x7f610c0add30 0x7f610c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f6111600640 1 -- 172.21.15.2:0/1603138796 >> v1:172.21.15.2:6789/0 conn(0x7f610c0ca050 legacy=0x7f610c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.389+0000 7f6111600640 1 -- 172.21.15.2:0/1603138796 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0ca550 con 0x7f610c0ad960 2024-08-17T02:49:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.391+0000 7f6111600640 1 --2- 172.21.15.2:0/1603138796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ad960 0x7f610c15b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6100009850 tx=0x7f61000090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e07521d5d22fc096 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:37.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.391+0000 7f610be00640 1 -- 172.21.15.2:0/1603138796 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8001600 con 0x7f610c0ad960 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.391+0000 7f610be00640 1 -- 172.21.15.2:0/1603138796 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610002aae0 con 0x7f610c0ad960 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.391+0000 7f610be00640 1 -- 172.21.15.2:0/1603138796 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610002ae80 con 0x7f610c0ad960 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.391+0000 7f6114000640 1 -- 172.21.15.2:0/1603138796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ad960 msgr2=0x7f610c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.391+0000 7f6114000640 1 --2- 172.21.15.2:0/1603138796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ad960 0x7f610c15b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6100009850 tx=0x7f61000090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.392+0000 7f6114000640 1 -- 172.21.15.2:0/1603138796 shutdown_connections 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.392+0000 7f6114000640 1 --2- 172.21.15.2:0/1603138796 >> v2:172.21.15.26:3300/0 conn(0x7f610c0add30 0x7f610c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.392+0000 7f6114000640 1 --2- 172.21.15.2:0/1603138796 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ad960 0x7f610c15b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.392+0000 7f6114000640 1 -- 172.21.15.2:0/1603138796 >> 172.21.15.2:0/1603138796 conn(0x7f610c066e60 msgr2=0x7f610c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.392+0000 7f6114000640 1 -- 172.21.15.2:0/1603138796 shutdown_connections 2024-08-17T02:49:37.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.392+0000 7f6114000640 1 -- 172.21.15.2:0/1603138796 wait complete. 2024-08-17T02:49:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.393+0000 7f6114000640 1 Processor -- start 2024-08-17T02:49:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.393+0000 7f6114000640 1 -- start start 2024-08-17T02:49:37.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6114000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f610c0ad960 0x7f610c144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6114000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0add30 0x7f610c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6114000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ca050 0x7f610c0aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6114000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0aa3a0 con 0x7f610c0ad960 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6114000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c157640 con 0x7f610c0add30 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6114000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0a9790 con 0x7f610c0ca050 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6111600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f610c0ad960 0x7f610c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6111600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f610c0ad960 0x7f610c144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55980/0 (socket says 172.21.15.2:55980) 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.394+0000 7f6111600640 1 -- 172.21.15.2:0/2546272200 learned_addr learned my addr 172.21.15.2:0/2546272200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.395+0000 7f6112000640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ca050 0x7f610c0aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.395+0000 7f6110c00640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0add30 0x7f610c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.395+0000 7f6111600640 1 -- 172.21.15.2:0/2546272200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ca050 msgr2=0x7f610c0aa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:37.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.395+0000 7f6111600640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ca050 0x7f610c0aa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.395+0000 7f6111600640 1 -- 172.21.15.2:0/2546272200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0add30 msgr2=0x7f610c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.395+0000 7f6111600640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0add30 0x7f610c157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.395+0000 7f6111600640 1 -- 172.21.15.2:0/2546272200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100009390 con 0x7f610c0ad960 2024-08-17T02:49:37.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.395+0000 7f6111600640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f610c0ad960 0x7f610c144490 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6100009850 tx=0x7f6100032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.396+0000 7f6108c00640 1 -- 172.21.15.2:0/2546272200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610003d700 con 0x7f610c0ad960 2024-08-17T02:49:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.396+0000 7f6108c00640 1 -- 172.21.15.2:0/2546272200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610003d880 con 0x7f610c0ad960 2024-08-17T02:49:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.396+0000 7f6108c00640 1 -- 172.21.15.2:0/2546272200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610003dc40 con 0x7f610c0ad960 2024-08-17T02:49:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.396+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c0a9a70 con 0x7f610c0ad960 2024-08-17T02:49:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.396+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c0aa030 con 0x7f610c0ad960 2024-08-17T02:49:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.397+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c063fb0 con 0x7f610c0ad960 2024-08-17T02:49:37.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.398+0000 7f6108c00640 1 -- 172.21.15.2:0/2546272200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6100039040 con 0x7f610c0ad960 2024-08-17T02:49:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.399+0000 7f6108c00640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f60ec065150 0x7f60ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.399+0000 7f6108c00640 1 -- 172.21.15.2:0/2546272200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f61000a2080 con 0x7f610c0ad960 2024-08-17T02:49:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.399+0000 7f6110c00640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f60ec065150 0x7f60ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:37.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.400+0000 7f6110c00640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f60ec065150 0x7f60ec067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f610c153d50 tx=0x7f60f80015f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:37.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.403+0000 7f6108c00640 1 -- 172.21.15.2:0/2546272200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61000d3e40 con 0x7f610c0ad960 2024-08-17T02:49:37.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:37.625+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000943317", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f610c156c90 con 0x7f610c0ad960 2024-08-17T02:49:38.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.212+0000 7f6108c00640 1 -- 172.21.15.2:0/2546272200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000943317", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7f6100070070 con 0x7f610c0ad960 2024-08-17T02:49:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f60ec065150 msgr2=0x7f60ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f60ec065150 0x7f60ec067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f610c153d50 tx=0x7f60f80015f0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f610c0ad960 msgr2=0x7f610c144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f610c0ad960 0x7f610c144490 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6100009850 tx=0x7f6100032000 comp rx=0 tx=0).stop 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 shutdown_connections 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f60ec065150 0x7f60ec067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f610c0ca050 0x7f610c0aa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f610c0add30 0x7f610c157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 --2- 172.21.15.2:0/2546272200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f610c0ad960 0x7f610c144490 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 >> 172.21.15.2:0/2546272200 conn(0x7f610c066e60 msgr2=0x7f610c0cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.214+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 shutdown_connections 2024-08-17T02:49:38.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.215+0000 7f6114000640 1 -- 172.21.15.2:0/2546272200 wait complete. 2024-08-17T02:49:38.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000943317.meta cephfs.volume_0000000000943317.meta --yes-i-really-really-mean-it 2024-08-17T02:49:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.430+0000 7fac8fc00640 1 Processor -- start 2024-08-17T02:49:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.430+0000 7fac8fc00640 1 -- start start 2024-08-17T02:49:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8fc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fac88156a90 0x7fac880ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8fc00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8fc00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac881582b0 con 0x7fac880adba0 2024-08-17T02:49:38.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8fc00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac880c9f80 con 0x7fac88156a90 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8fc00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac880ca110 con 0x7fac880aef00 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fac88156a90 0x7fac880ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8d200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fac88156a90 0x7fac880ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55984/0 (socket says 172.21.15.2:55984) 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8d200640 1 -- 172.21.15.2:0/123703722 learned_addr learned my addr 172.21.15.2:0/123703722 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac87e00640 1 --1- 172.21.15.2:0/123703722 >> v1:172.21.15.2:6789/0 conn(0x7fac880adba0 0x7fac880ae7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47100/0 (socket says 172.21.15.2:47100) 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8dc00640 1 --2- 172.21.15.2:0/123703722 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8d200640 1 -- 172.21.15.2:0/123703722 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 msgr2=0x7fac880ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8d200640 1 --2- 172.21.15.2:0/123703722 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.432+0000 7fac8d200640 1 -- 172.21.15.2:0/123703722 >> v1:172.21.15.2:6789/0 conn(0x7fac880adba0 legacy=0x7fac880ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.433+0000 7fac8d200640 1 -- 172.21.15.2:0/123703722 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880adff0 con 0x7fac88156a90 2024-08-17T02:49:38.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.433+0000 7fac8dc00640 1 --2- 172.21.15.2:0/123703722 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.434+0000 7fac8d200640 1 --2- 172.21.15.2:0/123703722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac88156a90 0x7fac880ad660 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009910 tx=0x7fac7c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a14b00ec012fe27 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:38.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.434+0000 7fac87400640 1 -- 172.21.15.2:0/123703722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c02add0 con 0x7fac88156a90 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.434+0000 7fac87400640 1 -- 172.21.15.2:0/123703722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c032440 con 0x7fac88156a90 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.434+0000 7fac87400640 1 -- 172.21.15.2:0/123703722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c032820 con 0x7fac88156a90 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.434+0000 7fac8fc00640 1 -- 172.21.15.2:0/123703722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac88156a90 msgr2=0x7fac880ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.434+0000 7fac8fc00640 1 --2- 172.21.15.2:0/123703722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac88156a90 0x7fac880ad660 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009910 tx=0x7fac7c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.435+0000 7fac8fc00640 1 -- 172.21.15.2:0/123703722 shutdown_connections 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.435+0000 7fac8fc00640 1 --2- 172.21.15.2:0/123703722 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.435+0000 7fac8fc00640 1 --2- 172.21.15.2:0/123703722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac88156a90 0x7fac880ad660 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.435+0000 7fac8fc00640 1 -- 172.21.15.2:0/123703722 >> 172.21.15.2:0/123703722 conn(0x7fac88066e60 msgr2=0x7fac88067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.435+0000 7fac8fc00640 1 -- 172.21.15.2:0/123703722 shutdown_connections 2024-08-17T02:49:38.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.435+0000 7fac8fc00640 1 -- 172.21.15.2:0/123703722 wait complete. 2024-08-17T02:49:38.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.436+0000 7fac8fc00640 1 Processor -- start 2024-08-17T02:49:38.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.436+0000 7fac8fc00640 1 -- start start 2024-08-17T02:49:38.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8fc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac880adba0 0x7fac880a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8fc00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8fc00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac88156a90 0x7fac8814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8fc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac880a5890 con 0x7fac880adba0 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8fc00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac880a9350 con 0x7fac88156a90 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8fc00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac880a87a0 con 0x7fac880aef00 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac880adba0 0x7fac880a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac880adba0 0x7fac880a5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56000/0 (socket says 172.21.15.2:56000) 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8d200640 1 -- 172.21.15.2:0/2448260873 learned_addr learned my addr 172.21.15.2:0/2448260873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac8dc00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac88156a90 0x7fac8814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.437+0000 7fac87e00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8d200640 1 -- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 msgr2=0x7fac880a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8d200640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8d200640 1 -- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac88156a90 msgr2=0x7fac8814f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:38.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8d200640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac88156a90 0x7fac8814f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:38.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8d200640 1 -- 172.21.15.2:0/2448260873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c009450 con 0x7fac880adba0 2024-08-17T02:49:38.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8dc00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac88156a90 0x7fac8814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:38.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8d200640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac880adba0 0x7fac880a5060 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009970 tx=0x7fac7c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac7be00640 1 -- 172.21.15.2:0/2448260873 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c031de0 con 0x7fac880adba0 2024-08-17T02:49:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac7be00640 1 -- 172.21.15.2:0/2448260873 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c03d440 con 0x7fac880adba0 2024-08-17T02:49:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac7be00640 1 -- 172.21.15.2:0/2448260873 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c03d800 con 0x7fac880adba0 2024-08-17T02:49:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac880a8a20 con 0x7fac880adba0 2024-08-17T02:49:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.438+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac880a8fe0 con 0x7fac880adba0 2024-08-17T02:49:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.439+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac88063fb0 con 0x7fac880adba0 2024-08-17T02:49:38.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.440+0000 7fac7be00640 1 -- 172.21.15.2:0/2448260873 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fac7c039040 con 0x7fac880adba0 2024-08-17T02:49:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.441+0000 7fac7be00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fac68065180 0x7fac68067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.441+0000 7fac7be00640 1 -- 172.21.15.2:0/2448260873 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fac7c0a28c0 con 0x7fac880adba0 2024-08-17T02:49:38.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.441+0000 7fac87e00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fac68065180 0x7fac68067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:38.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.442+0000 7fac87e00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fac68065180 0x7fac68067630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fac88063810 tx=0x7fac74007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.446+0000 7fac7be00640 1 -- 172.21.15.2:0/2448260873 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fac7c070800 con 0x7fac880adba0 2024-08-17T02:49:38.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:38.630+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000943317.meta", "pool2": "cephfs.volume_0000000000943317.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fac881573c0 con 0x7fac880adba0 2024-08-17T02:49:39.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.361+0000 7fac7be00640 1 -- 172.21.15.2:0/2448260873 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000943317.meta", "pool2": "cephfs.volume_0000000000943317.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000943317.meta' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7fac7c037100 con 0x7fac880adba0 2024-08-17T02:49:39.362 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs.volume_0000000000943317.meta' removed 2024-08-17T02:49:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fac68065180 msgr2=0x7fac68067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fac68065180 0x7fac68067630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fac88063810 tx=0x7fac74007ce0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac880adba0 msgr2=0x7fac880a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:39.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac880adba0 0x7fac880a5060 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009970 tx=0x7fac7c032000 comp rx=0 tx=0).stop 2024-08-17T02:49:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 shutdown_connections 2024-08-17T02:49:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac88156a90 0x7fac8814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fac68065180 0x7fac68067630 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fac880aef00 0x7fac880a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 --2- 172.21.15.2:0/2448260873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac880adba0 0x7fac880a5060 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 >> 172.21.15.2:0/2448260873 conn(0x7fac88066e60 msgr2=0x7fac88150330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 shutdown_connections 2024-08-17T02:49:39.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.365+0000 7fac8fc00640 1 -- 172.21.15.2:0/2448260873 wait complete. 2024-08-17T02:49:39.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000943317.data cephfs.volume_0000000000943317.data --yes-i-really-really-mean-it 2024-08-17T02:49:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb13200640 1 Processor -- start 2024-08-17T02:49:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb13200640 1 -- start start 2024-08-17T02:49:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb13200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb14158b00 0x7fdb140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb13200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdb140b1fa0 0x7fdb140ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb13200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140b07f0 con 0x7fdb14069d10 2024-08-17T02:49:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb13200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb140b0ad0 con 0x7fdb14158b00 2024-08-17T02:49:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb13200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb140b0db0 con 0x7fdb140b1fa0 2024-08-17T02:49:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb11e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb14158b00 0x7fdb140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb11e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb14158b00 0x7fdb140697d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56016/0 (socket says 172.21.15.2:56016) 2024-08-17T02:49:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb11e00640 1 -- 172.21.15.2:0/3107585195 learned_addr learned my addr 172.21.15.2:0/3107585195 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.543+0000 7fdb12800640 1 --2- 172.21.15.2:0/3107585195 >> v2:172.21.15.26:3300/0 conn(0x7fdb140b1fa0 0x7fdb140ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.544+0000 7fdb11e00640 1 -- 172.21.15.2:0/3107585195 >> v2:172.21.15.26:3300/0 conn(0x7fdb140b1fa0 msgr2=0x7fdb140ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.544+0000 7fdb11e00640 1 --2- 172.21.15.2:0/3107585195 >> v2:172.21.15.26:3300/0 conn(0x7fdb140b1fa0 0x7fdb140ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.544+0000 7fdb11e00640 1 -- 172.21.15.2:0/3107585195 >> v1:172.21.15.2:6789/0 conn(0x7fdb14069d10 legacy=0x7fdb140b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.544+0000 7fdb11e00640 1 -- 172.21.15.2:0/3107585195 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140b1090 con 0x7fdb14158b00 2024-08-17T02:49:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.545+0000 7fdb11e00640 1 --2- 172.21.15.2:0/3107585195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb14158b00 0x7fdb140697d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdb140a8970 tx=0x7fdb040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efdb0b3e6c2ea20 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.545+0000 7fdb10a00640 1 -- 172.21.15.2:0/3107585195 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0402ae80 con 0x7fdb14158b00 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.545+0000 7fdb10a00640 1 -- 172.21.15.2:0/3107585195 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04032440 con 0x7fdb14158b00 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.545+0000 7fdb10a00640 1 -- 172.21.15.2:0/3107585195 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04032800 con 0x7fdb14158b00 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.545+0000 7fdb13200640 1 -- 172.21.15.2:0/3107585195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb14158b00 msgr2=0x7fdb140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.545+0000 7fdb13200640 1 --2- 172.21.15.2:0/3107585195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb14158b00 0x7fdb140697d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdb140a8970 tx=0x7fdb040091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.546+0000 7fdb13200640 1 -- 172.21.15.2:0/3107585195 shutdown_connections 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.546+0000 7fdb13200640 1 --2- 172.21.15.2:0/3107585195 >> v2:172.21.15.26:3300/0 conn(0x7fdb140b1fa0 0x7fdb140ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.546+0000 7fdb13200640 1 --2- 172.21.15.2:0/3107585195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb14158b00 0x7fdb140697d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.546+0000 7fdb13200640 1 -- 172.21.15.2:0/3107585195 >> 172.21.15.2:0/3107585195 conn(0x7fdb14066e60 msgr2=0x7fdb14067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.546+0000 7fdb13200640 1 -- 172.21.15.2:0/3107585195 shutdown_connections 2024-08-17T02:49:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.546+0000 7fdb13200640 1 -- 172.21.15.2:0/3107585195 wait complete. 2024-08-17T02:49:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.547+0000 7fdb13200640 1 Processor -- start 2024-08-17T02:49:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.547+0000 7fdb13200640 1 -- start start 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.548+0000 7fdb13200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb14069d10 0x7fdb14096ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.548+0000 7fdb13200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb140b1fa0 0x7fdb14156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.548+0000 7fdb13200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb14158b00 0x7fdb141578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.548+0000 7fdb13200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14097730 con 0x7fdb140b1fa0 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.548+0000 7fdb13200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1416d060 con 0x7fdb14069d10 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.548+0000 7fdb13200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14097450 con 0x7fdb14158b00 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb140b1fa0 0x7fdb14156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb140b1fa0 0x7fdb14156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56030/0 (socket says 172.21.15.2:56030) 2024-08-17T02:49:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 -- 172.21.15.2:0/3226954050 learned_addr learned my addr 172.21.15.2:0/3226954050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11e00640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb14069d10 0x7fdb14096ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb12800640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb14158b00 0x7fdb141578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 -- 172.21.15.2:0/3226954050 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb14158b00 msgr2=0x7fdb141578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb14158b00 0x7fdb141578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 -- 172.21.15.2:0/3226954050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb14069d10 msgr2=0x7fdb14096ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb14069d10 0x7fdb14096ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 -- 172.21.15.2:0/3226954050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb04009450 con 0x7fdb140b1fa0 2024-08-17T02:49:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.549+0000 7fdb11400640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb140b1fa0 0x7fdb14156d00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c590 tx=0x7fdb00007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.550+0000 7fdb09600640 1 -- 172.21.15.2:0/3226954050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00011590 con 0x7fdb140b1fa0 2024-08-17T02:49:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.550+0000 7fdb09600640 1 -- 172.21.15.2:0/3226954050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb00011710 con 0x7fdb140b1fa0 2024-08-17T02:49:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.550+0000 7fdb09600640 1 -- 172.21.15.2:0/3226954050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00011ad0 con 0x7fdb140b1fa0 2024-08-17T02:49:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.550+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1416ca10 con 0x7fdb140b1fa0 2024-08-17T02:49:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.550+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb14097020 con 0x7fdb140b1fa0 2024-08-17T02:49:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.551+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1416c870 con 0x7fdb140b1fa0 2024-08-17T02:49:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.552+0000 7fdb09600640 1 -- 172.21.15.2:0/3226954050 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdb0001b3b0 con 0x7fdb140b1fa0 2024-08-17T02:49:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.552+0000 7fdb09600640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdaf4065150 0x7fdaf4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.553+0000 7fdb09600640 1 -- 172.21.15.2:0/3226954050 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fdb00081950 con 0x7fdb140b1fa0 2024-08-17T02:49:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.553+0000 7fdb11e00640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdaf4065150 0x7fdaf4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.554+0000 7fdb11e00640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdaf4065150 0x7fdaf4067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb04034000 tx=0x7fdb04032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.557+0000 7fdb09600640 1 -- 172.21.15.2:0/3226954050 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdb1416c870 con 0x7fdb140b1fa0 2024-08-17T02:49:39.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:39.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:49:39.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:39.743+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000943317.data", "pool2": "cephfs.volume_0000000000943317.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb1416c870 con 0x7fdb140b1fa0 2024-08-17T02:49:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.368+0000 7fdb09600640 1 -- 172.21.15.2:0/3226954050 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000943317.data", "pool2": "cephfs.volume_0000000000943317.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000943317.data' removed v44) v1 ==== 241+0+0 (secure 0 0 0) 0x7fdb1416c870 con 0x7fdb140b1fa0 2024-08-17T02:49:40.368 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs.volume_0000000000943317.data' removed 2024-08-17T02:49:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdaf4065150 msgr2=0x7fdaf4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdaf4065150 0x7fdaf4067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb04034000 tx=0x7fdb04032000 comp rx=0 tx=0).stop 2024-08-17T02:49:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb140b1fa0 msgr2=0x7fdb14156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb140b1fa0 0x7fdb14156d00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c590 tx=0x7fdb00007ec0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 shutdown_connections 2024-08-17T02:49:40.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fdaf4065150 0x7fdaf4067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fdb14158b00 0x7fdb141578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb140b1fa0 0x7fdb14156d00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 --2- 172.21.15.2:0/3226954050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb14069d10 0x7fdb14096ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 >> 172.21.15.2:0/3226954050 conn(0x7fdb14066e60 msgr2=0x7fdb140ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 shutdown_connections 2024-08-17T02:49:40.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.371+0000 7fdb13200640 1 -- 172.21.15.2:0/3226954050 wait complete. 2024-08-17T02:49:40.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:49:40.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.582+0000 7ff93a800640 1 Processor -- start 2024-08-17T02:49:40.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.582+0000 7ff93a800640 1 -- start start 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.583+0000 7ff93a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9340afca0 0x7ff9340b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.583+0000 7ff93a800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9340c92b0 con 0x7ff9340acf10 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.583+0000 7ff93a800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9340ad480 con 0x7ff9341590b0 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.583+0000 7ff93a800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9340b0980 con 0x7ff9340afca0 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.584+0000 7ff933400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9340afca0 0x7ff9340b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.584+0000 7ff933400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9340afca0 0x7ff9340b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56034/0 (socket says 172.21.15.2:56034) 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.584+0000 7ff933400640 1 -- 172.21.15.2:0/3415592184 learned_addr learned my addr 172.21.15.2:0/3415592184 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.584+0000 7ff932a00640 1 --1- 172.21.15.2:0/3415592184 >> v1:172.21.15.2:6789/0 conn(0x7ff9340acf10 0x7ff9341589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47106/0 (socket says 172.21.15.2:47106) 2024-08-17T02:49:40.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.584+0000 7ff933400640 1 -- 172.21.15.2:0/3415592184 >> v1:172.21.15.26:6789/0 conn(0x7ff9341590b0 legacy=0x7ff9340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.584+0000 7ff933400640 1 -- 172.21.15.2:0/3415592184 >> v1:172.21.15.2:6789/0 conn(0x7ff9340acf10 legacy=0x7ff9341589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.584+0000 7ff932000640 1 -- 172.21.15.2:0/3415592184 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658047688 0 0) 0x7ff9340c92b0 con 0x7ff9340acf10 2024-08-17T02:49:40.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.584+0000 7ff933400640 1 -- 172.21.15.2:0/3415592184 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340ad760 con 0x7ff9340afca0 2024-08-17T02:49:40.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.585+0000 7ff933400640 1 --2- 172.21.15.2:0/3415592184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9340afca0 0x7ff9340b0070 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff924009910 tx=0x7ff9240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884a79cd01dd739a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:40.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.585+0000 7ff932000640 1 -- 172.21.15.2:0/3415592184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924032440 con 0x7ff9340afca0 2024-08-17T02:49:40.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.585+0000 7ff932000640 1 -- 172.21.15.2:0/3415592184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9240325a0 con 0x7ff9340afca0 2024-08-17T02:49:40.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.585+0000 7ff932000640 1 -- 172.21.15.2:0/3415592184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924032940 con 0x7ff9340afca0 2024-08-17T02:49:40.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.586+0000 7ff93a800640 1 -- 172.21.15.2:0/3415592184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9340afca0 msgr2=0x7ff9340b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.586+0000 7ff93a800640 1 --2- 172.21.15.2:0/3415592184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9340afca0 0x7ff9340b0070 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff924009910 tx=0x7ff9240091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.586+0000 7ff93a800640 1 -- 172.21.15.2:0/3415592184 shutdown_connections 2024-08-17T02:49:40.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.586+0000 7ff93a800640 1 --2- 172.21.15.2:0/3415592184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9340afca0 0x7ff9340b0070 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.586+0000 7ff93a800640 1 -- 172.21.15.2:0/3415592184 >> 172.21.15.2:0/3415592184 conn(0x7ff934066e60 msgr2=0x7ff934067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:40.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.586+0000 7ff93a800640 1 -- 172.21.15.2:0/3415592184 shutdown_connections 2024-08-17T02:49:40.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.586+0000 7ff93a800640 1 -- 172.21.15.2:0/3415592184 wait complete. 2024-08-17T02:49:40.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.587+0000 7ff93a800640 1 Processor -- start 2024-08-17T02:49:40.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.588+0000 7ff93a800640 1 -- start start 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.588+0000 7ff93a800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9340acf10 0x7ff9341422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff93a800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9340afca0 0x7ff9340aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff93a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9341590b0 0x7ff9341476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff93a800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340c1360 con 0x7ff9341590b0 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff93a800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff934145420 con 0x7ff9340afca0 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff93a800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340af240 con 0x7ff9340acf10 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9341590b0 0x7ff9341476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9341590b0 0x7ff9341476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56038/0 (socket says 172.21.15.2:56038) 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933e00640 1 -- 172.21.15.2:0/738900559 learned_addr learned my addr 172.21.15.2:0/738900559 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933400640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9340acf10 0x7ff9341422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff932a00640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9340afca0 0x7ff9340aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933e00640 1 -- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9340acf10 msgr2=0x7ff9341422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933e00640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9340acf10 0x7ff9341422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933e00640 1 -- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9340afca0 msgr2=0x7ff9340aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933e00640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9340afca0 0x7ff9340aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933e00640 1 -- 172.21.15.2:0/738900559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924009450 con 0x7ff9341590b0 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff933400640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9340acf10 0x7ff9341422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.589+0000 7ff932a00640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9340afca0 0x7ff9340aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.590+0000 7ff933e00640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9341590b0 0x7ff9341476a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00c7c0 tx=0x7ff92c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.590+0000 7ff92aa00640 1 -- 172.21.15.2:0/738900559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00a640 con 0x7ff9341590b0 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.590+0000 7ff92aa00640 1 -- 172.21.15.2:0/738900559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c00a7c0 con 0x7ff9341590b0 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.590+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9340af520 con 0x7ff9341590b0 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.590+0000 7ff92aa00640 1 -- 172.21.15.2:0/738900559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00ab80 con 0x7ff9341590b0 2024-08-17T02:49:40.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.590+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff934147be0 con 0x7ff9341590b0 2024-08-17T02:49:40.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.591+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff934147e60 con 0x7ff9341590b0 2024-08-17T02:49:40.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.592+0000 7ff92aa00640 1 -- 172.21.15.2:0/738900559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff92c012420 con 0x7ff9341590b0 2024-08-17T02:49:40.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.592+0000 7ff92aa00640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff914065150 0x7ff914067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.593+0000 7ff92aa00640 1 -- 172.21.15.2:0/738900559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff92c082340 con 0x7ff9341590b0 2024-08-17T02:49:40.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.593+0000 7ff933400640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff914065150 0x7ff914067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.593+0000 7ff933400640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff914065150 0x7ff914067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff924034000 tx=0x7ff924032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:40.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.596+0000 7ff92aa00640 1 -- 172.21.15.2:0/738900559 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff92c0506a0 con 0x7ff9341590b0 2024-08-17T02:49:40.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.780+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff934063fb0 con 0x7ff9341590b0 2024-08-17T02:49:40.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.785+0000 7ff92aa00640 1 -- 172.21.15.2:0/738900559 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff92c053cc0 con 0x7ff9341590b0 2024-08-17T02:49:40.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff914065150 msgr2=0x7ff914067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff914065150 0x7ff914067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff924034000 tx=0x7ff924032000 comp rx=0 tx=0).stop 2024-08-17T02:49:40.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9341590b0 msgr2=0x7ff9341476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9341590b0 0x7ff9341476a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00c7c0 tx=0x7ff92c0015b0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 shutdown_connections 2024-08-17T02:49:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9341590b0 0x7ff9341476a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9340afca0 0x7ff9340aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff914065150 0x7ff914067600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 --2- 172.21.15.2:0/738900559 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff9340acf10 0x7ff9341422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 >> 172.21.15.2:0/738900559 conn(0x7ff934066e60 msgr2=0x7ff93414c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 shutdown_connections 2024-08-17T02:49:40.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.787+0000 7ff93a800640 1 -- 172.21.15.2:0/738900559 wait complete. 2024-08-17T02:49:40.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:49:40.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.956+0000 7fd08be00640 1 Processor -- start 2024-08-17T02:49:40.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.956+0000 7fd08be00640 1 -- start start 2024-08-17T02:49:40.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.957+0000 7fd08be00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.957+0000 7fd08be00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c06d7c0 con 0x7fd08c15a590 2024-08-17T02:49:40.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.957+0000 7fd08be00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c15ab30 con 0x7fd08c156f90 2024-08-17T02:49:40.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.957+0000 7fd08be00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c15ae10 con 0x7fd08c0b0e30 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd08b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd08c15a590 0x7fd08c13fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47112/0 (socket says 172.21.15.2:47112) 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd08b400640 1 -- 172.21.15.2:0/2745454327 learned_addr learned my addr 172.21.15.2:0/2745454327 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd08aa00640 1 --2- 172.21.15.2:0/2745454327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd089600640 1 -- 172.21.15.2:0/2745454327 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975436917 0 0) 0x7fd08c06d7c0 con 0x7fd08c15a590 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd089600640 1 -- 172.21.15.2:0/2745454327 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0700034e0 con 0x7fd08c15a590 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd089600640 1 -- 172.21.15.2:0/2745454327 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649335427 0 0) 0x7fd08c15ab30 con 0x7fd08c156f90 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd089600640 1 -- 172.21.15.2:0/2745454327 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c06d7c0 con 0x7fd08c156f90 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd08aa00640 1 -- 172.21.15.2:0/2745454327 >> v1:172.21.15.26:6789/0 conn(0x7fd08c156f90 legacy=0x7fd08c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.958+0000 7fd08aa00640 1 -- 172.21.15.2:0/2745454327 >> v1:172.21.15.2:6789/0 conn(0x7fd08c15a590 legacy=0x7fd08c13fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.959+0000 7fd089600640 1 -- 172.21.15.2:0/2745454327 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4106720312 0 0) 0x7fd0700034e0 con 0x7fd08c15a590 2024-08-17T02:49:40.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.959+0000 7fd08aa00640 1 -- 172.21.15.2:0/2745454327 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c15b0f0 con 0x7fd08c0b0e30 2024-08-17T02:49:40.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.960+0000 7fd08aa00640 1 --2- 172.21.15.2:0/2745454327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c0b1200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009880 tx=0x7fd07c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91db6401ed9a4fbc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:40.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.960+0000 7fd089600640 1 -- 172.21.15.2:0/2745454327 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840017f0 con 0x7fd08c0b0e30 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.960+0000 7fd089600640 1 -- 172.21.15.2:0/2745454327 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c02aac0 con 0x7fd08c0b0e30 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.960+0000 7fd089600640 1 -- 172.21.15.2:0/2745454327 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c02ae60 con 0x7fd08c0b0e30 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.960+0000 7fd08be00640 1 -- 172.21.15.2:0/2745454327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 msgr2=0x7fd08c0b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.960+0000 7fd08be00640 1 --2- 172.21.15.2:0/2745454327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c0b1200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009880 tx=0x7fd07c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.961+0000 7fd08be00640 1 -- 172.21.15.2:0/2745454327 shutdown_connections 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.961+0000 7fd08be00640 1 --2- 172.21.15.2:0/2745454327 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c0b1200 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.961+0000 7fd08be00640 1 -- 172.21.15.2:0/2745454327 >> 172.21.15.2:0/2745454327 conn(0x7fd08c062af0 msgr2=0x7fd08c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.961+0000 7fd08be00640 1 -- 172.21.15.2:0/2745454327 shutdown_connections 2024-08-17T02:49:40.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.961+0000 7fd08be00640 1 -- 172.21.15.2:0/2745454327 wait complete. 2024-08-17T02:49:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.962+0000 7fd08be00640 1 Processor -- start 2024-08-17T02:49:40.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.962+0000 7fd08be00640 1 -- start start 2024-08-17T02:49:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08be00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c14b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd08c156f90 0x7fd08c13f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08be00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd08c15a590 0x7fd08c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c13eb80 con 0x7fd08c156f90 2024-08-17T02:49:40.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08be00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c13dfb0 con 0x7fd08c15a590 2024-08-17T02:49:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08be00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c13e250 con 0x7fd08c0b0e30 2024-08-17T02:49:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd08c156f90 0x7fd08c13f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd08c156f90 0x7fd08c13f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56050/0 (socket says 172.21.15.2:56050) 2024-08-17T02:49:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08a000640 1 -- 172.21.15.2:0/3797889023 learned_addr learned my addr 172.21.15.2:0/3797889023 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08aa00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.963+0000 7fd08b400640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd08c15a590 0x7fd08c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd08a000640 1 -- 172.21.15.2:0/3797889023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 msgr2=0x7fd08c14b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd08a000640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c14b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd08a000640 1 -- 172.21.15.2:0/3797889023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd08c15a590 msgr2=0x7fd08c1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd08a000640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd08c15a590 0x7fd08c1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd08a000640 1 -- 172.21.15.2:0/3797889023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c009390 con 0x7fd08c156f90 2024-08-17T02:49:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd08a000640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd08c156f90 0x7fd08c13f010 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c590 tx=0x7fd078007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd082000640 1 -- 172.21.15.2:0/3797889023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078012630 con 0x7fd08c156f90 2024-08-17T02:49:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd082000640 1 -- 172.21.15.2:0/3797889023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0780127b0 con 0x7fd08c156f90 2024-08-17T02:49:40.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd082000640 1 -- 172.21.15.2:0/3797889023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078012bb0 con 0x7fd08c156f90 2024-08-17T02:49:40.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.964+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c13e530 con 0x7fd08c156f90 2024-08-17T02:49:40.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.965+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c14bac0 con 0x7fd08c156f90 2024-08-17T02:49:40.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.966+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c13ecf0 con 0x7fd08c156f90 2024-08-17T02:49:40.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.966+0000 7fd082000640 1 -- 172.21.15.2:0/3797889023 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd07801a3b0 con 0x7fd08c156f90 2024-08-17T02:49:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.968+0000 7fd082000640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd06c065150 0x7fd06c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.968+0000 7fd082000640 1 -- 172.21.15.2:0/3797889023 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd078082010 con 0x7fd08c156f90 2024-08-17T02:49:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.968+0000 7fd08aa00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd06c065150 0x7fd06c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:40.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.969+0000 7fd08aa00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd06c065150 0x7fd06c067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd07c034000 tx=0x7fd07c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:40.972+0000 7fd082000640 1 -- 172.21.15.2:0/3797889023 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd078050380 con 0x7fd08c156f90 2024-08-17T02:49:41.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.222+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fd08c070720 con 0x7fd08c156f90 2024-08-17T02:49:41.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.370+0000 7fd082000640 1 -- 172.21.15.2:0/3797889023 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v161) v1 ==== 135+0+0 (secure 0 0 0) 0x7fd0780539a0 con 0x7fd08c156f90 2024-08-17T02:49:41.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd06c065150 msgr2=0x7fd06c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:41.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd06c065150 0x7fd06c067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd07c034000 tx=0x7fd07c032000 comp rx=0 tx=0).stop 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd08c156f90 msgr2=0x7fd08c13f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd08c156f90 0x7fd08c13f010 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c590 tx=0x7fd078007d80 comp rx=0 tx=0).stop 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 shutdown_connections 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd08c15a590 0x7fd08c1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd08c156f90 0x7fd08c13f010 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fd06c065150 0x7fd06c067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 --2- 172.21.15.2:0/3797889023 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fd08c0b0e30 0x7fd08c14b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 >> 172.21.15.2:0/3797889023 conn(0x7fd08c062af0 msgr2=0x7fd08c155600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 shutdown_connections 2024-08-17T02:49:41.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:41.372+0000 7fd08be00640 1 -- 172.21.15.2:0/3797889023 wait complete. 2024-08-17T02:49:41.391 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:49:41.391 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:41.391 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:49:41.391 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:49:41.392 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:49:41.393 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:49:41.393 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000943317 --yes-i-really-mean-it' 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:49:41.394 INFO:tasks.cephfs_test_runner:Ran 1 test in 176.451s 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:49:41.395 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000943317 --yes-i-really-mean-it' 2024-08-17T02:49:41.396 INFO:tasks.cephfs_test_runner: 2024-08-17T02:49:41.396 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:49:41.654 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=01d40cdd0a104d5cb04748027afe074e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:49:41.655 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:49:41.664 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:49:41.737 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:49:41.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:41.738 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:49:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:49:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:49:41.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:41.779 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:49:41.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:41.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:49:42.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:42.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-17T02:49:42.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:42.409 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-08-17T02:49:42.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:42.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-08-17T02:49:42.546 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-08-17T02:49:42.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:49:42.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:42.550 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-08-17T02:49:42.589 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:49:42.590 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:49:42.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:42.591 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:49:42.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:42.694 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:49:42.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:42.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-08-17T02:49:43.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:43.278 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-08-17T02:49:43.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:49:43.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-08-17T02:49:43.415 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2024-08-17T02:49:43.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:49:43.418 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:49:43.427 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:49:43.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:43.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.587+0000 7f04b5c00640 1 Processor -- start 2024-08-17T02:49:43.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.587+0000 7f04b5c00640 1 -- start start 2024-08-17T02:49:43.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.588+0000 7f04b5c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04b00ad960 0x7f04b015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.588+0000 7f04b5c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b015b5e0 con 0x7f04b00add30 2024-08-17T02:49:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.588+0000 7f04b5c00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00cb160 con 0x7f04b00ca050 2024-08-17T02:49:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.588+0000 7f04b5c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00b0d10 con 0x7f04b00ad960 2024-08-17T02:49:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.589+0000 7f04aea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04b00ad960 0x7f04b015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.589+0000 7f04aea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04b00ad960 0x7f04b015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47870/0 (socket says 172.21.15.2:47870) 2024-08-17T02:49:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.589+0000 7f04aea00640 1 -- 172.21.15.2:0/3223048370 learned_addr learned my addr 172.21.15.2:0/3223048370 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.589+0000 7f04aea00640 1 -- 172.21.15.2:0/3223048370 >> v1:172.21.15.26:6789/0 conn(0x7f04b00ca050 legacy=0x7f04b0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.589+0000 7f04aea00640 1 -- 172.21.15.2:0/3223048370 >> v1:172.21.15.2:6789/0 conn(0x7f04b00add30 legacy=0x7f04b00aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.589+0000 7f04aea00640 1 -- 172.21.15.2:0/3223048370 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00ca550 con 0x7f04b00ad960 2024-08-17T02:49:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.589+0000 7f04ae000640 1 -- 172.21.15.2:0/3223048370 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122787486 0 0) 0x7f04a8001490 con 0x7f04b00add30 2024-08-17T02:49:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.590+0000 7f04aea00640 1 --2- 172.21.15.2:0/3223048370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ad960 0x7f04b015b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009910 tx=0x7f04a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15bbd439660f2b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.590+0000 7f04ae000640 1 -- 172.21.15.2:0/3223048370 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0032440 con 0x7f04b00ad960 2024-08-17T02:49:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04ae000640 1 -- 172.21.15.2:0/3223048370 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a00325a0 con 0x7f04b00ad960 2024-08-17T02:49:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04ae000640 1 -- 172.21.15.2:0/3223048370 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0032940 con 0x7f04b00ad960 2024-08-17T02:49:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04b5c00640 1 -- 172.21.15.2:0/3223048370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ad960 msgr2=0x7f04b015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04b5c00640 1 --2- 172.21.15.2:0/3223048370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ad960 0x7f04b015b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009910 tx=0x7f04a00091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04b5c00640 1 -- 172.21.15.2:0/3223048370 shutdown_connections 2024-08-17T02:49:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04b5c00640 1 --2- 172.21.15.2:0/3223048370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ad960 0x7f04b015b0a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04b5c00640 1 -- 172.21.15.2:0/3223048370 >> 172.21.15.2:0/3223048370 conn(0x7f04b0066e60 msgr2=0x7f04b0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04b5c00640 1 -- 172.21.15.2:0/3223048370 shutdown_connections 2024-08-17T02:49:43.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.591+0000 7f04b5c00640 1 -- 172.21.15.2:0/3223048370 wait complete. 2024-08-17T02:49:43.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.593+0000 7f04b5c00640 1 Processor -- start 2024-08-17T02:49:43.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.593+0000 7f04b5c00640 1 -- start start 2024-08-17T02:49:43.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04b5c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f04b00ad960 0x7f04b00a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04b5c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04b00add30 0x7f04b00a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04b5c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ca050 0x7f04b0140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04b5c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01517e0 con 0x7f04b00ca050 2024-08-17T02:49:43.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04b5c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0141360 con 0x7f04b00add30 2024-08-17T02:49:43.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04b5c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01415b0 con 0x7f04b00ad960 2024-08-17T02:49:43.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04af400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ca050 0x7f04b0140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04af400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ca050 0x7f04b0140680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47878/0 (socket says 172.21.15.2:47878) 2024-08-17T02:49:43.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04af400640 1 -- 172.21.15.2:0/3715032536 learned_addr learned my addr 172.21.15.2:0/3715032536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:43.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04aea00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f04b00ad960 0x7f04b00a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.594+0000 7f04a7e00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04b00add30 0x7f04b00a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04af400640 1 -- 172.21.15.2:0/3715032536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f04b00ad960 msgr2=0x7f04b00a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04af400640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f04b00ad960 0x7f04b00a80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04af400640 1 -- 172.21.15.2:0/3715032536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04b00add30 msgr2=0x7f04b00a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04af400640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04b00add30 0x7f04b00a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04af400640 1 -- 172.21.15.2:0/3715032536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0009450 con 0x7f04b00ca050 2024-08-17T02:49:43.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04af400640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ca050 0x7f04b0140680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c960 tx=0x7f04a8007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:43.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04a6000640 1 -- 172.21.15.2:0/3715032536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800a850 con 0x7f04b00ca050 2024-08-17T02:49:43.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04a6000640 1 -- 172.21.15.2:0/3715032536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a800a9b0 con 0x7f04b00ca050 2024-08-17T02:49:43.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04a6000640 1 -- 172.21.15.2:0/3715032536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800adb0 con 0x7f04b00ca050 2024-08-17T02:49:43.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b0141890 con 0x7f04b00ca050 2024-08-17T02:49:43.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.595+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b0141ed0 con 0x7f04b00ca050 2024-08-17T02:49:43.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.596+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0063fb0 con 0x7f04b00ca050 2024-08-17T02:49:43.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.597+0000 7f04a6000640 1 -- 172.21.15.2:0/3715032536 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f04a8012630 con 0x7f04b00ca050 2024-08-17T02:49:43.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.598+0000 7f04a6000640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f048c065150 0x7f048c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.598+0000 7f04a6000640 1 -- 172.21.15.2:0/3715032536 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f04a8082380 con 0x7f04b00ca050 2024-08-17T02:49:43.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.598+0000 7f04aea00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f048c065150 0x7f048c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.599+0000 7f04aea00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f048c065150 0x7f048c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f04a0034000 tx=0x7f04a0032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:43.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.602+0000 7f04a6000640 1 -- 172.21.15.2:0/3715032536 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f04a80506f0 con 0x7f04b00ca050 2024-08-17T02:49:43.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.784+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04b015b5e0 con 0x7f04b00ca050 2024-08-17T02:49:43.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.785+0000 7f04a6000640 1 -- 172.21.15.2:0/3715032536 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12293 (secure 0 0 0) 0x7f04b015b5e0 con 0x7f04b00ca050 2024-08-17T02:49:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:43.785 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":44,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:49:40.360857+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6836/1036695601":"2024-08-18T02:49:37.207296+0000","172.21.15.2:6834/1036695601":"2024-08-18T02:49:37.207296+0000","172.21.15.2:6837/1889487336":"2024-08-18T02:49:30.194821+0000","172.21.15.2:6835/1889487336":"2024-08-18T02:49:30.194821+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:43.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f048c065150 msgr2=0x7f048c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f048c065150 0x7f048c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f04a0034000 tx=0x7f04a0032000 comp rx=0 tx=0).stop 2024-08-17T02:49:43.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ca050 msgr2=0x7f04b0140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ca050 0x7f04b0140680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c960 tx=0x7f04a8007ed0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 shutdown_connections 2024-08-17T02:49:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b00ca050 0x7f04b0140680 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f04b00add30 0x7f04b00a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f048c065150 0x7f048c067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 --2- 172.21.15.2:0/3715032536 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f04b00ad960 0x7f04b00a80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 >> 172.21.15.2:0/3715032536 conn(0x7f04b0066e60 msgr2=0x7f04b00ac0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:43.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 shutdown_connections 2024-08-17T02:49:43.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.787+0000 7f04b5c00640 1 -- 172.21.15.2:0/3715032536 wait complete. 2024-08-17T02:49:43.802 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:49:43.802 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:43.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.953+0000 7f8023200640 1 Processor -- start 2024-08-17T02:49:43.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.953+0000 7f8023200640 1 -- start start 2024-08-17T02:49:43.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.954+0000 7f8023200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240ad790 0x7f80240adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.954+0000 7f8023200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240cb180 con 0x7f80240c9d20 2024-08-17T02:49:43.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.954+0000 7f8023200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240af530 con 0x7f80241559e0 2024-08-17T02:49:43.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.954+0000 7f8023200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80240ca8e0 con 0x7f80240ad790 2024-08-17T02:49:43.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.954+0000 7f8019400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f80240c9d20 0x7f80241552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56650/0 (socket says 172.21.15.2:56650) 2024-08-17T02:49:43.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.954+0000 7f8019400640 1 -- 172.21.15.2:0/3706710622 learned_addr learned my addr 172.21.15.2:0/3706710622 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:43.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.954+0000 7f8021e00640 1 --2- 172.21.15.2:0/3706710622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240ad790 0x7f80240adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.955+0000 7f8021400640 1 -- 172.21.15.2:0/3706710622 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637152205 0 0) 0x7f80240cb180 con 0x7f80240c9d20 2024-08-17T02:49:43.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.955+0000 7f8021400640 1 -- 172.21.15.2:0/3706710622 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80080034e0 con 0x7f80240c9d20 2024-08-17T02:49:43.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.955+0000 7f8021400640 1 -- 172.21.15.2:0/3706710622 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502932758 0 0) 0x7f80240af530 con 0x7f80241559e0 2024-08-17T02:49:43.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.955+0000 7f8021400640 1 -- 172.21.15.2:0/3706710622 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80240cb180 con 0x7f80241559e0 2024-08-17T02:49:43.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.955+0000 7f8021e00640 1 -- 172.21.15.2:0/3706710622 >> v1:172.21.15.26:6789/0 conn(0x7f80241559e0 legacy=0x7f80240af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.955+0000 7f8021e00640 1 -- 172.21.15.2:0/3706710622 >> v1:172.21.15.2:6789/0 conn(0x7f80240c9d20 legacy=0x7f80241552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.955+0000 7f8021e00640 1 -- 172.21.15.2:0/3706710622 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240cabc0 con 0x7f80240ad790 2024-08-17T02:49:43.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.956+0000 7f8021e00640 1 --2- 172.21.15.2:0/3706710622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240ad790 0x7f80240adb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8014009880 tx=0x7f80140090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81f04ac505babcc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:43.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.956+0000 7f8021400640 1 -- 172.21.15.2:0/3706710622 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801402ad80 con 0x7f80240ad790 2024-08-17T02:49:43.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.956+0000 7f8021400640 1 -- 172.21.15.2:0/3706710622 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014032440 con 0x7f80240ad790 2024-08-17T02:49:43.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.956+0000 7f8021400640 1 -- 172.21.15.2:0/3706710622 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140327e0 con 0x7f80240ad790 2024-08-17T02:49:43.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.957+0000 7f8023200640 1 -- 172.21.15.2:0/3706710622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240ad790 msgr2=0x7f80240adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.957+0000 7f8023200640 1 --2- 172.21.15.2:0/3706710622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240ad790 0x7f80240adb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8014009880 tx=0x7f80140090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.957+0000 7f8023200640 1 -- 172.21.15.2:0/3706710622 shutdown_connections 2024-08-17T02:49:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.957+0000 7f8023200640 1 --2- 172.21.15.2:0/3706710622 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240ad790 0x7f80240adb60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.957+0000 7f8023200640 1 -- 172.21.15.2:0/3706710622 >> 172.21.15.2:0/3706710622 conn(0x7f8024062af0 msgr2=0x7f8024062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.957+0000 7f8023200640 1 -- 172.21.15.2:0/3706710622 shutdown_connections 2024-08-17T02:49:43.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.957+0000 7f8023200640 1 -- 172.21.15.2:0/3706710622 wait complete. 2024-08-17T02:49:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.958+0000 7f8023200640 1 Processor -- start 2024-08-17T02:49:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.959+0000 7f8023200640 1 -- start start 2024-08-17T02:49:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.959+0000 7f8023200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80240ad790 0x7f80241461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8023200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240c9d20 0x7f802415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8023200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80241559e0 0x7f802415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8023200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802415c9e0 con 0x7f80241559e0 2024-08-17T02:49:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8023200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802415b940 con 0x7f80240ad790 2024-08-17T02:49:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8023200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802415bc20 con 0x7f80240c9d20 2024-08-17T02:49:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8022800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80241559e0 0x7f802415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8022800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80241559e0 0x7f802415d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47890/0 (socket says 172.21.15.2:47890) 2024-08-17T02:49:43.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8022800640 1 -- 172.21.15.2:0/1188086860 learned_addr learned my addr 172.21.15.2:0/1188086860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8019400640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240c9d20 0x7f802415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8021e00640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80240ad790 0x7f80241461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8022800640 1 -- 172.21.15.2:0/1188086860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240c9d20 msgr2=0x7f802415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8022800640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240c9d20 0x7f802415d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8022800640 1 -- 172.21.15.2:0/1188086860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80240ad790 msgr2=0x7f80241461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8022800640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80240ad790 0x7f80241461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.960+0000 7f8022800640 1 -- 172.21.15.2:0/1188086860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014009390 con 0x7f80241559e0 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.961+0000 7f8022800640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80241559e0 0x7f802415d750 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c840 tx=0x7f801c002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:43.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.961+0000 7f801a000640 1 -- 172.21.15.2:0/1188086860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00a640 con 0x7f80241559e0 2024-08-17T02:49:43.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.961+0000 7f801a000640 1 -- 172.21.15.2:0/1188086860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c00a7a0 con 0x7f80241559e0 2024-08-17T02:49:43.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.961+0000 7f801a000640 1 -- 172.21.15.2:0/1188086860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00ab60 con 0x7f80241559e0 2024-08-17T02:49:43.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.961+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802415bf00 con 0x7f80241559e0 2024-08-17T02:49:43.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.961+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802415c4c0 con 0x7f80241559e0 2024-08-17T02:49:43.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.962+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802415c6e0 con 0x7f80241559e0 2024-08-17T02:49:43.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.963+0000 7f801a000640 1 -- 172.21.15.2:0/1188086860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f801c012420 con 0x7f80241559e0 2024-08-17T02:49:43.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.964+0000 7f801a000640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8000065180 0x7f8000067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:43.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.964+0000 7f801a000640 1 -- 172.21.15.2:0/1188086860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f801c0824a0 con 0x7f80241559e0 2024-08-17T02:49:43.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.964+0000 7f8021e00640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8000065180 0x7f8000067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:43.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.965+0000 7f8021e00640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8000065180 0x7f8000067630 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8014034000 tx=0x7f8014032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:43.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:43.968+0000 7f801a000640 1 -- 172.21.15.2:0/1188086860 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f801c0508d0 con 0x7f80241559e0 2024-08-17T02:49:44.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.144+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8024070720 con 0x7f8000065180 2024-08-17T02:49:44.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.147+0000 7f801a000640 1 -- 172.21.15.2:0/1188086860 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50782 (secure 0 0 0) 0x7f8024070720 con 0x7f8000065180 2024-08-17T02:49:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:44.148 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:49:44.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8000065180 msgr2=0x7f8000067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8000065180 0x7f8000067630 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8014034000 tx=0x7f8014032000 comp rx=0 tx=0).stop 2024-08-17T02:49:44.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80241559e0 msgr2=0x7f802415d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80241559e0 0x7f802415d750 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c840 tx=0x7f801c002650 comp rx=0 tx=0).stop 2024-08-17T02:49:44.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 shutdown_connections 2024-08-17T02:49:44.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80241559e0 0x7f802415d750 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8000065180 0x7f8000067630 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f80240c9d20 0x7f802415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 --2- 172.21.15.2:0/1188086860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80240ad790 0x7f80241461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 >> 172.21.15.2:0/1188086860 conn(0x7f8024062af0 msgr2=0x7f802406d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:44.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.149+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 shutdown_connections 2024-08-17T02:49:44.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.150+0000 7f8023200640 1 -- 172.21.15.2:0/1188086860 wait complete. 2024-08-17T02:49:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-17T02:49:43.066453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2417272,"kb_used_data":5132,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752557448,"statfs":{"total":773094113280,"available":770618826752,"internally_reserved":0,"allocated":5255168,"data_stored":2877287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001283"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:49:37.300754+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:49:37.300754+0000","last_peered":"2024-08-17T02:49:37.300754+0000","last_clean":"2024-08-17T02:49:37.300754+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:49:37.300754+0000","last_undegraded":"2024-08-17T02:49:37.300754+0000","last_fullsized":"2024-08-17T02:49:37.300754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1101824,"data_stored":802492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.57799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.03,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.751,"15min":0.747},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.006,"5min":1.286,"15min":1.286},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.71299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":1.972,"15min":1.972},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.68799999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.351,"15min":1.351},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":1.02,"15min":1.02},"last":0.871},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.63700000000000001,"15min":0.66500000000000004},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.82599999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98999999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76700000000000002,"15min":0.80700000000000005},"min":{"1min":0.433,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.61899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622},{"interface":"front","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.50600000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.58099999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.748,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.626,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70699999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63200000000000001,"15min":0.66100000000000003},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.749,"5min":1.05,"15min":1.05},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.105,"15min":1.105},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68000000000000005,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":1.101,"15min":1.101},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.745},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95999999999999996,"5min":1.151,"15min":1.151},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93000000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.54600000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.628,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0549999999999999,"5min":1.359,"15min":1.359},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69599999999999995,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":1.032,"15min":1.032},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.72699999999999998,"15min":0.71099999999999997},"min":{"1min":0.57899999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.02,"5min":1.075,"15min":1.075},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81299999999999994,"5min":1.119,"15min":1.119},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89000000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.286,"15min":1.286},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.57599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89600000000000002,"5min":1.165,"15min":1.165},"last":0.755},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.61699999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94499999999999995,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88100000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69299999999999995,"15min":0.65200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95099999999999996,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.98999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.52500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":6.859,"15min":6.859},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":0.85799999999999998},"min":{"1min":0.67300000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.86499999999999999,"15min":0.86299999999999999},"min":{"1min":0.61599999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95299999999999996,"5min":5.2969999999999997,"15min":5.2969999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84099999999999997,"15min":0.87},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96399999999999997,"5min":3.7149999999999999,"15min":3.7149999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91300000000000003,"5min":8.2899999999999991,"15min":8.2899999999999991},"last":0.88900000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":6.0640000000000001,"15min":6.0640000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.745}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":1.016},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.874,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":1.0349999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91900000000000004,"5min":2.484,"15min":2.484},"last":1.054},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.876,"15min":0.82299999999999995},"min":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":12.157999999999999,"15min":12.157999999999999},"last":1.0629999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302016,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.622,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.58299999999999996,"15min":0.624},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70699999999999996,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.64700000000000002,"15min":0.73099999999999998},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.59499999999999997,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.65300000000000002},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.75600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85699999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85099999999999998,"15min":0.90500000000000003},"min":{"1min":0.57799999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0649999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.52300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93100000000000005,"15min":0.998},"min":{"1min":0.65700000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":4.0940000000000003,"15min":4.0940000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.89300000000000002,"15min":0.94599999999999995},"min":{"1min":0.60399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.03,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.88100000000000001,"15min":0.92600000000000005},"min":{"1min":0.63500000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94099999999999995,"5min":1.992,"15min":1.992},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88600000000000001,"15min":0.92700000000000005},"min":{"1min":0.624,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.206,"5min":2.056,"15min":2.056},"last":0.79100000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.95599999999999996},"min":{"1min":0.64500000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.153,"5min":2.113,"15min":2.113},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.92800000000000005,"15min":0.98599999999999999},"min":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.121,"5min":2.98,"15min":2.98},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.58799999999999997,"15min":0.66000000000000003},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":6.0810000000000004,"15min":6.0810000000000004},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.63700000000000001,"15min":0.69699999999999995},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76400000000000001,"15min":0.82999999999999996},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.495}]},{"osd":4,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.91000000000000003,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93300000000000005,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.877},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98399999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.755}]},{"osd":5,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0580000000000001,"5min":1.845,"15min":1.845},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.93999999999999995,"15min":1.018},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.97399999999999998,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97599999999999998,"5min":6.3899999999999997,"15min":6.3899999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.93400000000000005,"15min":1},"min":{"1min":0.61199999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98499999999999999,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98799999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.96299999999999997,"15min":1.0389999999999999},"min":{"1min":0.57899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.008,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":0.89900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.47399999999999998,"15min":0.496},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.56999999999999995,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64700000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.751,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73499999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.66800000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.55000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0820000000000001,"5min":3.673,"15min":3.673},"last":0.628},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.034,"5min":2.492,"15min":2.492},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.98499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.878},"min":{"1min":0.57999999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95699999999999996,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.627,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.111,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.014,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.76400000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.61399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302580,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069260,"statfs":{"total":96636764160,"available":96326922240,"internally_reserved":0,"allocated":1089536,"data_stored":796403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.318,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58799999999999997,"5min":1.403,"15min":1.403},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.376,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72999999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64900000000000002,"5min":1.466,"15min":1.466},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78400000000000003,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.308},{"interface":"front","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.59299999999999997},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78100000000000003,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.026,"5min":3.294,"15min":3.294},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.64200000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.63400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0269999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.79600000000000004},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97499999999999998,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.78800000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.038,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.69999999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95199999999999996,"5min":2.871,"15min":2.871},"last":0.72399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.83299999999999996},"min":{"1min":0.66600000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.63500000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":3.347,"15min":3.347},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:44.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:44.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.318+0000 7fa525600640 1 Processor -- start 2024-08-17T02:49:44.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.318+0000 7fa525600640 1 -- start start 2024-08-17T02:49:44.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa525600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa5200b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa525600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5200b25c0 0x7fa520066e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa525600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5200a9620 con 0x7fa520158ee0 2024-08-17T02:49:44.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa525600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5200aa420 con 0x7fa5200b25c0 2024-08-17T02:49:44.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa525600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200a9850 con 0x7fa520158b10 2024-08-17T02:49:44.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa524c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa520158ee0 0x7fa5200aa8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56664/0 (socket says 172.21.15.2:56664) 2024-08-17T02:49:44.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa524c00640 1 -- 172.21.15.2:0/835421440 learned_addr learned my addr 172.21.15.2:0/835421440 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:44.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa51f400640 1 --2- 172.21.15.2:0/835421440 >> v2:172.21.15.26:3300/0 conn(0x7fa5200b25c0 0x7fa520066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.319+0000 7fa51fe00640 1 --2- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa5200b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.320+0000 7fa51ea00640 1 -- 172.21.15.2:0/835421440 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797597473 0 0) 0x7fa5200a9620 con 0x7fa520158ee0 2024-08-17T02:49:44.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.320+0000 7fa51ea00640 1 -- 172.21.15.2:0/835421440 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5040034e0 con 0x7fa520158ee0 2024-08-17T02:49:44.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.320+0000 7fa51f400640 1 -- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 msgr2=0x7fa5200b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:44.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.320+0000 7fa51f400640 1 --2- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa5200b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.320+0000 7fa51f400640 1 -- 172.21.15.2:0/835421440 >> v1:172.21.15.2:6789/0 conn(0x7fa520158ee0 legacy=0x7fa5200aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.320+0000 7fa51f400640 1 -- 172.21.15.2:0/835421440 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520067c40 con 0x7fa5200b25c0 2024-08-17T02:49:44.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.320+0000 7fa51fe00640 1 --2- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa5200b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:49:44.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.321+0000 7fa51f400640 1 --2- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 0x7fa520066e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009880 tx=0x7fa50c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ef2d208b3abb300 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:44.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.321+0000 7fa51ea00640 1 -- 172.21.15.2:0/835421440 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c02ace0 con 0x7fa5200b25c0 2024-08-17T02:49:44.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa51ea00640 1 -- 172.21.15.2:0/835421440 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c02ae40 con 0x7fa5200b25c0 2024-08-17T02:49:44.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa51ea00640 1 -- 172.21.15.2:0/835421440 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c032670 con 0x7fa5200b25c0 2024-08-17T02:49:44.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa525600640 1 -- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 msgr2=0x7fa520066e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa525600640 1 --2- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 0x7fa520066e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009880 tx=0x7fa50c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa525600640 1 -- 172.21.15.2:0/835421440 shutdown_connections 2024-08-17T02:49:44.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa525600640 1 --2- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 0x7fa520066e60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa525600640 1 --2- 172.21.15.2:0/835421440 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa5200b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa525600640 1 -- 172.21.15.2:0/835421440 >> 172.21.15.2:0/835421440 conn(0x7fa520095a70 msgr2=0x7fa520095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:44.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa525600640 1 -- 172.21.15.2:0/835421440 shutdown_connections 2024-08-17T02:49:44.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.322+0000 7fa525600640 1 -- 172.21.15.2:0/835421440 wait complete. 2024-08-17T02:49:44.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.323+0000 7fa525600640 1 Processor -- start 2024-08-17T02:49:44.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.324+0000 7fa525600640 1 -- start start 2024-08-17T02:49:44.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.324+0000 7fa525600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 0x7fa5201462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.324+0000 7fa525600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa520099160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.324+0000 7fa525600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa520158ee0 0x7fa5200996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.324+0000 7fa525600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52016acf0 con 0x7fa520158ee0 2024-08-17T02:49:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.324+0000 7fa525600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52016a120 con 0x7fa5200b25c0 2024-08-17T02:49:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.324+0000 7fa525600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52016a3c0 con 0x7fa520158b10 2024-08-17T02:49:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa520158ee0 0x7fa5200996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa520158ee0 0x7fa5200996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47898/0 (socket says 172.21.15.2:47898) 2024-08-17T02:49:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 -- 172.21.15.2:0/1731315681 learned_addr learned my addr 172.21.15.2:0/1731315681 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:44.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa51fe00640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 0x7fa5201462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa51f400640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa520099160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 -- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 msgr2=0x7fa520099160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa520099160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 -- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 msgr2=0x7fa5201462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 0x7fa5201462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 -- 172.21.15.2:0/1731315681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510009390 con 0x7fa520158ee0 2024-08-17T02:49:44.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa51f400640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa520099160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:44.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.325+0000 7fa524c00640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa520158ee0 0x7fa5200996a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa518001460 tx=0x7fa518001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:44.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.326+0000 7fa517400640 1 -- 172.21.15.2:0/1731315681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51800ce90 con 0x7fa520158ee0 2024-08-17T02:49:44.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.326+0000 7fa517400640 1 -- 172.21.15.2:0/1731315681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51800a850 con 0x7fa520158ee0 2024-08-17T02:49:44.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.326+0000 7fa517400640 1 -- 172.21.15.2:0/1731315681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51800ac50 con 0x7fa520158ee0 2024-08-17T02:49:44.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.326+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c009390 con 0x7fa520158ee0 2024-08-17T02:49:44.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.326+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52016a980 con 0x7fa520158ee0 2024-08-17T02:49:44.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.327+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa520070720 con 0x7fa520158ee0 2024-08-17T02:49:44.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.328+0000 7fa517400640 1 -- 172.21.15.2:0/1731315681 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa518007300 con 0x7fa520158ee0 2024-08-17T02:49:44.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.328+0000 7fa517400640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa500065150 0x7fa500067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.329+0000 7fa517400640 1 -- 172.21.15.2:0/1731315681 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa518082280 con 0x7fa520158ee0 2024-08-17T02:49:44.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.329+0000 7fa51fe00640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa500065150 0x7fa500067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.329+0000 7fa51fe00640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa500065150 0x7fa500067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa510009eb0 tx=0x7fa5100090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:44.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.333+0000 7fa517400640 1 -- 172.21.15.2:0/1731315681 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa518050720 con 0x7fa520158ee0 2024-08-17T02:49:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.509+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa520157cb0 con 0x7fa500065150 2024-08-17T02:49:44.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.511+0000 7fa517400640 1 -- 172.21.15.2:0/1731315681 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50782 (secure 0 0 0) 0x7fa520157cb0 con 0x7fa500065150 2024-08-17T02:49:44.512 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:49:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa500065150 msgr2=0x7fa500067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa500065150 0x7fa500067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa510009eb0 tx=0x7fa5100090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa520158ee0 msgr2=0x7fa5200996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa520158ee0 0x7fa5200996a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa518001460 tx=0x7fa518001ae0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 shutdown_connections 2024-08-17T02:49:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa520158ee0 0x7fa5200996a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fa500065150 0x7fa500067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fa520158b10 0x7fa520099160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 --2- 172.21.15.2:0/1731315681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5200b25c0 0x7fa5201462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 >> 172.21.15.2:0/1731315681 conn(0x7fa520095a70 msgr2=0x7fa5200b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 shutdown_connections 2024-08-17T02:49:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.514+0000 7fa525600640 1 -- 172.21.15.2:0/1731315681 wait complete. 2024-08-17T02:49:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-17T02:49:43.066453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2417272,"kb_used_data":5132,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752557448,"statfs":{"total":773094113280,"available":770618826752,"internally_reserved":0,"allocated":5255168,"data_stored":2877287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001283"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:49:37.300754+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:49:37.300754+0000","last_peered":"2024-08-17T02:49:37.300754+0000","last_clean":"2024-08-17T02:49:37.300754+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:49:37.300754+0000","last_undegraded":"2024-08-17T02:49:37.300754+0000","last_fullsized":"2024-08-17T02:49:37.300754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1101824,"data_stored":802492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.57799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.03,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.751,"15min":0.747},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.006,"5min":1.286,"15min":1.286},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.71299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":1.972,"15min":1.972},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.68799999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.351,"15min":1.351},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":1.02,"15min":1.02},"last":0.871},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.63700000000000001,"15min":0.66500000000000004},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.82599999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98999999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76700000000000002,"15min":0.80700000000000005},"min":{"1min":0.433,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.61899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622},{"interface":"front","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.50600000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.58099999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.748,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.626,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70699999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63200000000000001,"15min":0.66100000000000003},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.749,"5min":1.05,"15min":1.05},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.105,"15min":1.105},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68000000000000005,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":1.101,"15min":1.101},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.745},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95999999999999996,"5min":1.151,"15min":1.151},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93000000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.54600000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.628,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0549999999999999,"5min":1.359,"15min":1.359},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69599999999999995,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":1.032,"15min":1.032},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.72699999999999998,"15min":0.71099999999999997},"min":{"1min":0.57899999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.02,"5min":1.075,"15min":1.075},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81299999999999994,"5min":1.119,"15min":1.119},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89000000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.286,"15min":1.286},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.57599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89600000000000002,"5min":1.165,"15min":1.165},"last":0.755},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.61699999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94499999999999995,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88100000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69299999999999995,"15min":0.65200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95099999999999996,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.98999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.52500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":6.859,"15min":6.859},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":0.85799999999999998},"min":{"1min":0.67300000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.86499999999999999,"15min":0.86299999999999999},"min":{"1min":0.61599999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95299999999999996,"5min":5.2969999999999997,"15min":5.2969999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84099999999999997,"15min":0.87},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96399999999999997,"5min":3.7149999999999999,"15min":3.7149999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91300000000000003,"5min":8.2899999999999991,"15min":8.2899999999999991},"last":0.88900000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":6.0640000000000001,"15min":6.0640000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.745}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":1.016},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.874,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":1.0349999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91900000000000004,"5min":2.484,"15min":2.484},"last":1.054},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.876,"15min":0.82299999999999995},"min":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":12.157999999999999,"15min":12.157999999999999},"last":1.0629999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302016,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.622,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.58299999999999996,"15min":0.624},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70699999999999996,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.64700000000000002,"15min":0.73099999999999998},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.59499999999999997,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.65300000000000002},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.75600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85699999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85099999999999998,"15min":0.90500000000000003},"min":{"1min":0.57799999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0649999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.52300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93100000000000005,"15min":0.998},"min":{"1min":0.65700000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":4.0940000000000003,"15min":4.0940000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.89300000000000002,"15min":0.94599999999999995},"min":{"1min":0.60399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.03,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.88100000000000001,"15min":0.92600000000000005},"min":{"1min":0.63500000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94099999999999995,"5min":1.992,"15min":1.992},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88600000000000001,"15min":0.92700000000000005},"min":{"1min":0.624,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.206,"5min":2.056,"15min":2.056},"last":0.79100000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.95599999999999996},"min":{"1min":0.64500000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.153,"5min":2.113,"15min":2.113},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.92800000000000005,"15min":0.98599999999999999},"min":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.121,"5min":2.98,"15min":2.98},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.58799999999999997,"15min":0.66000000000000003},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":6.0810000000000004,"15min":6.0810000000000004},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.63700000000000001,"15min":0.69699999999999995},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76400000000000001,"15min":0.82999999999999996},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.495}]},{"osd":4,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.91000000000000003,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93300000000000005,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.877},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98399999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.755}]},{"osd":5,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0580000000000001,"5min":1.845,"15min":1.845},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.93999999999999995,"15min":1.018},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.97399999999999998,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97599999999999998,"5min":6.3899999999999997,"15min":6.3899999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.93400000000000005,"15min":1},"min":{"1min":0.61199999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98499999999999999,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98799999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.96299999999999997,"15min":1.0389999999999999},"min":{"1min":0.57899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.008,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":0.89900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.47399999999999998,"15min":0.496},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.56999999999999995,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64700000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.751,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73499999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.66800000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.55000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0820000000000001,"5min":3.673,"15min":3.673},"last":0.628},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.034,"5min":2.492,"15min":2.492},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.98499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.878},"min":{"1min":0.57999999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95699999999999996,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.627,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.111,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.014,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.76400000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.61399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302580,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069260,"statfs":{"total":96636764160,"available":96326922240,"internally_reserved":0,"allocated":1089536,"data_stored":796403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.318,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58799999999999997,"5min":1.403,"15min":1.403},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.376,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72999999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64900000000000002,"5min":1.466,"15min":1.466},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78400000000000003,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.308},{"interface":"front","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.59299999999999997},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78100000000000003,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.026,"5min":3.294,"15min":3.294},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.64200000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.63400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0269999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.79600000000000004},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97499999999999998,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.78800000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.038,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.69999999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95199999999999996,"5min":2.871,"15min":2.871},"last":0.72399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.83299999999999996},"min":{"1min":0.66600000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.63500000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":3.347,"15min":3.347},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:44.531 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:49:44.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.682+0000 7f9146a00640 1 Processor -- start 2024-08-17T02:49:44.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.682+0000 7f9146a00640 1 -- start start 2024-08-17T02:49:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f9146a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91400ad960 0x7f914015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f9146a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400add30 0x7f9140156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f9146a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914015b5e0 con 0x7f91400ca050 2024-08-17T02:49:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f9146a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400cb160 con 0x7f91400ad960 2024-08-17T02:49:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f9146a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91400b0d10 con 0x7f91400add30 2024-08-17T02:49:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f913f400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f91400ca050 0x7f9140156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56680/0 (socket says 172.21.15.2:56680) 2024-08-17T02:49:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f913f400640 1 -- 172.21.15.2:0/2343869864 learned_addr learned my addr 172.21.15.2:0/2343869864 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f913fe00640 1 --2- 172.21.15.2:0/2343869864 >> v2:172.21.15.26:3300/0 conn(0x7f91400ad960 0x7f914015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.684+0000 7f9144a00640 1 --2- 172.21.15.2:0/2343869864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400add30 0x7f9140156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.685+0000 7f913ea00640 1 -- 172.21.15.2:0/2343869864 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858219342 0 0) 0x7f912c001110 con 0x7f91400ca050 2024-08-17T02:49:44.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.685+0000 7f913ea00640 1 -- 172.21.15.2:0/2343869864 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91240034e0 con 0x7f91400ca050 2024-08-17T02:49:44.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.685+0000 7f913fe00640 1 -- 172.21.15.2:0/2343869864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400add30 msgr2=0x7f9140156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:44.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.685+0000 7f913fe00640 1 --2- 172.21.15.2:0/2343869864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400add30 0x7f9140156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.685+0000 7f913fe00640 1 -- 172.21.15.2:0/2343869864 >> v1:172.21.15.2:6789/0 conn(0x7f91400ca050 legacy=0x7f9140156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.685+0000 7f913fe00640 1 -- 172.21.15.2:0/2343869864 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400ca550 con 0x7f91400ad960 2024-08-17T02:49:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.686+0000 7f913fe00640 1 --2- 172.21.15.2:0/2343869864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400ad960 0x7f914015b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9130009850 tx=0x7f91300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c492df267aa88ec1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.686+0000 7f913ea00640 1 -- 172.21.15.2:0/2343869864 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913002ae20 con 0x7f91400ad960 2024-08-17T02:49:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.686+0000 7f913ea00640 1 -- 172.21.15.2:0/2343869864 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130032440 con 0x7f91400ad960 2024-08-17T02:49:44.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.686+0000 7f913ea00640 1 -- 172.21.15.2:0/2343869864 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130032800 con 0x7f91400ad960 2024-08-17T02:49:44.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.687+0000 7f9146a00640 1 -- 172.21.15.2:0/2343869864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400ad960 msgr2=0x7f914015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.687+0000 7f9146a00640 1 --2- 172.21.15.2:0/2343869864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400ad960 0x7f914015b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9130009850 tx=0x7f91300090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.687+0000 7f9146a00640 1 -- 172.21.15.2:0/2343869864 shutdown_connections 2024-08-17T02:49:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.687+0000 7f9146a00640 1 --2- 172.21.15.2:0/2343869864 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400add30 0x7f9140156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.687+0000 7f9146a00640 1 --2- 172.21.15.2:0/2343869864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400ad960 0x7f914015b0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.687+0000 7f9146a00640 1 -- 172.21.15.2:0/2343869864 >> 172.21.15.2:0/2343869864 conn(0x7f9140066e60 msgr2=0x7f9140067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.687+0000 7f9146a00640 1 -- 172.21.15.2:0/2343869864 shutdown_connections 2024-08-17T02:49:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.687+0000 7f9146a00640 1 -- 172.21.15.2:0/2343869864 wait complete. 2024-08-17T02:49:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.688+0000 7f9146a00640 1 Processor -- start 2024-08-17T02:49:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.688+0000 7f9146a00640 1 -- start start 2024-08-17T02:49:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.689+0000 7f9146a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91400ad960 0x7f9140069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.689+0000 7f9146a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400add30 0x7f914016d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.689+0000 7f9146a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400ca050 0x7f914006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.689+0000 7f9146a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91400ac310 con 0x7f91400ad960 2024-08-17T02:49:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.689+0000 7f9146a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9140069ec0 con 0x7f91400add30 2024-08-17T02:49:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.689+0000 7f9146a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914006a1a0 con 0x7f91400ca050 2024-08-17T02:49:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91400ad960 0x7f9140069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91400ad960 0x7f9140069830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47906/0 (socket says 172.21.15.2:47906) 2024-08-17T02:49:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 -- 172.21.15.2:0/3647748094 learned_addr learned my addr 172.21.15.2:0/3647748094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913f400640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400add30 0x7f914016d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f9144a00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400ca050 0x7f914006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 -- 172.21.15.2:0/3647748094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400ca050 msgr2=0x7f914006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400ca050 0x7f914006afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 -- 172.21.15.2:0/3647748094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400add30 msgr2=0x7f914016d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400add30 0x7f914016d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 -- 172.21.15.2:0/3647748094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9130009390 con 0x7f91400ad960 2024-08-17T02:49:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.690+0000 7f913fe00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91400ad960 0x7f9140069830 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9130009360 tx=0x7f9130032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.691+0000 7f9137400640 1 -- 172.21.15.2:0/3647748094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130031c80 con 0x7f91400ad960 2024-08-17T02:49:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.691+0000 7f9137400640 1 -- 172.21.15.2:0/3647748094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130031de0 con 0x7f91400ad960 2024-08-17T02:49:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.691+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914006a480 con 0x7f91400ad960 2024-08-17T02:49:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.691+0000 7f9137400640 1 -- 172.21.15.2:0/3647748094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913003d650 con 0x7f91400ad960 2024-08-17T02:49:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.691+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914006b500 con 0x7f91400ad960 2024-08-17T02:49:44.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.692+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914006b6f0 con 0x7f91400ad960 2024-08-17T02:49:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.692+0000 7f9137400640 1 -- 172.21.15.2:0/3647748094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9130039040 con 0x7f91400ad960 2024-08-17T02:49:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.693+0000 7f9137400640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9120065150 0x7f9120067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.693+0000 7f9137400640 1 -- 172.21.15.2:0/3647748094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f91300a20d0 con 0x7f91400ad960 2024-08-17T02:49:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.694+0000 7f913f400640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9120065150 0x7f9120067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.694+0000 7f913f400640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9120065150 0x7f9120067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9140148e90 tx=0x7f912c007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.697+0000 7f9137400640 1 -- 172.21.15.2:0/3647748094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9130070440 con 0x7f91400ad960 2024-08-17T02:49:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.877+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9140063fb0 con 0x7f9120065150 2024-08-17T02:49:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.879+0000 7f9137400640 1 -- 172.21.15.2:0/3647748094 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50782 (secure 0 0 0) 0x7f9140063fb0 con 0x7f9120065150 2024-08-17T02:49:44.879 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:49:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9120065150 msgr2=0x7f9120067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9120065150 0x7f9120067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9140148e90 tx=0x7f912c007b60 comp rx=0 tx=0).stop 2024-08-17T02:49:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91400ad960 msgr2=0x7f9140069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91400ad960 0x7f9140069830 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9130009360 tx=0x7f9130032000 comp rx=0 tx=0).stop 2024-08-17T02:49:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 shutdown_connections 2024-08-17T02:49:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9120065150 0x7f9120067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f91400ca050 0x7f914006afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91400add30 0x7f914016d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.881+0000 7f9146a00640 1 --2- 172.21.15.2:0/3647748094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91400ad960 0x7f9140069830 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.882+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 >> 172.21.15.2:0/3647748094 conn(0x7f9140066e60 msgr2=0x7f914014a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.882+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 shutdown_connections 2024-08-17T02:49:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:44.882+0000 7f9146a00640 1 -- 172.21.15.2:0/3647748094 wait complete. 2024-08-17T02:49:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-17T02:49:43.066453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2417272,"kb_used_data":5132,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752557448,"statfs":{"total":773094113280,"available":770618826752,"internally_reserved":0,"allocated":5255168,"data_stored":2877287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001283"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:49:37.300754+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:49:37.300754+0000","last_peered":"2024-08-17T02:49:37.300754+0000","last_clean":"2024-08-17T02:49:37.300754+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:49:37.300754+0000","last_undegraded":"2024-08-17T02:49:37.300754+0000","last_fullsized":"2024-08-17T02:49:37.300754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:54:47.825977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1101824,"data_stored":802492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.57799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.03,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.751,"15min":0.747},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.006,"5min":1.286,"15min":1.286},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.71299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":1.972,"15min":1.972},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.68799999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.351,"15min":1.351},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":1.02,"15min":1.02},"last":0.871},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.63700000000000001,"15min":0.66500000000000004},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.82599999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98999999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76700000000000002,"15min":0.80700000000000005},"min":{"1min":0.433,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.61899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.622},{"interface":"front","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.50600000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.58099999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.748,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.626,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70699999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63200000000000001,"15min":0.66100000000000003},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.749,"5min":1.05,"15min":1.05},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.105,"15min":1.105},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68000000000000005,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":1.101,"15min":1.101},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.745},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95999999999999996,"5min":1.151,"15min":1.151},"last":0.53700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93000000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.54600000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.628,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0549999999999999,"5min":1.359,"15min":1.359},"last":0.45400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69599999999999995,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":1.032,"15min":1.032},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.72699999999999998,"15min":0.71099999999999997},"min":{"1min":0.57899999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.02,"5min":1.075,"15min":1.075},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81299999999999994,"5min":1.119,"15min":1.119},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89000000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.286,"15min":1.286},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.57599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89600000000000002,"5min":1.165,"15min":1.165},"last":0.755},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.61699999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94499999999999995,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88100000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69299999999999995,"15min":0.65200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95099999999999996,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.98999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.52500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":6.859,"15min":6.859},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":0.85799999999999998},"min":{"1min":0.67300000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.86499999999999999,"15min":0.86299999999999999},"min":{"1min":0.61599999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95299999999999996,"5min":5.2969999999999997,"15min":5.2969999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84099999999999997,"15min":0.87},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96399999999999997,"5min":3.7149999999999999,"15min":3.7149999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91300000000000003,"5min":8.2899999999999991,"15min":8.2899999999999991},"last":0.88900000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":6.0640000000000001,"15min":6.0640000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.745}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":1.016},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.874,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":1.0349999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91900000000000004,"5min":2.484,"15min":2.484},"last":1.054},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.876,"15min":0.82299999999999995},"min":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":12.157999999999999,"15min":12.157999999999999},"last":1.0629999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302016,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.622,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.58299999999999996,"15min":0.624},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70699999999999996,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.64700000000000002,"15min":0.73099999999999998},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.59499999999999997,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.65300000000000002},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.75600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85699999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85099999999999998,"15min":0.90500000000000003},"min":{"1min":0.57799999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0649999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.52300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93100000000000005,"15min":0.998},"min":{"1min":0.65700000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":4.0940000000000003,"15min":4.0940000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.89300000000000002,"15min":0.94599999999999995},"min":{"1min":0.60399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.03,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.88100000000000001,"15min":0.92600000000000005},"min":{"1min":0.63500000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94099999999999995,"5min":1.992,"15min":1.992},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88600000000000001,"15min":0.92700000000000005},"min":{"1min":0.624,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.206,"5min":2.056,"15min":2.056},"last":0.79100000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.95599999999999996},"min":{"1min":0.64500000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.153,"5min":2.113,"15min":2.113},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.92800000000000005,"15min":0.98599999999999999},"min":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.121,"5min":2.98,"15min":2.98},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302012,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069828,"statfs":{"total":96636764160,"available":96327503872,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.58799999999999997,"15min":0.66000000000000003},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":6.0810000000000004,"15min":6.0810000000000004},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.63700000000000001,"15min":0.69699999999999995},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76400000000000001,"15min":0.82999999999999996},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.495}]},{"osd":4,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.91000000000000003,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93300000000000005,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.877},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98399999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.755}]},{"osd":5,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0580000000000001,"5min":1.845,"15min":1.845},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.93999999999999995,"15min":1.018},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.97399999999999998,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97599999999999998,"5min":6.3899999999999997,"15min":6.3899999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.93400000000000005,"15min":1},"min":{"1min":0.61199999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98499999999999999,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98799999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.96299999999999997,"15min":1.0389999999999999},"min":{"1min":0.57899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.008,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":0.89900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":507904,"data_stored":212124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.47399999999999998,"15min":0.496},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.56999999999999995,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64700000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.751,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73499999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.66800000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.55000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0820000000000001,"5min":3.673,"15min":3.673},"last":0.628},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.034,"5min":2.492,"15min":2.492},"last":0.68899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.98499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.878},"min":{"1min":0.57999999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95699999999999996,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.70499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.627,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.111,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.014,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.76400000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.61399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302580,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069260,"statfs":{"total":96636764160,"available":96326922240,"internally_reserved":0,"allocated":1089536,"data_stored":796403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.318,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58799999999999997,"5min":1.403,"15min":1.403},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.376,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72999999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.39800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64900000000000002,"5min":1.466,"15min":1.466},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78400000000000003,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.308},{"interface":"front","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.59299999999999997},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78100000000000003,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.026,"5min":3.294,"15min":3.294},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.64200000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.63400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0269999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.79600000000000004},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97499999999999998,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.78800000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.038,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.69999999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95199999999999996,"5min":2.871,"15min":2.871},"last":0.72399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.83299999999999996},"min":{"1min":0.66600000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.63500000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":3.347,"15min":3.347},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:44.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:49:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.051+0000 7fad1b000640 1 Processor -- start 2024-08-17T02:49:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.051+0000 7fad1b000640 1 -- start start 2024-08-17T02:49:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.053+0000 7fad1b000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad140acf10 0x7fad140b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.053+0000 7fad1b000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad140c92b0 con 0x7fad141590b0 2024-08-17T02:49:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.053+0000 7fad1b000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad140ad480 con 0x7fad140afca0 2024-08-17T02:49:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.053+0000 7fad1b000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad140b0980 con 0x7fad140acf10 2024-08-17T02:49:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.053+0000 7fad0be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fad141590b0 0x7fad140c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56686/0 (socket says 172.21.15.2:56686) 2024-08-17T02:49:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.053+0000 7fad0be00640 1 -- 172.21.15.2:0/378608472 learned_addr learned my addr 172.21.15.2:0/378608472 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.053+0000 7fad19000640 1 --2- 172.21.15.2:0/378608472 >> v2:172.21.15.2:3300/0 conn(0x7fad140acf10 0x7fad140b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.054+0000 7fad19000640 1 -- 172.21.15.2:0/378608472 >> v1:172.21.15.26:6789/0 conn(0x7fad140afca0 legacy=0x7fad141589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:45.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.054+0000 7fad19000640 1 -- 172.21.15.2:0/378608472 >> v1:172.21.15.2:6789/0 conn(0x7fad141590b0 legacy=0x7fad140c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.054+0000 7fad19000640 1 -- 172.21.15.2:0/378608472 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140ad760 con 0x7fad140acf10 2024-08-17T02:49:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.054+0000 7fad13400640 1 -- 172.21.15.2:0/378608472 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801626565 0 0) 0x7fad140c92b0 con 0x7fad141590b0 2024-08-17T02:49:45.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.055+0000 7fad19000640 1 --2- 172.21.15.2:0/378608472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad140acf10 0x7fad140b0070 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009e60 tx=0x7fad0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a3073abbd66ce8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.055+0000 7fad13400640 1 -- 172.21.15.2:0/378608472 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c007550 con 0x7fad140acf10 2024-08-17T02:49:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.055+0000 7fad13400640 1 -- 172.21.15.2:0/378608472 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c02d050 con 0x7fad140acf10 2024-08-17T02:49:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.055+0000 7fad13400640 1 -- 172.21.15.2:0/378608472 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c007900 con 0x7fad140acf10 2024-08-17T02:49:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.056+0000 7fad1b000640 1 -- 172.21.15.2:0/378608472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad140acf10 msgr2=0x7fad140b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.056+0000 7fad1b000640 1 --2- 172.21.15.2:0/378608472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad140acf10 0x7fad140b0070 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009e60 tx=0x7fad0c009780 comp rx=0 tx=0).stop 2024-08-17T02:49:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.056+0000 7fad1b000640 1 -- 172.21.15.2:0/378608472 shutdown_connections 2024-08-17T02:49:45.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.056+0000 7fad1b000640 1 --2- 172.21.15.2:0/378608472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad140acf10 0x7fad140b0070 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:45.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.056+0000 7fad1b000640 1 -- 172.21.15.2:0/378608472 >> 172.21.15.2:0/378608472 conn(0x7fad14066e60 msgr2=0x7fad14067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:45.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.056+0000 7fad1b000640 1 -- 172.21.15.2:0/378608472 shutdown_connections 2024-08-17T02:49:45.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.056+0000 7fad1b000640 1 -- 172.21.15.2:0/378608472 wait complete. 2024-08-17T02:49:45.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.057+0000 7fad1b000640 1 Processor -- start 2024-08-17T02:49:45.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.057+0000 7fad1b000640 1 -- start start 2024-08-17T02:49:45.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.058+0000 7fad1b000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad140acf10 0x7fad1415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:45.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.058+0000 7fad1b000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad140afca0 0x7fad1415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.058+0000 7fad1b000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad141590b0 0x7fad140ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.058+0000 7fad1b000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14159520 con 0x7fad141590b0 2024-08-17T02:49:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.058+0000 7fad1b000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad14159dc0 con 0x7fad140afca0 2024-08-17T02:49:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.058+0000 7fad1b000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1416d060 con 0x7fad140acf10 2024-08-17T02:49:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.058+0000 7fad19000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad141590b0 0x7fad140ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad19000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad141590b0 0x7fad140ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47934/0 (socket says 172.21.15.2:47934) 2024-08-17T02:49:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad19000640 1 -- 172.21.15.2:0/4113023892 learned_addr learned my addr 172.21.15.2:0/4113023892 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad0be00640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad140afca0 0x7fad1415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad13e00640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad140acf10 0x7fad1415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad19000640 1 -- 172.21.15.2:0/4113023892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad140acf10 msgr2=0x7fad1415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad19000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad140acf10 0x7fad1415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad19000640 1 -- 172.21.15.2:0/4113023892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad140afca0 msgr2=0x7fad1415ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad19000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad140afca0 0x7fad1415ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad19000640 1 -- 172.21.15.2:0/4113023892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c009a20 con 0x7fad141590b0 2024-08-17T02:49:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.059+0000 7fad19000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad141590b0 0x7fad140ae9f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0099f0 tx=0x7fad0c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.060+0000 7fad0b400640 1 -- 172.21.15.2:0/4113023892 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c031ce0 con 0x7fad141590b0 2024-08-17T02:49:45.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.060+0000 7fad0b400640 1 -- 172.21.15.2:0/4113023892 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c031e40 con 0x7fad141590b0 2024-08-17T02:49:45.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.060+0000 7fad0b400640 1 -- 172.21.15.2:0/4113023892 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c03d640 con 0x7fad141590b0 2024-08-17T02:49:45.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.060+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad14159770 con 0x7fad141590b0 2024-08-17T02:49:45.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.060+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1415b1d0 con 0x7fad141590b0 2024-08-17T02:49:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.061+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad14159f70 con 0x7fad141590b0 2024-08-17T02:49:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.062+0000 7fad0b400640 1 -- 172.21.15.2:0/4113023892 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fad0c003040 con 0x7fad141590b0 2024-08-17T02:49:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.062+0000 7fad0b400640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7facf0065150 0x7facf0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.063+0000 7fad0b400640 1 -- 172.21.15.2:0/4113023892 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fad0c0a3ff0 con 0x7fad141590b0 2024-08-17T02:49:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.063+0000 7fad13e00640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7facf0065150 0x7facf0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.063+0000 7fad13e00640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7facf0065150 0x7facf0067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fad14146810 tx=0x7fad04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:45.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.067+0000 7fad0b400640 1 -- 172.21.15.2:0/4113023892 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fad14159f70 con 0x7fad141590b0 2024-08-17T02:49:45.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.251+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad14159f30 con 0x7fad141590b0 2024-08-17T02:49:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.252+0000 7fad0b400640 1 -- 172.21.15.2:0/4113023892 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12293 (secure 0 0 0) 0x7fad0c072360 con 0x7fad141590b0 2024-08-17T02:49:45.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":44,"fsid":"f19c300a-c18c-4d11-a652-563f33592040","created":"2024-08-17T02:45:54.479982+0000","modified":"2024-08-17T02:49:40.360857+0000","last_up_change":"2024-08-17T02:46:05.706724+0000","last_in_change":"2024-08-17T02:45:57.579302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:46:07.068392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"032a88b1-f4bd-43d4-af19-9c0bd408f20a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":36944},{"type":"v1","addr":"172.21.15.2:6801","nonce":36944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":36944},{"type":"v1","addr":"172.21.15.2:6803","nonce":36944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":36944},{"type":"v1","addr":"172.21.15.2:6807","nonce":36944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":36944},{"type":"v1","addr":"172.21.15.2:6805","nonce":36944}]},"public_addr":"172.21.15.2:6801/36944","cluster_addr":"172.21.15.2:6803/36944","heartbeat_back_addr":"172.21.15.2:6807/36944","heartbeat_front_addr":"172.21.15.2:6805/36944","state":["exists","up"]},{"osd":1,"uuid":"246f5645-d860-4bde-95e1-b2b41809af1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":36946},{"type":"v1","addr":"172.21.15.2:6809","nonce":36946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":36946},{"type":"v1","addr":"172.21.15.2:6811","nonce":36946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":36946},{"type":"v1","addr":"172.21.15.2:6815","nonce":36946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":36946},{"type":"v1","addr":"172.21.15.2:6813","nonce":36946}]},"public_addr":"172.21.15.2:6809/36946","cluster_addr":"172.21.15.2:6811/36946","heartbeat_back_addr":"172.21.15.2:6815/36946","heartbeat_front_addr":"172.21.15.2:6813/36946","state":["exists","up"]},{"osd":2,"uuid":"e12756ac-1613-40d4-8acb-279976c28e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":36950},{"type":"v1","addr":"172.21.15.2:6825","nonce":36950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":36950},{"type":"v1","addr":"172.21.15.2:6827","nonce":36950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":36950},{"type":"v1","addr":"172.21.15.2:6831","nonce":36950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":36950},{"type":"v1","addr":"172.21.15.2:6829","nonce":36950}]},"public_addr":"172.21.15.2:6825/36950","cluster_addr":"172.21.15.2:6827/36950","heartbeat_back_addr":"172.21.15.2:6831/36950","heartbeat_front_addr":"172.21.15.2:6829/36950","state":["exists","up"]},{"osd":3,"uuid":"e113cc6c-8f60-47dd-bd6e-38ee163a40a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":36949},{"type":"v1","addr":"172.21.15.2:6817","nonce":36949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":36949},{"type":"v1","addr":"172.21.15.2:6819","nonce":36949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":36949},{"type":"v1","addr":"172.21.15.2:6823","nonce":36949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":36949},{"type":"v1","addr":"172.21.15.2:6821","nonce":36949}]},"public_addr":"172.21.15.2:6817/36949","cluster_addr":"172.21.15.2:6819/36949","heartbeat_back_addr":"172.21.15.2:6823/36949","heartbeat_front_addr":"172.21.15.2:6821/36949","state":["exists","up"]},{"osd":4,"uuid":"00d2db92-f8ce-4a86-94b4-60080a276b05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":37447},{"type":"v1","addr":"172.21.15.26:6817","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":37447},{"type":"v1","addr":"172.21.15.26:6819","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":37447},{"type":"v1","addr":"172.21.15.26:6823","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":37447},{"type":"v1","addr":"172.21.15.26:6821","nonce":37447}]},"public_addr":"172.21.15.26:6817/37447","cluster_addr":"172.21.15.26:6819/37447","heartbeat_back_addr":"172.21.15.26:6823/37447","heartbeat_front_addr":"172.21.15.26:6821/37447","state":["exists","up"]},{"osd":5,"uuid":"28352cad-5d51-4699-b770-28f35da20025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":37445},{"type":"v1","addr":"172.21.15.26:6801","nonce":37445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":37445},{"type":"v1","addr":"172.21.15.26:6803","nonce":37445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":37445},{"type":"v1","addr":"172.21.15.26:6807","nonce":37445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":37445},{"type":"v1","addr":"172.21.15.26:6805","nonce":37445}]},"public_addr":"172.21.15.26:6801/37445","cluster_addr":"172.21.15.26:6803/37445","heartbeat_back_addr":"172.21.15.26:6807/37445","heartbeat_front_addr":"172.21.15.26:6805/37445","state":["exists","up"]},{"osd":6,"uuid":"1a02c581-33b9-4b3b-a8ff-3b6fec1f8f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":37446},{"type":"v1","addr":"172.21.15.26:6809","nonce":37446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":37446},{"type":"v1","addr":"172.21.15.26:6811","nonce":37446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":37446},{"type":"v1","addr":"172.21.15.26:6815","nonce":37446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":37446},{"type":"v1","addr":"172.21.15.26:6813","nonce":37446}]},"public_addr":"172.21.15.26:6809/37446","cluster_addr":"172.21.15.26:6811/37446","heartbeat_back_addr":"172.21.15.26:6815/37446","heartbeat_front_addr":"172.21.15.26:6813/37446","state":["exists","up"]},{"osd":7,"uuid":"4d9d3701-49b0-4975-b22e-6d73d4c53e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":37470},{"type":"v1","addr":"172.21.15.26:6825","nonce":37470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":37470},{"type":"v1","addr":"172.21.15.26:6827","nonce":37470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":37470},{"type":"v1","addr":"172.21.15.26:6831","nonce":37470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":37470},{"type":"v1","addr":"172.21.15.26:6829","nonce":37470}]},"public_addr":"172.21.15.26:6825/37470","cluster_addr":"172.21.15.26:6827/37470","heartbeat_back_addr":"172.21.15.26:6831/37470","heartbeat_front_addr":"172.21.15.26:6829/37470","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.791618+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.866369+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.990539+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.919603+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.960441+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.885348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.977206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:46:02.969111+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6836/1036695601":"2024-08-18T02:49:37.207296+0000","172.21.15.2:6834/1036695601":"2024-08-18T02:49:37.207296+0000","172.21.15.2:6837/1889487336":"2024-08-18T02:49:30.194821+0000","172.21.15.2:6835/1889487336":"2024-08-18T02:49:30.194821+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:49:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7facf0065150 msgr2=0x7facf0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7facf0065150 0x7facf0067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fad14146810 tx=0x7fad04009040 comp rx=0 tx=0).stop 2024-08-17T02:49:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad141590b0 msgr2=0x7fad140ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad141590b0 0x7fad140ae9f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0099f0 tx=0x7fad0c037000 comp rx=0 tx=0).stop 2024-08-17T02:49:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 shutdown_connections 2024-08-17T02:49:45.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad141590b0 0x7fad140ae9f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad140afca0 0x7fad1415ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7facf0065150 0x7facf0067600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 --2- 172.21.15.2:0/4113023892 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fad140acf10 0x7fad1415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 >> 172.21.15.2:0/4113023892 conn(0x7fad14066e60 msgr2=0x7fad14069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 shutdown_connections 2024-08-17T02:49:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:45.255+0000 7fad1b000640 1 -- 172.21.15.2:0/4113023892 wait complete. 2024-08-17T02:49:46.271 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:49:46.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.436+0000 7f532fe00640 1 Processor -- start 2024-08-17T02:49:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.436+0000 7f532fe00640 1 -- start start 2024-08-17T02:49:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f532fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53301556c0 0x7f5330159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f532fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5330155a90 0x7f53300acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f532fe00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f53300c7dd0 0x7f53300ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f532fe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300c8f20 con 0x7f5330155a90 2024-08-17T02:49:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f532fe00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53301599b0 con 0x7f53300c7dd0 2024-08-17T02:49:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f532fe00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5330159c50 con 0x7f53301556c0 2024-08-17T02:49:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f5326000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5330155a90 0x7f53300acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f5326000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5330155a90 0x7f53300acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47950/0 (socket says 172.21.15.2:47950) 2024-08-17T02:49:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f5326000640 1 -- 172.21.15.2:0/2777415569 learned_addr learned my addr 172.21.15.2:0/2777415569 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f532ea00640 1 --2- 172.21.15.2:0/2777415569 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53301556c0 0x7f5330159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.438+0000 7f532f400640 1 --2- 172.21.15.2:0/2777415569 >> v2:172.21.15.26:3300/0 conn(0x7f53300c7dd0 0x7f53300ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.439+0000 7f5326000640 1 -- 172.21.15.2:0/2777415569 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53301556c0 msgr2=0x7f5330159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.439+0000 7f5326000640 1 --2- 172.21.15.2:0/2777415569 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53301556c0 0x7f5330159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.439+0000 7f5326000640 1 -- 172.21.15.2:0/2777415569 >> v2:172.21.15.26:3300/0 conn(0x7f53300c7dd0 msgr2=0x7f53300ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.439+0000 7f5326000640 1 --2- 172.21.15.2:0/2777415569 >> v2:172.21.15.26:3300/0 conn(0x7f53300c7dd0 0x7f53300ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.439+0000 7f5326000640 1 -- 172.21.15.2:0/2777415569 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330159f30 con 0x7f5330155a90 2024-08-17T02:49:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.440+0000 7f5326000640 1 --2- 172.21.15.2:0/2777415569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 0x7f53300acd20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f53300c8e90 tx=0x7f53180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a3208bbad27819 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.440+0000 7f532e000640 1 -- 172.21.15.2:0/2777415569 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531802acb0 con 0x7f5330155a90 2024-08-17T02:49:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.440+0000 7f532e000640 1 -- 172.21.15.2:0/2777415569 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531802ae10 con 0x7f5330155a90 2024-08-17T02:49:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.440+0000 7f532e000640 1 -- 172.21.15.2:0/2777415569 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318032670 con 0x7f5330155a90 2024-08-17T02:49:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.440+0000 7f532fe00640 1 -- 172.21.15.2:0/2777415569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 msgr2=0x7f53300acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.440+0000 7f532fe00640 1 --2- 172.21.15.2:0/2777415569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 0x7f53300acd20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f53300c8e90 tx=0x7f53180091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.441+0000 7f532fe00640 1 -- 172.21.15.2:0/2777415569 shutdown_connections 2024-08-17T02:49:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.441+0000 7f532fe00640 1 --2- 172.21.15.2:0/2777415569 >> v2:172.21.15.26:3300/0 conn(0x7f53300c7dd0 0x7f53300ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.441+0000 7f532fe00640 1 --2- 172.21.15.2:0/2777415569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 0x7f53300acd20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.441+0000 7f532fe00640 1 --2- 172.21.15.2:0/2777415569 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53301556c0 0x7f5330159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.441+0000 7f532fe00640 1 -- 172.21.15.2:0/2777415569 >> 172.21.15.2:0/2777415569 conn(0x7f5330066e60 msgr2=0x7f5330067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.441+0000 7f532fe00640 1 -- 172.21.15.2:0/2777415569 shutdown_connections 2024-08-17T02:49:46.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.441+0000 7f532fe00640 1 -- 172.21.15.2:0/2777415569 wait complete. 2024-08-17T02:49:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.442+0000 7f532fe00640 1 Processor -- start 2024-08-17T02:49:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.442+0000 7f532fe00640 1 -- start start 2024-08-17T02:49:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532fe00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53300c7dd0 0x7f53300c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532fe00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53301556c0 0x7f533016beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 0x7f5330168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533016c3f0 con 0x7f5330155a90 2024-08-17T02:49:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532fe00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5330169ff0 con 0x7f53301556c0 2024-08-17T02:49:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532fe00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53301572d0 con 0x7f53300c7dd0 2024-08-17T02:49:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 0x7f5330168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 0x7f5330168f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47962/0 (socket says 172.21.15.2:47962) 2024-08-17T02:49:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532f400640 1 -- 172.21.15.2:0/1180400278 learned_addr learned my addr 172.21.15.2:0/1180400278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f5326000640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53301556c0 0x7f533016beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.443+0000 7f532ea00640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53300c7dd0 0x7f53300c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f532f400640 1 -- 172.21.15.2:0/1180400278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53300c7dd0 msgr2=0x7f53300c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f532f400640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f53300c7dd0 0x7f53300c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f532f400640 1 -- 172.21.15.2:0/1180400278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53301556c0 msgr2=0x7f533016beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f532f400640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53301556c0 0x7f533016beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f532f400640 1 -- 172.21.15.2:0/1180400278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5318009450 con 0x7f5330155a90 2024-08-17T02:49:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f532f400640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 0x7f5330168f90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5328007f20 tx=0x7f5328009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532800ee30 con 0x7f5330155a90 2024-08-17T02:49:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5328014420 con 0x7f5330155a90 2024-08-17T02:49:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280147e0 con 0x7f5330155a90 2024-08-17T02:49:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.444+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53301694d0 con 0x7f5330155a90 2024-08-17T02:49:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.445+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5330169a30 con 0x7f5330155a90 2024-08-17T02:49:46.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.445+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5330063f10 con 0x7f5330155a90 2024-08-17T02:49:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.446+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5328014b50 con 0x7f5330155a90 2024-08-17T02:49:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.447+0000 7f5326a00640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f530c065150 0x7f530c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.447+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5328082850 con 0x7f5330155a90 2024-08-17T02:49:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.447+0000 7f5326a00640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f530c06b040 0x7f530c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.447+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 --> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f530c06db00 con 0x7f530c06b040 2024-08-17T02:49:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.447+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5328084db0 con 0x7f5330155a90 2024-08-17T02:49:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.447+0000 7f532ea00640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f530c065150 0x7f530c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.448+0000 7f5326000640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f530c06b040 0x7f530c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.448+0000 7f532ea00640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f530c065150 0x7f530c067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5320007ba0 tx=0x7f5320008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.448+0000 7f5326000640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f530c06b040 0x7f530c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.449+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 <== osd.0 v2:172.21.15.2:6800/36944 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f530c06db00 con 0x7f530c06b040 2024-08-17T02:49:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.462+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 --> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f53301570a0 con 0x7f530c06b040 2024-08-17T02:49:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.462+0000 7f5326a00640 1 -- 172.21.15.2:0/1180400278 <== osd.0 v2:172.21.15.2:6800/36944 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f53301570a0 con 0x7f530c06b040 2024-08-17T02:49:46.462 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:49:46.462 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:46.463 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:49:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.462+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f530c06b040 msgr2=0x7f530c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6800/36944,v1:172.21.15.2:6801/36944] conn(0x7f530c06b040 0x7f530c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f530c065150 msgr2=0x7f530c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f530c065150 0x7f530c067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5320007ba0 tx=0x7f5320008040 comp rx=0 tx=0).stop 2024-08-17T02:49:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 msgr2=0x7f5330168f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 --2- 172.21.15.2:0/1180400278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5330155a90 0x7f5330168f90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5328007f20 tx=0x7f5328009860 comp rx=0 tx=0).stop 2024-08-17T02:49:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532f400640 1 -- 172.21.15.2:0/1180400278 reap_dead start 2024-08-17T02:49:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 shutdown_connections 2024-08-17T02:49:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 >> 172.21.15.2:0/1180400278 conn(0x7f5330066e60 msgr2=0x7f53300ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 shutdown_connections 2024-08-17T02:49:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.463+0000 7f532fe00640 1 -- 172.21.15.2:0/1180400278 wait complete. 2024-08-17T02:49:46.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:49:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.629+0000 7f94dca00640 1 Processor -- start 2024-08-17T02:49:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.630+0000 7f94dca00640 1 -- start start 2024-08-17T02:49:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.631+0000 7f94dca00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f94d80ad0b0 0x7f94d80c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.631+0000 7f94dca00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80c92b0 con 0x7f94d80acc60 2024-08-17T02:49:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.631+0000 7f94dca00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80c8ca0 con 0x7f94d80abdf0 2024-08-17T02:49:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.631+0000 7f94dca00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d8159ec0 con 0x7f94d80ad0b0 2024-08-17T02:49:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.631+0000 7f94cfe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f94d80acc60 0x7f94d80c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56688/0 (socket says 172.21.15.2:56688) 2024-08-17T02:49:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.631+0000 7f94cfe00640 1 -- 172.21.15.2:0/3813788311 learned_addr learned my addr 172.21.15.2:0/3813788311 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.631+0000 7f94d7200640 1 --2- 172.21.15.2:0/3813788311 >> v2:172.21.15.26:3300/0 conn(0x7f94d80ad0b0 0x7f94d80c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.632+0000 7f94d5e00640 1 -- 172.21.15.2:0/3813788311 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499677509 0 0) 0x7f94d80c92b0 con 0x7f94d80acc60 2024-08-17T02:49:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.632+0000 7f94d5e00640 1 -- 172.21.15.2:0/3813788311 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94bc0034e0 con 0x7f94d80acc60 2024-08-17T02:49:46.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.632+0000 7f94d7200640 1 -- 172.21.15.2:0/3813788311 >> v1:172.21.15.26:6789/0 conn(0x7f94d80abdf0 legacy=0x7f94d8159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.632+0000 7f94d7200640 1 -- 172.21.15.2:0/3813788311 >> v1:172.21.15.2:6789/0 conn(0x7f94d80acc60 legacy=0x7f94d80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.632+0000 7f94d7200640 1 -- 172.21.15.2:0/3813788311 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d815a1a0 con 0x7f94d80ad0b0 2024-08-17T02:49:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.633+0000 7f94d7200640 1 --2- 172.21.15.2:0/3813788311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80ad0b0 0x7f94d80c9e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009e60 tx=0x7f94d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8135faaef8e41205 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.633+0000 7f94d5e00640 1 -- 172.21.15.2:0/3813788311 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0007550 con 0x7f94d80ad0b0 2024-08-17T02:49:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.633+0000 7f94d5e00640 1 -- 172.21.15.2:0/3813788311 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d002d050 con 0x7f94d80ad0b0 2024-08-17T02:49:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.633+0000 7f94d5e00640 1 -- 172.21.15.2:0/3813788311 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00078c0 con 0x7f94d80ad0b0 2024-08-17T02:49:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.634+0000 7f94dca00640 1 -- 172.21.15.2:0/3813788311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80ad0b0 msgr2=0x7f94d80c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.634+0000 7f94dca00640 1 --2- 172.21.15.2:0/3813788311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80ad0b0 0x7f94d80c9e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009e60 tx=0x7f94d0009780 comp rx=0 tx=0).stop 2024-08-17T02:49:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.634+0000 7f94dca00640 1 -- 172.21.15.2:0/3813788311 shutdown_connections 2024-08-17T02:49:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.634+0000 7f94dca00640 1 --2- 172.21.15.2:0/3813788311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80ad0b0 0x7f94d80c9e50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.634+0000 7f94dca00640 1 -- 172.21.15.2:0/3813788311 >> 172.21.15.2:0/3813788311 conn(0x7f94d8066e60 msgr2=0x7f94d8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.634+0000 7f94dca00640 1 -- 172.21.15.2:0/3813788311 shutdown_connections 2024-08-17T02:49:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.634+0000 7f94dca00640 1 -- 172.21.15.2:0/3813788311 wait complete. 2024-08-17T02:49:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.635+0000 7f94dca00640 1 Processor -- start 2024-08-17T02:49:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.636+0000 7f94dca00640 1 -- start start 2024-08-17T02:49:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.636+0000 7f94dca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d80abdf0 0x7f94d80cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.636+0000 7f94dca00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80acc60 0x7f94d81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.636+0000 7f94dca00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94d80ad0b0 0x7f94d8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.636+0000 7f94dca00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80ca3a0 con 0x7f94d80abdf0 2024-08-17T02:49:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.636+0000 7f94dca00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80ca680 con 0x7f94d80acc60 2024-08-17T02:49:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.636+0000 7f94dca00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80ca960 con 0x7f94d80ad0b0 2024-08-17T02:49:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d80abdf0 0x7f94d80cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d80abdf0 0x7f94d80cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47970/0 (socket says 172.21.15.2:47970) 2024-08-17T02:49:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 -- 172.21.15.2:0/2588035711 learned_addr learned my addr 172.21.15.2:0/2588035711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d7200640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94d80ad0b0 0x7f94d8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94cfe00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80acc60 0x7f94d81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 -- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94d80ad0b0 msgr2=0x7f94d8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94d80ad0b0 0x7f94d8157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 -- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80acc60 msgr2=0x7f94d81521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80acc60 0x7f94d81521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 -- 172.21.15.2:0/2588035711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0009a20 con 0x7f94d80abdf0 2024-08-17T02:49:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d7200640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94d80ad0b0 0x7f94d8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94cfe00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80acc60 0x7f94d81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:49:46.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.637+0000 7f94d6800640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d80abdf0 0x7f94d80cb420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c560 tx=0x7f94c8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.638+0000 7f94ce000640 1 -- 172.21.15.2:0/2588035711 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8012630 con 0x7f94d80abdf0 2024-08-17T02:49:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.638+0000 7f94ce000640 1 -- 172.21.15.2:0/2588035711 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c80127b0 con 0x7f94d80abdf0 2024-08-17T02:49:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.638+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80cac40 con 0x7f94d80abdf0 2024-08-17T02:49:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.638+0000 7f94ce000640 1 -- 172.21.15.2:0/2588035711 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8012b70 con 0x7f94d80abdf0 2024-08-17T02:49:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.638+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d80cb960 con 0x7f94d80abdf0 2024-08-17T02:49:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.639+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d8070720 con 0x7f94d80abdf0 2024-08-17T02:49:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.640+0000 7f94ce000640 1 -- 172.21.15.2:0/2588035711 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f94c801b400 con 0x7f94d80abdf0 2024-08-17T02:49:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.641+0000 7f94ce000640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f94b4065150 0x7f94b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.641+0000 7f94ce000640 1 -- 172.21.15.2:0/2588035711 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f94c8081da0 con 0x7f94d80abdf0 2024-08-17T02:49:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.641+0000 7f94cfe00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f94b4065150 0x7f94b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.642+0000 7f94cfe00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f94b4065150 0x7f94b4067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f94d80b0900 tx=0x7f94c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.644+0000 7f94ce000640 1 -- 172.21.15.2:0/2588035711 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f94c8050100 con 0x7f94d80abdf0 2024-08-17T02:49:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.828+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f94d80cbb80 con 0x7f94b4065150 2024-08-17T02:49:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.829+0000 7f94ce000640 1 -- 172.21.15.2:0/2588035711 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94c0005870 con 0x7f94b4065150 2024-08-17T02:49:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:49:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f94b4065150 msgr2=0x7f94b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f94b4065150 0x7f94b4067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f94d80b0900 tx=0x7f94c0009040 comp rx=0 tx=0).stop 2024-08-17T02:49:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d80abdf0 msgr2=0x7f94d80cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d80abdf0 0x7f94d80cb420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f94c800c560 tx=0x7f94c8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 shutdown_connections 2024-08-17T02:49:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f94b4065150 0x7f94b4067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f94d80ad0b0 0x7f94d8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d80acc60 0x7f94d81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 --2- 172.21.15.2:0/2588035711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d80abdf0 0x7f94d80cb420 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 >> 172.21.15.2:0/2588035711 conn(0x7f94d8066e60 msgr2=0x7f94d8155280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 shutdown_connections 2024-08-17T02:49:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:46.831+0000 7f94dca00640 1 -- 172.21.15.2:0/2588035711 wait complete. 2024-08-17T02:49:46.847 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:49:46.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:47.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.001+0000 7f3913a00640 1 Processor -- start 2024-08-17T02:49:47.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.001+0000 7f3913a00640 1 -- start start 2024-08-17T02:49:47.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.002+0000 7f3913a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f390c158bb0 0x7f390c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.002+0000 7f3913a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c0b1a70 0x7f390c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.002+0000 7f3913a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0cc9e0 con 0x7f390c158f80 2024-08-17T02:49:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3913a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0cbdd0 con 0x7f390c158bb0 2024-08-17T02:49:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3913a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0cc0b0 con 0x7f390c0b1a70 2024-08-17T02:49:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f390c158bb0 0x7f390c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f390c158bb0 0x7f390c0cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47974/0 (socket says 172.21.15.2:47974) 2024-08-17T02:49:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911000640 1 -- 172.21.15.2:0/193945028 learned_addr learned my addr 172.21.15.2:0/193945028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:47.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911000640 1 -- 172.21.15.2:0/193945028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c0b1a70 msgr2=0x7f390c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:47.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911a00640 1 --2- 172.21.15.2:0/193945028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c0b1a70 0x7f390c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911000640 1 --2- 172.21.15.2:0/193945028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c0b1a70 0x7f390c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911000640 1 -- 172.21.15.2:0/193945028 >> v1:172.21.15.2:6789/0 conn(0x7f390c158f80 legacy=0x7f390c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f390be00640 1 -- 172.21.15.2:0/193945028 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185517869 0 0) 0x7f390c0cc9e0 con 0x7f390c158f80 2024-08-17T02:49:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911000640 1 -- 172.21.15.2:0/193945028 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0cc390 con 0x7f390c158bb0 2024-08-17T02:49:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.003+0000 7f3911a00640 1 --2- 172.21.15.2:0/193945028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c0b1a70 0x7f390c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.004+0000 7f3911000640 1 --2- 172.21.15.2:0/193945028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c158bb0 0x7f390c0cce70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009910 tx=0x7f38fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2f493b4424fa36 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f390be00640 1 -- 172.21.15.2:0/193945028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc02adb0 con 0x7f390c158bb0 2024-08-17T02:49:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f390be00640 1 -- 172.21.15.2:0/193945028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc032440 con 0x7f390c158bb0 2024-08-17T02:49:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f390be00640 1 -- 172.21.15.2:0/193945028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0327e0 con 0x7f390c158bb0 2024-08-17T02:49:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f3913a00640 1 -- 172.21.15.2:0/193945028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c158bb0 msgr2=0x7f390c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f3913a00640 1 --2- 172.21.15.2:0/193945028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c158bb0 0x7f390c0cce70 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009910 tx=0x7f38fc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f3913a00640 1 -- 172.21.15.2:0/193945028 shutdown_connections 2024-08-17T02:49:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f3913a00640 1 --2- 172.21.15.2:0/193945028 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c0b1a70 0x7f390c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f3913a00640 1 --2- 172.21.15.2:0/193945028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c158bb0 0x7f390c0cce70 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f3913a00640 1 -- 172.21.15.2:0/193945028 >> 172.21.15.2:0/193945028 conn(0x7f390c06e590 msgr2=0x7f390c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f3913a00640 1 -- 172.21.15.2:0/193945028 shutdown_connections 2024-08-17T02:49:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.005+0000 7f3913a00640 1 -- 172.21.15.2:0/193945028 wait complete. 2024-08-17T02:49:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.007+0000 7f3913a00640 1 Processor -- start 2024-08-17T02:49:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.007+0000 7f3913a00640 1 -- start start 2024-08-17T02:49:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3913a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c0b1a70 0x7f390c15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3913a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c158bb0 0x7f390c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3913a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f390c158f80 0x7f390c0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3913a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c15acc0 con 0x7f390c0b1a70 2024-08-17T02:49:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3913a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c15a2f0 con 0x7f390c158f80 2024-08-17T02:49:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3913a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c1596e0 con 0x7f390c158bb0 2024-08-17T02:49:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3911000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c0b1a70 0x7f390c15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3911000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c0b1a70 0x7f390c15d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47978/0 (socket says 172.21.15.2:47978) 2024-08-17T02:49:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3911000640 1 -- 172.21.15.2:0/1748076436 learned_addr learned my addr 172.21.15.2:0/1748076436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3911000640 1 -- 172.21.15.2:0/1748076436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c158bb0 msgr2=0x7f390c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3911000640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f390c158bb0 0x7f390c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3911000640 1 -- 172.21.15.2:0/1748076436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f390c158f80 msgr2=0x7f390c0c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3911000640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f390c158f80 0x7f390c0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.008+0000 7f3911000640 1 -- 172.21.15.2:0/1748076436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009450 con 0x7f390c0b1a70 2024-08-17T02:49:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.009+0000 7f3911000640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c0b1a70 0x7f390c15d740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f38fc035040 tx=0x7f38fc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.009+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc031de0 con 0x7f390c0b1a70 2024-08-17T02:49:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.009+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc03d420 con 0x7f390c0b1a70 2024-08-17T02:49:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.009+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc03d7e0 con 0x7f390c0b1a70 2024-08-17T02:49:47.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.009+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c1599c0 con 0x7f390c0b1a70 2024-08-17T02:49:47.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.009+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c159f80 con 0x7f390c0b1a70 2024-08-17T02:49:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.010+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f390c063fb0 con 0x7f390c0b1a70 2024-08-17T02:49:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.011+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38fc039040 con 0x7f390c0b1a70 2024-08-17T02:49:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.012+0000 7f3908c00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38e8065180 0x7f38e8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.012+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f38fc0a2960 con 0x7f390c0b1a70 2024-08-17T02:49:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.012+0000 7f3903e00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38e8065180 0x7f38e8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.012+0000 7f3908c00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f38e806b070 0x7f38e806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.012+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 --> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38e806db30 con 0x7f38e806b070 2024-08-17T02:49:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.012+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38fc0a2c50 con 0x7f390c0b1a70 2024-08-17T02:49:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.012+0000 7f3911a00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f38e806b070 0x7f38e806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.013+0000 7f3903e00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38e8065180 0x7f38e8067630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f390c15c330 tx=0x7f38f4007ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.013+0000 7f3911a00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f38e806b070 0x7f38e806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.013+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 <== osd.1 v2:172.21.15.2:6808/36946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f38e806db30 con 0x7f38e806b070 2024-08-17T02:49:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.026+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 --> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f390c067650 con 0x7f38e806b070 2024-08-17T02:49:47.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.026+0000 7f3908c00640 1 -- 172.21.15.2:0/1748076436 <== osd.1 v2:172.21.15.2:6808/36946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f390c067650 con 0x7f38e806b070 2024-08-17T02:49:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:49:47.028 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:47.028 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:49:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f38e806b070 msgr2=0x7f38e806d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6808/36946,v1:172.21.15.2:6809/36946] conn(0x7f38e806b070 0x7f38e806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38e8065180 msgr2=0x7f38e8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f38e8065180 0x7f38e8067630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f390c15c330 tx=0x7f38f4007ab0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c0b1a70 msgr2=0x7f390c15d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 --2- 172.21.15.2:0/1748076436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f390c0b1a70 0x7f390c15d740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f38fc035040 tx=0x7f38fc032000 comp rx=0 tx=0).stop 2024-08-17T02:49:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3911a00640 1 -- 172.21.15.2:0/1748076436 reap_dead start 2024-08-17T02:49:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 shutdown_connections 2024-08-17T02:49:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 >> 172.21.15.2:0/1748076436 conn(0x7f390c06e590 msgr2=0x7f390c0caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 shutdown_connections 2024-08-17T02:49:47.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.027+0000 7f3913a00640 1 -- 172.21.15.2:0/1748076436 wait complete. 2024-08-17T02:49:47.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:49:47.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.194+0000 7f12d7800640 1 Processor -- start 2024-08-17T02:49:47.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.194+0000 7f12d7800640 1 -- start start 2024-08-17T02:49:47.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.195+0000 7f12d7800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f12d00aea20 0x7f12d00aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.195+0000 7f12d7800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d00af3a0 con 0x7f12d0158b90 2024-08-17T02:49:47.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.195+0000 7f12d7800640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d00afd20 con 0x7f12d00ca8e0 2024-08-17T02:49:47.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.195+0000 7f12d7800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d00affe0 con 0x7f12d00aea20 2024-08-17T02:49:47.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.195+0000 7f12d4e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f12d0158b90 0x7f12d00b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56704/0 (socket says 172.21.15.2:56704) 2024-08-17T02:49:47.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.195+0000 7f12d4e00640 1 -- 172.21.15.2:0/1622024376 learned_addr learned my addr 172.21.15.2:0/1622024376 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:47.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.196+0000 7f12cfe00640 1 --2- 172.21.15.2:0/1622024376 >> v2:172.21.15.26:3300/0 conn(0x7f12d00aea20 0x7f12d00aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.196+0000 7f12cf400640 1 -- 172.21.15.2:0/1622024376 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709386865 0 0) 0x7f12d00af3a0 con 0x7f12d0158b90 2024-08-17T02:49:47.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.196+0000 7f12cf400640 1 -- 172.21.15.2:0/1622024376 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b80034e0 con 0x7f12d0158b90 2024-08-17T02:49:47.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.196+0000 7f12cfe00640 1 -- 172.21.15.2:0/1622024376 >> v1:172.21.15.26:6789/0 conn(0x7f12d00ca8e0 legacy=0x7f12d00cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.196+0000 7f12cfe00640 1 -- 172.21.15.2:0/1622024376 >> v1:172.21.15.2:6789/0 conn(0x7f12d0158b90 legacy=0x7f12d00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.196+0000 7f12cfe00640 1 -- 172.21.15.2:0/1622024376 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00b02c0 con 0x7f12d00aea20 2024-08-17T02:49:47.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.197+0000 7f12cfe00640 1 --2- 172.21.15.2:0/1622024376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00aea20 0x7f12d00aee60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009850 tx=0x7f12bc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e19ad06d6f906bd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.197+0000 7f12cf400640 1 -- 172.21.15.2:0/1622024376 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc02ae20 con 0x7f12d00aea20 2024-08-17T02:49:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12cf400640 1 -- 172.21.15.2:0/1622024376 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc032440 con 0x7f12d00aea20 2024-08-17T02:49:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12cf400640 1 -- 172.21.15.2:0/1622024376 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0327c0 con 0x7f12d00aea20 2024-08-17T02:49:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12d7800640 1 -- 172.21.15.2:0/1622024376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00aea20 msgr2=0x7f12d00aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12d7800640 1 --2- 172.21.15.2:0/1622024376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00aea20 0x7f12d00aee60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009850 tx=0x7f12bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12d7800640 1 -- 172.21.15.2:0/1622024376 shutdown_connections 2024-08-17T02:49:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12d7800640 1 --2- 172.21.15.2:0/1622024376 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00aea20 0x7f12d00aee60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12d7800640 1 -- 172.21.15.2:0/1622024376 >> 172.21.15.2:0/1622024376 conn(0x7f12d006e590 msgr2=0x7f12d006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:47.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12d7800640 1 -- 172.21.15.2:0/1622024376 shutdown_connections 2024-08-17T02:49:47.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.198+0000 7f12d7800640 1 -- 172.21.15.2:0/1622024376 wait complete. 2024-08-17T02:49:47.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.200+0000 7f12d7800640 1 Processor -- start 2024-08-17T02:49:47.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.200+0000 7f12d7800640 1 -- start start 2024-08-17T02:49:47.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.200+0000 7f12d7800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d00aea20 0x7f12d00c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.200+0000 7f12d7800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00ca8e0 0x7f12d0158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.200+0000 7f12d7800640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d0158b90 0x7f12d0158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d7800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d0159fe0 con 0x7f12d00aea20 2024-08-17T02:49:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d7800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01691b0 con 0x7f12d00ca8e0 2024-08-17T02:49:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d7800640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01594a0 con 0x7f12d0158b90 2024-08-17T02:49:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d00aea20 0x7f12d00c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d00aea20 0x7f12d00c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47990/0 (socket says 172.21.15.2:47990) 2024-08-17T02:49:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 -- 172.21.15.2:0/3919606641 learned_addr learned my addr 172.21.15.2:0/3919606641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12cfe00640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00ca8e0 0x7f12d0158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d5800640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d0158b90 0x7f12d0158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 -- 172.21.15.2:0/3919606641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d0158b90 msgr2=0x7f12d0158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d0158b90 0x7f12d0158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 -- 172.21.15.2:0/3919606641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00ca8e0 msgr2=0x7f12d0158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00ca8e0 0x7f12d0158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 -- 172.21.15.2:0/3919606641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc009390 con 0x7f12d00aea20 2024-08-17T02:49:47.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.201+0000 7f12d4e00640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d00aea20 0x7f12d00c87b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c590 tx=0x7f12c4007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.202+0000 7f12c3e00640 1 -- 172.21.15.2:0/3919606641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4005aa0 con 0x7f12d00aea20 2024-08-17T02:49:47.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.202+0000 7f12c3e00640 1 -- 172.21.15.2:0/3919606641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4005c40 con 0x7f12d00aea20 2024-08-17T02:49:47.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.202+0000 7f12c3e00640 1 -- 172.21.15.2:0/3919606641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c40070f0 con 0x7f12d00aea20 2024-08-17T02:49:47.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.202+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d0158590 con 0x7f12d00aea20 2024-08-17T02:49:47.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.202+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d0159a20 con 0x7f12d00aea20 2024-08-17T02:49:47.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.203+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d0063fb0 con 0x7f12d00aea20 2024-08-17T02:49:47.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.204+0000 7f12c3e00640 1 -- 172.21.15.2:0/3919606641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f12c4007520 con 0x7f12d00aea20 2024-08-17T02:49:47.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.204+0000 7f12c3e00640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12b0065150 0x7f12b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.205+0000 7f12c3e00640 1 -- 172.21.15.2:0/3919606641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f12c4081ba0 con 0x7f12d00aea20 2024-08-17T02:49:47.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.205+0000 7f12cfe00640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12b0065150 0x7f12b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.206+0000 7f12cfe00640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12b0065150 0x7f12b0067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f12bc034000 tx=0x7f12bc032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.209+0000 7f12c3e00640 1 -- 172.21.15.2:0/3919606641 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f12c404ff80 con 0x7f12d00aea20 2024-08-17T02:49:47.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.395+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f12d00b2420 con 0x7f12b0065150 2024-08-17T02:49:47.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.395+0000 7f12c3e00640 1 -- 172.21.15.2:0/3919606641 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f12d00b2420 con 0x7f12b0065150 2024-08-17T02:49:47.396 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:49:47.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12b0065150 msgr2=0x7f12b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12b0065150 0x7f12b0067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f12bc034000 tx=0x7f12bc032000 comp rx=0 tx=0).stop 2024-08-17T02:49:47.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d00aea20 msgr2=0x7f12d00c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d00aea20 0x7f12d00c87b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c590 tx=0x7f12c4007d40 comp rx=0 tx=0).stop 2024-08-17T02:49:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 shutdown_connections 2024-08-17T02:49:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12b0065150 0x7f12b0067600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f12d0158b90 0x7f12d0158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f12d00ca8e0 0x7f12d0158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 --2- 172.21.15.2:0/3919606641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12d00aea20 0x7f12d00c87b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.397+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 >> 172.21.15.2:0/3919606641 conn(0x7f12d006e590 msgr2=0x7f12d00b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:47.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.398+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 shutdown_connections 2024-08-17T02:49:47.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.398+0000 7f12d7800640 1 -- 172.21.15.2:0/3919606641 wait complete. 2024-08-17T02:49:47.413 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:49:47.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.568+0000 7f66f1e00640 1 Processor -- start 2024-08-17T02:49:47.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.568+0000 7f66f1e00640 1 -- start start 2024-08-17T02:49:47.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66f1e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f66ec158dc0 0x7f66ec0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66f1e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66ec0cf520 0x7f66ec0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66f1e00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec0b3ac0 con 0x7f66ec1589f0 2024-08-17T02:49:47.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66f1e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec0b3190 con 0x7f66ec158dc0 2024-08-17T02:49:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66f1e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec0b3470 con 0x7f66ec0cf520 2024-08-17T02:49:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66ebe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f66ec158dc0 0x7f66ec0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66ebe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f66ec158dc0 0x7f66ec0ceef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48006/0 (socket says 172.21.15.2:48006) 2024-08-17T02:49:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66ebe00640 1 -- 172.21.15.2:0/720714353 learned_addr learned my addr 172.21.15.2:0/720714353 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66f1400640 1 --2- 172.21.15.2:0/720714353 >> v2:172.21.15.26:3300/0 conn(0x7f66ec0cf520 0x7f66ec0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66ebe00640 1 -- 172.21.15.2:0/720714353 >> v2:172.21.15.26:3300/0 conn(0x7f66ec0cf520 msgr2=0x7f66ec0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:47.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66ebe00640 1 --2- 172.21.15.2:0/720714353 >> v2:172.21.15.26:3300/0 conn(0x7f66ec0cf520 0x7f66ec0cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66ebe00640 1 -- 172.21.15.2:0/720714353 >> v1:172.21.15.26:6789/0 conn(0x7f66ec1589f0 legacy=0x7f66ec0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66ebe00640 1 -- 172.21.15.2:0/720714353 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0b3750 con 0x7f66ec158dc0 2024-08-17T02:49:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.570+0000 7f66f1400640 1 --2- 172.21.15.2:0/720714353 >> v2:172.21.15.26:3300/0 conn(0x7f66ec0cf520 0x7f66ec0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.571+0000 7f66ebe00640 1 --2- 172.21.15.2:0/720714353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec158dc0 0x7f66ec0ceef0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0b2e80 tx=0x7f66d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46db7b4e4b8bddd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66eb400640 1 -- 172.21.15.2:0/720714353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d802add0 con 0x7f66ec158dc0 2024-08-17T02:49:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66eb400640 1 -- 172.21.15.2:0/720714353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d8032440 con 0x7f66ec158dc0 2024-08-17T02:49:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66eb400640 1 -- 172.21.15.2:0/720714353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8032820 con 0x7f66ec158dc0 2024-08-17T02:49:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66f1e00640 1 -- 172.21.15.2:0/720714353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec158dc0 msgr2=0x7f66ec0ceef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66f1e00640 1 --2- 172.21.15.2:0/720714353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec158dc0 0x7f66ec0ceef0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0b2e80 tx=0x7f66d80091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66f1e00640 1 -- 172.21.15.2:0/720714353 shutdown_connections 2024-08-17T02:49:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66f1e00640 1 --2- 172.21.15.2:0/720714353 >> v2:172.21.15.26:3300/0 conn(0x7f66ec0cf520 0x7f66ec0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66f1e00640 1 --2- 172.21.15.2:0/720714353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec158dc0 0x7f66ec0ceef0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.572+0000 7f66f1e00640 1 -- 172.21.15.2:0/720714353 >> 172.21.15.2:0/720714353 conn(0x7f66ec087a80 msgr2=0x7f66ec06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.573+0000 7f66f1e00640 1 -- 172.21.15.2:0/720714353 shutdown_connections 2024-08-17T02:49:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.573+0000 7f66f1e00640 1 -- 172.21.15.2:0/720714353 wait complete. 2024-08-17T02:49:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.574+0000 7f66f1e00640 1 Processor -- start 2024-08-17T02:49:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.574+0000 7f66f1e00640 1 -- start start 2024-08-17T02:49:47.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.575+0000 7f66f1e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66ec0cf520 0x7f66ec14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.575+0000 7f66f1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec1589f0 0x7f66ec15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.575+0000 7f66f1e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66ec158dc0 0x7f66ec14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.575+0000 7f66f1e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec14d630 con 0x7f66ec1589f0 2024-08-17T02:49:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.575+0000 7f66f1e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec153bf0 con 0x7f66ec158dc0 2024-08-17T02:49:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.575+0000 7f66f1e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec153ed0 con 0x7f66ec0cf520 2024-08-17T02:49:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66ebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec1589f0 0x7f66ec15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66f1400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66ec158dc0 0x7f66ec14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66f0a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66ec0cf520 0x7f66ec14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66ebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec1589f0 0x7f66ec15b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48020/0 (socket says 172.21.15.2:48020) 2024-08-17T02:49:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66f1400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66ec158dc0 0x7f66ec14c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.2:49396/0 (socket says 172.21.15.2:49396) 2024-08-17T02:49:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66f0a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66ec0cf520 0x7f66ec14bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3301/0 says I am v2:172.21.15.2:42888/0 (socket says 172.21.15.2:42888) 2024-08-17T02:49:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66ebe00640 1 -- 172.21.15.2:0/854568081 learned_addr learned my addr 172.21.15.2:0/854568081 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66ebe00640 1 -- 172.21.15.2:0/854568081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66ec0cf520 msgr2=0x7f66ec14bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66ebe00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f66ec0cf520 0x7f66ec14bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66ebe00640 1 -- 172.21.15.2:0/854568081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66ec158dc0 msgr2=0x7f66ec14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66ebe00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66ec158dc0 0x7f66ec14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.576+0000 7f66ebe00640 1 -- 172.21.15.2:0/854568081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8009450 con 0x7f66ec1589f0 2024-08-17T02:49:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.577+0000 7f66ebe00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec1589f0 0x7f66ec15b730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f66d8035040 tx=0x7f66d8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.577+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8031de0 con 0x7f66ec1589f0 2024-08-17T02:49:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.577+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d803d440 con 0x7f66ec1589f0 2024-08-17T02:49:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.577+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec14d2c0 con 0x7f66ec1589f0 2024-08-17T02:49:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.577+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d803d800 con 0x7f66ec1589f0 2024-08-17T02:49:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.577+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec15bc70 con 0x7f66ec1589f0 2024-08-17T02:49:47.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.578+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66ec063f10 con 0x7f66ec1589f0 2024-08-17T02:49:47.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.579+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f66d8039040 con 0x7f66ec1589f0 2024-08-17T02:49:47.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.580+0000 7f66dfe00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f66cc065150 0x7f66cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.580+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f66d80a24a0 con 0x7f66ec1589f0 2024-08-17T02:49:47.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.580+0000 7f66f0a00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f66cc065150 0x7f66cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.580+0000 7f66dfe00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7f66cc06b040 0x7f66cc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.580+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 --> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66cc06db00 con 0x7f66cc06b040 2024-08-17T02:49:47.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.580+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66d80a4a00 con 0x7f66ec1589f0 2024-08-17T02:49:47.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.580+0000 7f66f1400640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7f66cc06b040 0x7f66cc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.581+0000 7f66f0a00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f66cc065150 0x7f66cc067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f66e0007fd0 tx=0x7f66e0007e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.581+0000 7f66f1400640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7f66cc06b040 0x7f66cc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.582+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 <== osd.2 v2:172.21.15.2:6824/36950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f66cc06db00 con 0x7f66cc06b040 2024-08-17T02:49:47.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.595+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 --> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66ec088a10 con 0x7f66cc06b040 2024-08-17T02:49:47.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.595+0000 7f66dfe00640 1 -- 172.21.15.2:0/854568081 <== osd.2 v2:172.21.15.2:6824/36950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f66ec088a10 con 0x7f66cc06b040 2024-08-17T02:49:47.596 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:49:47.596 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:47.596 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:49:47.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.595+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7f66cc06b040 msgr2=0x7f66cc06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.595+0000 7f66f1e00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6824/36950,v1:172.21.15.2:6825/36950] conn(0x7f66cc06b040 0x7f66cc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.595+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f66cc065150 msgr2=0x7f66cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.595+0000 7f66f1e00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f66cc065150 0x7f66cc067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f66e0007fd0 tx=0x7f66e0007e10 comp rx=0 tx=0).stop 2024-08-17T02:49:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.595+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec1589f0 msgr2=0x7f66ec15b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.595+0000 7f66f1e00640 1 --2- 172.21.15.2:0/854568081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66ec1589f0 0x7f66ec15b730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f66d8035040 tx=0x7f66d8032000 comp rx=0 tx=0).stop 2024-08-17T02:49:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.596+0000 7f66f1400640 1 -- 172.21.15.2:0/854568081 reap_dead start 2024-08-17T02:49:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.596+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 shutdown_connections 2024-08-17T02:49:47.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.596+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 >> 172.21.15.2:0/854568081 conn(0x7f66ec087a80 msgr2=0x7f66ec14e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:47.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.596+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 shutdown_connections 2024-08-17T02:49:47.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.596+0000 7f66f1e00640 1 -- 172.21.15.2:0/854568081 wait complete. 2024-08-17T02:49:47.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:49:47.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.763+0000 7f0101c00640 1 Processor -- start 2024-08-17T02:49:47.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.763+0000 7f0101c00640 1 -- start start 2024-08-17T02:49:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.764+0000 7f0101c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0acc60 0x7f00fc0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.764+0000 7f0101c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc0c92b0 con 0x7f00fc0c9740 2024-08-17T02:49:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.764+0000 7f0101c00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc0ad5f0 con 0x7f00fc0abdf0 2024-08-17T02:49:47.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.764+0000 7f0101c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0c8ca0 con 0x7f00fc0acc60 2024-08-17T02:49:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.764+0000 7f0101200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f00fc0c9740 0x7f00fc0c9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56710/0 (socket says 172.21.15.2:56710) 2024-08-17T02:49:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.764+0000 7f0101200640 1 -- 172.21.15.2:0/3028379901 learned_addr learned my addr 172.21.15.2:0/3028379901 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:47.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.764+0000 7f00f3400640 1 --2- 172.21.15.2:0/3028379901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0acc60 0x7f00fc0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.765+0000 7f00fb400640 1 -- 172.21.15.2:0/3028379901 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183646108 0 0) 0x7f00fc0c92b0 con 0x7f00fc0c9740 2024-08-17T02:49:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.765+0000 7f00fb400640 1 -- 172.21.15.2:0/3028379901 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e00034e0 con 0x7f00fc0c9740 2024-08-17T02:49:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.765+0000 7f00f3400640 1 -- 172.21.15.2:0/3028379901 >> v1:172.21.15.26:6789/0 conn(0x7f00fc0abdf0 legacy=0x7f00fc159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.765+0000 7f00fb400640 1 -- 172.21.15.2:0/3028379901 <== mon.1 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686458770 0 0) 0x7f00fc0ad5f0 con 0x7f00fc0abdf0 2024-08-17T02:49:47.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.765+0000 7f00f3400640 1 -- 172.21.15.2:0/3028379901 >> v1:172.21.15.2:6789/0 conn(0x7f00fc0c9740 legacy=0x7f00fc0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.765+0000 7f00f3400640 1 -- 172.21.15.2:0/3028379901 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc159ec0 con 0x7f00fc0acc60 2024-08-17T02:49:47.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.766+0000 7f00f3400640 1 --2- 172.21.15.2:0/3028379901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0acc60 0x7f00fc0ad0b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009880 tx=0x7f00e40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaeec045156aa610 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f00fb400640 1 -- 172.21.15.2:0/3028379901 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e402ae10 con 0x7f00fc0acc60 2024-08-17T02:49:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f00fb400640 1 -- 172.21.15.2:0/3028379901 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e4032440 con 0x7f00fc0acc60 2024-08-17T02:49:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f00fb400640 1 -- 172.21.15.2:0/3028379901 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e40327e0 con 0x7f00fc0acc60 2024-08-17T02:49:47.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f0101c00640 1 -- 172.21.15.2:0/3028379901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0acc60 msgr2=0x7f00fc0ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f0101c00640 1 --2- 172.21.15.2:0/3028379901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0acc60 0x7f00fc0ad0b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009880 tx=0x7f00e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f0101c00640 1 -- 172.21.15.2:0/3028379901 shutdown_connections 2024-08-17T02:49:47.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f0101c00640 1 --2- 172.21.15.2:0/3028379901 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0acc60 0x7f00fc0ad0b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f0101c00640 1 -- 172.21.15.2:0/3028379901 >> 172.21.15.2:0/3028379901 conn(0x7f00fc066e60 msgr2=0x7f00fc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:47.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.767+0000 7f0101c00640 1 -- 172.21.15.2:0/3028379901 shutdown_connections 2024-08-17T02:49:47.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.768+0000 7f0101c00640 1 -- 172.21.15.2:0/3028379901 wait complete. 2024-08-17T02:49:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.769+0000 7f0101c00640 1 Processor -- start 2024-08-17T02:49:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.769+0000 7f0101c00640 1 -- start start 2024-08-17T02:49:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101c00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0abdf0 0x7f00fc14a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101c00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00fc0acc60 0x7f00fc0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00fc0c9740 0x7f00fc0a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0aafe0 con 0x7f00fc0c9740 2024-08-17T02:49:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101c00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0cae70 con 0x7f00fc0acc60 2024-08-17T02:49:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101c00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0aa3d0 con 0x7f00fc0abdf0 2024-08-17T02:49:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00fc0c9740 0x7f00fc0a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00fc0c9740 0x7f00fc0a9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48030/0 (socket says 172.21.15.2:48030) 2024-08-17T02:49:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f0101200640 1 -- 172.21.15.2:0/671855689 learned_addr learned my addr 172.21.15.2:0/671855689 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f00fbe00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0abdf0 0x7f00fc14a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.770+0000 7f00f3400640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00fc0acc60 0x7f00fc0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f0101200640 1 -- 172.21.15.2:0/671855689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0abdf0 msgr2=0x7f00fc14a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f0101200640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0abdf0 0x7f00fc14a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f0101200640 1 -- 172.21.15.2:0/671855689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00fc0acc60 msgr2=0x7f00fc0a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f0101200640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00fc0acc60 0x7f00fc0a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f0101200640 1 -- 172.21.15.2:0/671855689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e4009390 con 0x7f00fc0c9740 2024-08-17T02:49:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f0101200640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00fc0c9740 0x7f00fc0a9d40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f00f4001460 tx=0x7f00f4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f00f3e00640 1 -- 172.21.15.2:0/671855689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400ce30 con 0x7f00fc0c9740 2024-08-17T02:49:47.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f00f3e00640 1 -- 172.21.15.2:0/671855689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f400a850 con 0x7f00fc0c9740 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc0aa6b0 con 0x7f00fc0c9740 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f00f3e00640 1 -- 172.21.15.2:0/671855689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400ac50 con 0x7f00fc0c9740 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.771+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc0aac70 con 0x7f00fc0c9740 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.772+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc0ab150 con 0x7f00fc0c9740 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.773+0000 7f00f3e00640 1 -- 172.21.15.2:0/671855689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f00f4007300 con 0x7f00fc0c9740 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.774+0000 7f00f3e00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f00d8065150 0x7f00d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.774+0000 7f00f3e00640 1 -- 172.21.15.2:0/671855689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f00f4082400 con 0x7f00fc0c9740 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.774+0000 7f00fbe00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f00d8065150 0x7f00d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:47.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.775+0000 7f00fbe00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f00d8065150 0x7f00d8067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0011e0 tx=0x7f00ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:47.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.778+0000 7f00f3e00640 1 -- 172.21.15.2:0/671855689 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f00f40506b0 con 0x7f00fc0c9740 2024-08-17T02:49:47.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.960+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f00fc159c00 con 0x7f00d8065150 2024-08-17T02:49:47.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.960+0000 7f00f3e00640 1 -- 172.21.15.2:0/671855689 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f00fc159c00 con 0x7f00d8065150 2024-08-17T02:49:47.962 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:49:47.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f00d8065150 msgr2=0x7f00d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f00d8065150 0x7f00d8067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0011e0 tx=0x7f00ec009040 comp rx=0 tx=0).stop 2024-08-17T02:49:47.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00fc0c9740 msgr2=0x7f00fc0a9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:47.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00fc0c9740 0x7f00fc0a9d40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f00f4001460 tx=0x7f00f4001a40 comp rx=0 tx=0).stop 2024-08-17T02:49:47.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 shutdown_connections 2024-08-17T02:49:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00fc0c9740 0x7f00fc0a9d40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00fc0acc60 0x7f00fc0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f00d8065150 0x7f00d8067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 --2- 172.21.15.2:0/671855689 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f00fc0abdf0 0x7f00fc14a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 >> 172.21.15.2:0/671855689 conn(0x7f00fc066e60 msgr2=0x7f00fc0afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 shutdown_connections 2024-08-17T02:49:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:47.963+0000 7f0101c00640 1 -- 172.21.15.2:0/671855689 wait complete. 2024-08-17T02:49:47.980 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:49:47.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:48.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.134+0000 7f1313200640 1 Processor -- start 2024-08-17T02:49:48.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.135+0000 7f1313200640 1 -- start start 2024-08-17T02:49:48.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1313200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314153060 0x7f1314156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1313200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1314068d80 0x7f131415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1313200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131415b290 con 0x7f1314159b40 2024-08-17T02:49:48.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1313200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131415a680 con 0x7f1314068d80 2024-08-17T02:49:48.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1313200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131415a960 con 0x7f1314153060 2024-08-17T02:49:48.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1311400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1314159b40 0x7f1314068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56724/0 (socket says 172.21.15.2:56724) 2024-08-17T02:49:48.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1311400640 1 -- 172.21.15.2:0/1601370615 learned_addr learned my addr 172.21.15.2:0/1601370615 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:48.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1311e00640 1 --2- 172.21.15.2:0/1601370615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314153060 0x7f1314156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.136+0000 7f1312800640 1 --2- 172.21.15.2:0/1601370615 >> v2:172.21.15.26:3300/0 conn(0x7f1314068d80 0x7f131415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.137+0000 7f1310a00640 1 -- 172.21.15.2:0/1601370615 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439690256 0 0) 0x7f131415b290 con 0x7f1314159b40 2024-08-17T02:49:48.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.137+0000 7f1310a00640 1 -- 172.21.15.2:0/1601370615 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f80034e0 con 0x7f1314159b40 2024-08-17T02:49:48.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.137+0000 7f1311e00640 1 -- 172.21.15.2:0/1601370615 >> v2:172.21.15.26:3300/0 conn(0x7f1314068d80 msgr2=0x7f131415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:48.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.137+0000 7f1311e00640 1 --2- 172.21.15.2:0/1601370615 >> v2:172.21.15.26:3300/0 conn(0x7f1314068d80 0x7f131415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.137+0000 7f1311e00640 1 -- 172.21.15.2:0/1601370615 >> v1:172.21.15.2:6789/0 conn(0x7f1314159b40 legacy=0x7f1314068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.137+0000 7f1311e00640 1 -- 172.21.15.2:0/1601370615 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131415ac40 con 0x7f1314153060 2024-08-17T02:49:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.138+0000 7f1311e00640 1 --2- 172.21.15.2:0/1601370615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314153060 0x7f1314156d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1304009850 tx=0x7f13040090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9fac8b5373602fd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.138+0000 7f1310a00640 1 -- 172.21.15.2:0/1601370615 <== mon.2 v2:172.21.15.26:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130402ad90 con 0x7f1314153060 2024-08-17T02:49:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.138+0000 7f1310a00640 1 -- 172.21.15.2:0/1601370615 <== mon.2 v2:172.21.15.26:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304032440 con 0x7f1314153060 2024-08-17T02:49:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.138+0000 7f1310a00640 1 -- 172.21.15.2:0/1601370615 <== mon.2 v2:172.21.15.26:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304032820 con 0x7f1314153060 2024-08-17T02:49:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.139+0000 7f1313200640 1 -- 172.21.15.2:0/1601370615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314153060 msgr2=0x7f1314156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.139+0000 7f1313200640 1 --2- 172.21.15.2:0/1601370615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314153060 0x7f1314156d30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1304009850 tx=0x7f13040090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.139+0000 7f1313200640 1 -- 172.21.15.2:0/1601370615 shutdown_connections 2024-08-17T02:49:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.139+0000 7f1313200640 1 --2- 172.21.15.2:0/1601370615 >> v2:172.21.15.26:3300/0 conn(0x7f1314068d80 0x7f131415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.139+0000 7f1313200640 1 --2- 172.21.15.2:0/1601370615 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314153060 0x7f1314156d30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.139+0000 7f1313200640 1 -- 172.21.15.2:0/1601370615 >> 172.21.15.2:0/1601370615 conn(0x7f131406f010 msgr2=0x7f1314087000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.139+0000 7f1313200640 1 -- 172.21.15.2:0/1601370615 shutdown_connections 2024-08-17T02:49:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.139+0000 7f1313200640 1 -- 172.21.15.2:0/1601370615 wait complete. 2024-08-17T02:49:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.140+0000 7f1313200640 1 Processor -- start 2024-08-17T02:49:48.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.140+0000 7f1313200640 1 -- start start 2024-08-17T02:49:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.141+0000 7f1313200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1314068d80 0x7f1314153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.141+0000 7f1313200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314153060 0x7f131415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.141+0000 7f1313200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314159b40 0x7f1314152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.141+0000 7f1313200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131415df80 con 0x7f1314153060 2024-08-17T02:49:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.141+0000 7f1313200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314168ad0 con 0x7f1314068d80 2024-08-17T02:49:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.141+0000 7f1313200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1314168db0 con 0x7f1314159b40 2024-08-17T02:49:48.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.141+0000 7f1311400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314153060 0x7f131415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314153060 0x7f131415d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48044/0 (socket says 172.21.15.2:48044) 2024-08-17T02:49:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311400640 1 -- 172.21.15.2:0/4224318470 learned_addr learned my addr 172.21.15.2:0/4224318470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1312800640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314159b40 0x7f1314152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311e00640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1314068d80 0x7f1314153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311400640 1 -- 172.21.15.2:0/4224318470 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314159b40 msgr2=0x7f1314152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311400640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f1314159b40 0x7f1314152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311400640 1 -- 172.21.15.2:0/4224318470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1314068d80 msgr2=0x7f1314153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311400640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1314068d80 0x7f1314153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311400640 1 -- 172.21.15.2:0/4224318470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009390 con 0x7f1314153060 2024-08-17T02:49:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1311400640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314153060 0x7f131415d5a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f130000c590 tx=0x7f1300007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300005b70 con 0x7f1314153060 2024-08-17T02:49:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300005cf0 con 0x7f1314153060 2024-08-17T02:49:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300007320 con 0x7f1314153060 2024-08-17T02:49:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.142+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1314169090 con 0x7f1314153060 2024-08-17T02:49:48.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.143+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131415c7d0 con 0x7f1314153060 2024-08-17T02:49:48.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.143+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f131415c9f0 con 0x7f1314153060 2024-08-17T02:49:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.144+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1300012400 con 0x7f1314153060 2024-08-17T02:49:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.146+0000 7f1309600640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12f4065150 0x7f12f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.146+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1300081790 con 0x7f1314153060 2024-08-17T02:49:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.146+0000 7f1309600640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f12f406b040 0x7f12f406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.146+0000 7f1311e00640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12f4065150 0x7f12f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.146+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 --> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12f406db00 con 0x7f12f406b040 2024-08-17T02:49:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.146+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1300083c90 con 0x7f1314153060 2024-08-17T02:49:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.146+0000 7f1312800640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f12f406b040 0x7f12f406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.147+0000 7f1311e00640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12f4065150 0x7f12f4067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1304034000 tx=0x7f1304032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.147+0000 7f1312800640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f12f406b040 0x7f12f406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.147+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 <== osd.3 v2:172.21.15.2:6816/36949 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f12f406db00 con 0x7f12f406b040 2024-08-17T02:49:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.160+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 --> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1314063f10 con 0x7f12f406b040 2024-08-17T02:49:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1309600640 1 -- 172.21.15.2:0/4224318470 <== osd.3 v2:172.21.15.2:6816/36949 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1314063f10 con 0x7f12f406b040 2024-08-17T02:49:48.162 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:49:48.162 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:48.162 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:49:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f12f406b040 msgr2=0x7f12f406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6816/36949,v1:172.21.15.2:6817/36949] conn(0x7f12f406b040 0x7f12f406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12f4065150 msgr2=0x7f12f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f12f4065150 0x7f12f4067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1304034000 tx=0x7f1304032000 comp rx=0 tx=0).stop 2024-08-17T02:49:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314153060 msgr2=0x7f131415d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 --2- 172.21.15.2:0/4224318470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1314153060 0x7f131415d5a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f130000c590 tx=0x7f1300007d70 comp rx=0 tx=0).stop 2024-08-17T02:49:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1312800640 1 -- 172.21.15.2:0/4224318470 reap_dead start 2024-08-17T02:49:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 shutdown_connections 2024-08-17T02:49:48.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 >> 172.21.15.2:0/4224318470 conn(0x7f131406f010 msgr2=0x7f1314158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 shutdown_connections 2024-08-17T02:49:48.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.161+0000 7f1313200640 1 -- 172.21.15.2:0/4224318470 wait complete. 2024-08-17T02:49:48.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:49:48.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.328+0000 7f2cc4a00640 1 Processor -- start 2024-08-17T02:49:48.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.328+0000 7f2cc4a00640 1 -- start start 2024-08-17T02:49:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.329+0000 7f2cc4a00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2cc0155040 0x7f2cc0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.329+0000 7f2cc4a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00aeeb0 con 0x7f2cc006e770 2024-08-17T02:49:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.329+0000 7f2cc4a00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00aadd0 con 0x7f2cc01591c0 2024-08-17T02:49:48.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.329+0000 7f2cc4a00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc0159610 con 0x7f2cc0155040 2024-08-17T02:49:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.329+0000 7f2cbe800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2cc006e770 0x7f2cc00af340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56730/0 (socket says 172.21.15.2:56730) 2024-08-17T02:49:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.329+0000 7f2cbe800640 1 -- 172.21.15.2:0/2363554033 learned_addr learned my addr 172.21.15.2:0/2363554033 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:49:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.330+0000 7f2cbde00640 1 --2- 172.21.15.2:0/2363554033 >> v2:172.21.15.26:3300/0 conn(0x7f2cc0155040 0x7f2cc0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.330+0000 7f2cbca00640 1 -- 172.21.15.2:0/2363554033 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134175241 0 0) 0x7f2cc00aeeb0 con 0x7f2cc006e770 2024-08-17T02:49:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.330+0000 7f2cbca00640 1 -- 172.21.15.2:0/2363554033 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca40034e0 con 0x7f2cc006e770 2024-08-17T02:49:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.330+0000 7f2cbde00640 1 -- 172.21.15.2:0/2363554033 >> v1:172.21.15.26:6789/0 conn(0x7f2cc01591c0 legacy=0x7f2cc006e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.330+0000 7f2cbde00640 1 -- 172.21.15.2:0/2363554033 >> v1:172.21.15.2:6789/0 conn(0x7f2cc006e770 legacy=0x7f2cc00af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.330+0000 7f2cbde00640 1 -- 172.21.15.2:0/2363554033 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc01597f0 con 0x7f2cc0155040 2024-08-17T02:49:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.331+0000 7f2cbde00640 1 --2- 172.21.15.2:0/2363554033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0155040 0x7f2cc0158c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009850 tx=0x7f2cb00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f84a5f73d476b17 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cbca00640 1 -- 172.21.15.2:0/2363554033 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb002ad00 con 0x7f2cc0155040 2024-08-17T02:49:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cbca00640 1 -- 172.21.15.2:0/2363554033 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb002ae60 con 0x7f2cc0155040 2024-08-17T02:49:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cbca00640 1 -- 172.21.15.2:0/2363554033 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0032650 con 0x7f2cc0155040 2024-08-17T02:49:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2363554033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0155040 msgr2=0x7f2cc0158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cc4a00640 1 --2- 172.21.15.2:0/2363554033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0155040 0x7f2cc0158c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009850 tx=0x7f2cb00090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2363554033 shutdown_connections 2024-08-17T02:49:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cc4a00640 1 --2- 172.21.15.2:0/2363554033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc0155040 0x7f2cc0158c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2363554033 >> 172.21.15.2:0/2363554033 conn(0x7f2cc0066e60 msgr2=0x7f2cc0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2363554033 shutdown_connections 2024-08-17T02:49:48.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.332+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2363554033 wait complete. 2024-08-17T02:49:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.334+0000 7f2cc4a00640 1 Processor -- start 2024-08-17T02:49:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.334+0000 7f2cc4a00640 1 -- start start 2024-08-17T02:49:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cc4a00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc006e770 0x7f2cc01692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cc4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc0155040 0x7f2cc014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cc4a00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc01591c0 0x7f2cc0158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cc4a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0169830 con 0x7f2cc0155040 2024-08-17T02:49:48.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cc4a00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0158f70 con 0x7f2cc01591c0 2024-08-17T02:49:48.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cc4a00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0156480 con 0x7f2cc006e770 2024-08-17T02:49:48.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc0155040 0x7f2cc014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc0155040 0x7f2cc014c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48058/0 (socket says 172.21.15.2:48058) 2024-08-17T02:49:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbd400640 1 -- 172.21.15.2:0/2831836558 learned_addr learned my addr 172.21.15.2:0/2831836558 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbde00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc006e770 0x7f2cc01692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbe800640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc01591c0 0x7f2cc0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbd400640 1 -- 172.21.15.2:0/2831836558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc006e770 msgr2=0x7f2cc01692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbd400640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc006e770 0x7f2cc01692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbd400640 1 -- 172.21.15.2:0/2831836558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc01591c0 msgr2=0x7f2cc0158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbd400640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc01591c0 0x7f2cc0158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.335+0000 7f2cbd400640 1 -- 172.21.15.2:0/2831836558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb0009390 con 0x7f2cc0155040 2024-08-17T02:49:48.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.336+0000 7f2cbd400640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc0155040 0x7f2cc014c2e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00c4c0 tx=0x7f2cac007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.336+0000 7f2cb5600640 1 -- 172.21.15.2:0/2831836558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac011590 con 0x7f2cc0155040 2024-08-17T02:49:48.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.336+0000 7f2cb5600640 1 -- 172.21.15.2:0/2831836558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac0116f0 con 0x7f2cc0155040 2024-08-17T02:49:48.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.336+0000 7f2cb5600640 1 -- 172.21.15.2:0/2831836558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac011ab0 con 0x7f2cc0155040 2024-08-17T02:49:48.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.336+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc0156760 con 0x7f2cc0155040 2024-08-17T02:49:48.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.336+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc0156af0 con 0x7f2cc0155040 2024-08-17T02:49:48.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.337+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc0063fb0 con 0x7f2cc0155040 2024-08-17T02:49:48.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.338+0000 7f2cb5600640 1 -- 172.21.15.2:0/2831836558 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2cac01b3b0 con 0x7f2cc0155040 2024-08-17T02:49:48.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.339+0000 7f2cb5600640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2ca0065150 0x7f2ca0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.339+0000 7f2cb5600640 1 -- 172.21.15.2:0/2831836558 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2cac081670 con 0x7f2cc0155040 2024-08-17T02:49:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.339+0000 7f2cbde00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2ca0065150 0x7f2ca0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.340+0000 7f2cbde00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2ca0065150 0x7f2ca0067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0034000 tx=0x7f2cb0032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.343+0000 7f2cb5600640 1 -- 172.21.15.2:0/2831836558 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2cac04f930 con 0x7f2cc0155040 2024-08-17T02:49:48.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.526+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cc00b0350 con 0x7f2ca0065150 2024-08-17T02:49:48.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.526+0000 7f2cb5600640 1 -- 172.21.15.2:0/2831836558 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2cc00b0350 con 0x7f2ca0065150 2024-08-17T02:49:48.528 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:49:48.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2ca0065150 msgr2=0x7f2ca0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2ca0065150 0x7f2ca0067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0034000 tx=0x7f2cb0032000 comp rx=0 tx=0).stop 2024-08-17T02:49:48.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc0155040 msgr2=0x7f2cc014c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc0155040 0x7f2cc014c2e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00c4c0 tx=0x7f2cac007ea0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 shutdown_connections 2024-08-17T02:49:48.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cc01591c0 0x7f2cc0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc0155040 0x7f2cc014c2e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2ca0065150 0x7f2ca0067600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 --2- 172.21.15.2:0/2831836558 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2cc006e770 0x7f2cc01692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.528+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 >> 172.21.15.2:0/2831836558 conn(0x7f2cc0066e60 msgr2=0x7f2cc00a9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:48.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.529+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 shutdown_connections 2024-08-17T02:49:48.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.529+0000 7f2cc4a00640 1 -- 172.21.15.2:0/2831836558 wait complete. 2024-08-17T02:49:48.544 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:49:48.545 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:48.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.699+0000 7f9e1ec00640 1 Processor -- start 2024-08-17T02:49:48.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.699+0000 7f9e1ec00640 1 -- start start 2024-08-17T02:49:48.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1ec00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ad020 0x7f9e18159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1ec00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e180afa00 0x7f9e180afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1ec00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e180b03a0 con 0x7f9e180ac000 2024-08-17T02:49:48.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1ec00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e18159ad0 con 0x7f9e180afa00 2024-08-17T02:49:48.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1ec00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180ad590 con 0x7f9e180ad020 2024-08-17T02:49:48.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1cc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e180afa00 0x7f9e180afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1cc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e180afa00 0x7f9e180afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48068/0 (socket says 172.21.15.2:48068) 2024-08-17T02:49:48.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1cc00640 1 -- 172.21.15.2:0/3382461387 learned_addr learned my addr 172.21.15.2:0/3382461387 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:48.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e0f400640 1 --2- 172.21.15.2:0/3382461387 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ad020 0x7f9e18159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1cc00640 1 -- 172.21.15.2:0/3382461387 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ad020 msgr2=0x7f9e18159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:48.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1cc00640 1 --2- 172.21.15.2:0/3382461387 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ad020 0x7f9e18159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1cc00640 1 -- 172.21.15.2:0/3382461387 >> v1:172.21.15.2:6789/0 conn(0x7f9e180ac000 legacy=0x7f9e18156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.701+0000 7f9e1cc00640 1 -- 172.21.15.2:0/3382461387 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180ad870 con 0x7f9e180afa00 2024-08-17T02:49:48.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.702+0000 7f9e1cc00640 1 --2- 172.21.15.2:0/3382461387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180afa00 0x7f9e180afe60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009f20 tx=0x7f9e10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ef79000225aace server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e17400640 1 -- 172.21.15.2:0/3382461387 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10031400 con 0x7f9e180afa00 2024-08-17T02:49:48.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e17400640 1 -- 172.21.15.2:0/3382461387 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1002d050 con 0x7f9e180afa00 2024-08-17T02:49:48.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e17400640 1 -- 172.21.15.2:0/3382461387 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e100317d0 con 0x7f9e180afa00 2024-08-17T02:49:48.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3382461387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180afa00 msgr2=0x7f9e180afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e1ec00640 1 --2- 172.21.15.2:0/3382461387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180afa00 0x7f9e180afe60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009f20 tx=0x7f9e10009840 comp rx=0 tx=0).stop 2024-08-17T02:49:48.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3382461387 shutdown_connections 2024-08-17T02:49:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e1ec00640 1 --2- 172.21.15.2:0/3382461387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180afa00 0x7f9e180afe60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e1ec00640 1 --2- 172.21.15.2:0/3382461387 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ad020 0x7f9e18159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3382461387 >> 172.21.15.2:0/3382461387 conn(0x7f9e18066e60 msgr2=0x7f9e18067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3382461387 shutdown_connections 2024-08-17T02:49:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.703+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3382461387 wait complete. 2024-08-17T02:49:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.705+0000 7f9e1ec00640 1 Processor -- start 2024-08-17T02:49:48.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.705+0000 7f9e1ec00640 1 -- start start 2024-08-17T02:49:48.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e1ec00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ac000 0x7f9e180a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e1ec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180ad020 0x7f9e180a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e1ec00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e180afa00 0x7f9e180a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e1ec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18153a70 con 0x7f9e180ad020 2024-08-17T02:49:48.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e1ec00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1814e650 con 0x7f9e180afa00 2024-08-17T02:49:48.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e1ec00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18154870 con 0x7f9e180ac000 2024-08-17T02:49:48.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e0f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180ad020 0x7f9e180a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e0f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180ad020 0x7f9e180a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48072/0 (socket says 172.21.15.2:48072) 2024-08-17T02:49:48.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e0f400640 1 -- 172.21.15.2:0/3454701553 learned_addr learned my addr 172.21.15.2:0/3454701553 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:48.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e17e00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ac000 0x7f9e180a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.706+0000 7f9e1cc00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e180afa00 0x7f9e180a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0f400640 1 -- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ac000 msgr2=0x7f9e180a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0f400640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9e180ac000 0x7f9e180a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0f400640 1 -- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e180afa00 msgr2=0x7f9e180a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0f400640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e180afa00 0x7f9e180a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0f400640 1 -- 172.21.15.2:0/3454701553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10009ae0 con 0x7f9e180ad020 2024-08-17T02:49:48.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e1cc00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e180afa00 0x7f9e180a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:48.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0f400640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180ad020 0x7f9e180a8f20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000d8c0 tx=0x7f9e00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0000de50 con 0x7f9e180ad020 2024-08-17T02:49:48.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000098b0 con 0x7f9e180ad020 2024-08-17T02:49:48.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e18140e80 con 0x7f9e180ad020 2024-08-17T02:49:48.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00009c50 con 0x7f9e180ad020 2024-08-17T02:49:48.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.707+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e18153d10 con 0x7f9e180ad020 2024-08-17T02:49:48.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.708+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e18063fb0 con 0x7f9e180ad020 2024-08-17T02:49:48.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.709+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e00014620 con 0x7f9e180ad020 2024-08-17T02:49:48.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.710+0000 7f9e0fe00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9df4065180 0x7f9df4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.710+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9e00082920 con 0x7f9e180ad020 2024-08-17T02:49:48.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.710+0000 7f9e0fe00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7f9df406b070 0x7f9df406d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.710+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 --> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9df406db30 con 0x7f9df406b070 2024-08-17T02:49:48.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.710+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e00087240 con 0x7f9e180ad020 2024-08-17T02:49:48.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.710+0000 7f9e17e00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9df4065180 0x7f9df4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.711+0000 7f9e1cc00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7f9df406b070 0x7f9df406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.711+0000 7f9e17e00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9df4065180 0x7f9df4067630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e08003720 tx=0x7f9e08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.711+0000 7f9e1cc00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7f9df406b070 0x7f9df406d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.712+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 <== osd.4 v2:172.21.15.26:6816/37447 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9df406db30 con 0x7f9df406b070 2024-08-17T02:49:48.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.725+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 --> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e18067c10 con 0x7f9df406b070 2024-08-17T02:49:48.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e0fe00640 1 -- 172.21.15.2:0/3454701553 <== osd.4 v2:172.21.15.26:6816/37447 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9e18067c10 con 0x7f9df406b070 2024-08-17T02:49:48.727 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:49:48.727 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:48.727 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:49:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7f9df406b070 msgr2=0x7f9df406d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.26:6816/37447,v1:172.21.15.26:6817/37447] conn(0x7f9df406b070 0x7f9df406d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9df4065180 msgr2=0x7f9df4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f9df4065180 0x7f9df4067630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e08003720 tx=0x7f9e08009040 comp rx=0 tx=0).stop 2024-08-17T02:49:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180ad020 msgr2=0x7f9e180a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 --2- 172.21.15.2:0/3454701553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e180ad020 0x7f9e180a8f20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000d8c0 tx=0x7f9e00008040 comp rx=0 tx=0).stop 2024-08-17T02:49:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1cc00640 1 -- 172.21.15.2:0/3454701553 reap_dead start 2024-08-17T02:49:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 shutdown_connections 2024-08-17T02:49:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 >> 172.21.15.2:0/3454701553 conn(0x7f9e18066e60 msgr2=0x7f9e181528b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 shutdown_connections 2024-08-17T02:49:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.726+0000 7f9e1ec00640 1 -- 172.21.15.2:0/3454701553 wait complete. 2024-08-17T02:49:48.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:49:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.892+0000 7f2bab000640 1 Processor -- start 2024-08-17T02:49:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.892+0000 7f2bab000640 1 -- start start 2024-08-17T02:49:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.893+0000 7f2bab000640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ba4158f20 0x7f2ba4062f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.893+0000 7f2bab000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ba415a950 0x7f2ba40a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.893+0000 7f2bab000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba40a9a90 con 0x7f2ba40a9630 2024-08-17T02:49:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.893+0000 7f2bab000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba4067510 con 0x7f2ba415a950 2024-08-17T02:49:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.893+0000 7f2bab000640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba4066f00 con 0x7f2ba4158f20 2024-08-17T02:49:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ba415a950 0x7f2ba40a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ba415a950 0x7f2ba40a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48086/0 (socket says 172.21.15.2:48086) 2024-08-17T02:49:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3400640 1 -- 172.21.15.2:0/1140981046 learned_addr learned my addr 172.21.15.2:0/1140981046 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3e00640 1 --2- 172.21.15.2:0/1140981046 >> v2:172.21.15.26:3300/0 conn(0x7f2ba4158f20 0x7f2ba4062f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3400640 1 -- 172.21.15.2:0/1140981046 >> v2:172.21.15.26:3300/0 conn(0x7f2ba4158f20 msgr2=0x7f2ba4062f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3400640 1 --2- 172.21.15.2:0/1140981046 >> v2:172.21.15.26:3300/0 conn(0x7f2ba4158f20 0x7f2ba4062f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3400640 1 -- 172.21.15.2:0/1140981046 >> v1:172.21.15.26:6789/0 conn(0x7f2ba40a9630 legacy=0x7f2ba40679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3400640 1 -- 172.21.15.2:0/1140981046 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba40ccda0 con 0x7f2ba415a950 2024-08-17T02:49:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.894+0000 7f2ba3e00640 1 --2- 172.21.15.2:0/1140981046 >> v2:172.21.15.26:3300/0 conn(0x7f2ba4158f20 0x7f2ba4062f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.895+0000 7f2ba3400640 1 --2- 172.21.15.2:0/1140981046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba415a950 0x7f2ba40a90f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4095d10 tx=0x7f2b900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d834d95f8a9f859 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.895+0000 7f2ba2a00640 1 -- 172.21.15.2:0/1140981046 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9002adb0 con 0x7f2ba415a950 2024-08-17T02:49:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2ba2a00640 1 -- 172.21.15.2:0/1140981046 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b90032440 con 0x7f2ba415a950 2024-08-17T02:49:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2ba2a00640 1 -- 172.21.15.2:0/1140981046 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90032820 con 0x7f2ba415a950 2024-08-17T02:49:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2bab000640 1 -- 172.21.15.2:0/1140981046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba415a950 msgr2=0x7f2ba40a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2bab000640 1 --2- 172.21.15.2:0/1140981046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba415a950 0x7f2ba40a90f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4095d10 tx=0x7f2b900091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2bab000640 1 -- 172.21.15.2:0/1140981046 shutdown_connections 2024-08-17T02:49:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2bab000640 1 --2- 172.21.15.2:0/1140981046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba415a950 0x7f2ba40a90f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2bab000640 1 --2- 172.21.15.2:0/1140981046 >> v2:172.21.15.26:3300/0 conn(0x7f2ba4158f20 0x7f2ba4062f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2bab000640 1 -- 172.21.15.2:0/1140981046 >> 172.21.15.2:0/1140981046 conn(0x7f2ba406e5b0 msgr2=0x7f2ba40b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2bab000640 1 -- 172.21.15.2:0/1140981046 shutdown_connections 2024-08-17T02:49:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.896+0000 7f2bab000640 1 -- 172.21.15.2:0/1140981046 wait complete. 2024-08-17T02:49:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.898+0000 7f2bab000640 1 Processor -- start 2024-08-17T02:49:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.898+0000 7f2bab000640 1 -- start start 2024-08-17T02:49:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2bab000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba40a9630 0x7f2ba4153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2bab000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ba4158f20 0x7f2ba406b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2bab000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba415a950 0x7f2ba40ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2bab000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba414e5e0 con 0x7f2ba40a9630 2024-08-17T02:49:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2bab000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4153f40 con 0x7f2ba415a950 2024-08-17T02:49:48.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2bab000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4154220 con 0x7f2ba4158f20 2024-08-17T02:49:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba40a9630 0x7f2ba4153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba40a9630 0x7f2ba4153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48100/0 (socket says 172.21.15.2:48100) 2024-08-17T02:49:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 -- 172.21.15.2:0/1223201296 learned_addr learned my addr 172.21.15.2:0/1223201296 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 -- 172.21.15.2:0/1223201296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ba4158f20 msgr2=0x7f2ba406b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ba4158f20 0x7f2ba406b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 -- 172.21.15.2:0/1223201296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba415a950 msgr2=0x7f2ba40ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba415a950 0x7f2ba40ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 -- 172.21.15.2:0/1223201296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009450 con 0x7f2ba40a9630 2024-08-17T02:49:48.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.899+0000 7f2ba3e00640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba40a9630 0x7f2ba4153950 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c880 tx=0x7f2b94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.900+0000 7f2b9b400640 1 -- 172.21.15.2:0/1223201296 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400ce10 con 0x7f2ba40a9630 2024-08-17T02:49:48.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.900+0000 7f2b9b400640 1 -- 172.21.15.2:0/1223201296 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94007890 con 0x7f2ba40a9630 2024-08-17T02:49:48.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.900+0000 7f2b9b400640 1 -- 172.21.15.2:0/1223201296 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94007c10 con 0x7f2ba40a9630 2024-08-17T02:49:48.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.900+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba4154500 con 0x7f2ba40a9630 2024-08-17T02:49:48.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.900+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba406b800 con 0x7f2ba40a9630 2024-08-17T02:49:48.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.901+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba4063fb0 con 0x7f2ba40a9630 2024-08-17T02:49:48.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.902+0000 7f2b9b400640 1 -- 172.21.15.2:0/1223201296 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b940113f0 con 0x7f2ba40a9630 2024-08-17T02:49:48.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.902+0000 7f2b9b400640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b84065150 0x7f2b84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:48.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.903+0000 7f2b9b400640 1 -- 172.21.15.2:0/1223201296 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2b94082240 con 0x7f2ba40a9630 2024-08-17T02:49:48.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.903+0000 7f2ba3400640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b84065150 0x7f2b84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:48.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.903+0000 7f2ba3400640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b84065150 0x7f2b84067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2b90034000 tx=0x7f2b90032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:48.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:48.906+0000 7f2b9b400640 1 -- 172.21.15.2:0/1223201296 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2b94053f90 con 0x7f2ba40a9630 2024-08-17T02:49:49.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.092+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ba414e720 con 0x7f2b84065150 2024-08-17T02:49:49.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.092+0000 7f2b9b400640 1 -- 172.21.15.2:0/1223201296 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2b90032640 con 0x7f2b84065150 2024-08-17T02:49:49.093 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:49:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b84065150 msgr2=0x7f2b84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b84065150 0x7f2b84067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2b90034000 tx=0x7f2b90032000 comp rx=0 tx=0).stop 2024-08-17T02:49:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba40a9630 msgr2=0x7f2ba4153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba40a9630 0x7f2ba4153950 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c880 tx=0x7f2b94008040 comp rx=0 tx=0).stop 2024-08-17T02:49:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 shutdown_connections 2024-08-17T02:49:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ba415a950 0x7f2ba40ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f2b84065150 0x7f2b84067600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f2ba4158f20 0x7f2ba406b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 --2- 172.21.15.2:0/1223201296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ba40a9630 0x7f2ba4153950 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 >> 172.21.15.2:0/1223201296 conn(0x7f2ba406e5b0 msgr2=0x7f2ba415b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 shutdown_connections 2024-08-17T02:49:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.094+0000 7f2bab000640 1 -- 172.21.15.2:0/1223201296 wait complete. 2024-08-17T02:49:49.111 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:49:49.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:49.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.265+0000 7fde7a200640 1 Processor -- start 2024-08-17T02:49:49.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.265+0000 7fde7a200640 1 -- start start 2024-08-17T02:49:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.266+0000 7fde7a200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde74156a90 0x7fde740ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.266+0000 7fde7a200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde740adba0 0x7fde740ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde7a200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde741582b0 con 0x7fde740aed30 2024-08-17T02:49:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde7a200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde740c9f80 con 0x7fde740adba0 2024-08-17T02:49:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde7a200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde740ca110 con 0x7fde74156a90 2024-08-17T02:49:49.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde6be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde740adba0 0x7fde740ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde6be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde740adba0 0x7fde740ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48108/0 (socket says 172.21.15.2:48108) 2024-08-17T02:49:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde6be00640 1 -- 172.21.15.2:0/474942568 learned_addr learned my addr 172.21.15.2:0/474942568 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde73400640 1 --2- 172.21.15.2:0/474942568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde74156a90 0x7fde740ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde6be00640 1 -- 172.21.15.2:0/474942568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde74156a90 msgr2=0x7fde740ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde6be00640 1 --2- 172.21.15.2:0/474942568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde74156a90 0x7fde740ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde6be00640 1 -- 172.21.15.2:0/474942568 >> v1:172.21.15.2:6789/0 conn(0x7fde740aed30 legacy=0x7fde7406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde6be00640 1 -- 172.21.15.2:0/474942568 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740adff0 con 0x7fde740adba0 2024-08-17T02:49:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.267+0000 7fde72a00640 1 -- 172.21.15.2:0/474942568 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500876568 0 0) 0x7fde741582b0 con 0x7fde740aed30 2024-08-17T02:49:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.268+0000 7fde6be00640 1 --2- 172.21.15.2:0/474942568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 0x7fde740ae7f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009910 tx=0x7fde5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6e26f675c9c258 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde72a00640 1 -- 172.21.15.2:0/474942568 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c02ae40 con 0x7fde740adba0 2024-08-17T02:49:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde72a00640 1 -- 172.21.15.2:0/474942568 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c032440 con 0x7fde740adba0 2024-08-17T02:49:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde72a00640 1 -- 172.21.15.2:0/474942568 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0327e0 con 0x7fde740adba0 2024-08-17T02:49:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde7a200640 1 -- 172.21.15.2:0/474942568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 msgr2=0x7fde740ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde7a200640 1 --2- 172.21.15.2:0/474942568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 0x7fde740ae7f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009910 tx=0x7fde5c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde7a200640 1 -- 172.21.15.2:0/474942568 shutdown_connections 2024-08-17T02:49:49.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde7a200640 1 --2- 172.21.15.2:0/474942568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 0x7fde740ae7f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde7a200640 1 --2- 172.21.15.2:0/474942568 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde74156a90 0x7fde740ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde7a200640 1 -- 172.21.15.2:0/474942568 >> 172.21.15.2:0/474942568 conn(0x7fde74066e60 msgr2=0x7fde74067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde7a200640 1 -- 172.21.15.2:0/474942568 shutdown_connections 2024-08-17T02:49:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.269+0000 7fde7a200640 1 -- 172.21.15.2:0/474942568 wait complete. 2024-08-17T02:49:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.271+0000 7fde7a200640 1 Processor -- start 2024-08-17T02:49:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.271+0000 7fde7a200640 1 -- start start 2024-08-17T02:49:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde7a200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 0x7fde741535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde7a200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde740aed30 0x7fde740ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde7a200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde74156a90 0x7fde740abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde7a200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7415ba80 con 0x7fde740adba0 2024-08-17T02:49:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde7a200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740aa290 con 0x7fde74156a90 2024-08-17T02:49:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde7a200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde740ace40 con 0x7fde740aed30 2024-08-17T02:49:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 0x7fde741535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 0x7fde741535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48114/0 (socket says 172.21.15.2:48114) 2024-08-17T02:49:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73400640 1 -- 172.21.15.2:0/3878608738 learned_addr learned my addr 172.21.15.2:0/3878608738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde6be00640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde740aed30 0x7fde740ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73e00640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde74156a90 0x7fde740abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73400640 1 -- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde740aed30 msgr2=0x7fde740ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73400640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fde740aed30 0x7fde740ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73400640 1 -- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde74156a90 msgr2=0x7fde740abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73400640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde74156a90 0x7fde740abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.272+0000 7fde73400640 1 -- 172.21.15.2:0/3878608738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c009450 con 0x7fde740adba0 2024-08-17T02:49:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.273+0000 7fde73400640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 0x7fde741535a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fde6400d8c0 tx=0x7fde64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.273+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6400de50 con 0x7fde740adba0 2024-08-17T02:49:49.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.273+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64009850 con 0x7fde740adba0 2024-08-17T02:49:49.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.273+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64009bf0 con 0x7fde740adba0 2024-08-17T02:49:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.273+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde740a9cd0 con 0x7fde740adba0 2024-08-17T02:49:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.273+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde740acad0 con 0x7fde740adba0 2024-08-17T02:49:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.274+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde74063fb0 con 0x7fde740adba0 2024-08-17T02:49:49.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.275+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde64014410 con 0x7fde740adba0 2024-08-17T02:49:49.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.276+0000 7fde6aa00640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde50065180 0x7fde50067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.276+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fde64082970 con 0x7fde740adba0 2024-08-17T02:49:49.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.276+0000 7fde6be00640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde50065180 0x7fde50067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.276+0000 7fde6aa00640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7fde5006b070 0x7fde5006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.276+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 --> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde5006db30 con 0x7fde5006b070 2024-08-17T02:49:49.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.276+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde64087220 con 0x7fde740adba0 2024-08-17T02:49:49.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.276+0000 7fde73e00640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7fde5006b070 0x7fde5006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.277+0000 7fde6be00640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde50065180 0x7fde50067630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fde5c034000 tx=0x7fde5c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.277+0000 7fde73e00640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7fde5006b070 0x7fde5006d480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.278+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 <== osd.5 v2:172.21.15.26:6800/37445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fde5006db30 con 0x7fde5006b070 2024-08-17T02:49:49.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.291+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 --> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fde741573c0 con 0x7fde5006b070 2024-08-17T02:49:49.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde6aa00640 1 -- 172.21.15.2:0/3878608738 <== osd.5 v2:172.21.15.26:6800/37445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fde741573c0 con 0x7fde5006b070 2024-08-17T02:49:49.293 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:49:49.293 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:49.294 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:49:49.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7fde5006b070 msgr2=0x7fde5006d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.26:6800/37445,v1:172.21.15.26:6801/37445] conn(0x7fde5006b070 0x7fde5006d480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde50065180 msgr2=0x7fde50067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fde50065180 0x7fde50067630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fde5c034000 tx=0x7fde5c032000 comp rx=0 tx=0).stop 2024-08-17T02:49:49.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 msgr2=0x7fde741535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 --2- 172.21.15.2:0/3878608738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde740adba0 0x7fde741535a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fde6400d8c0 tx=0x7fde64008040 comp rx=0 tx=0).stop 2024-08-17T02:49:49.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde73e00640 1 -- 172.21.15.2:0/3878608738 reap_dead start 2024-08-17T02:49:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 shutdown_connections 2024-08-17T02:49:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 >> 172.21.15.2:0/3878608738 conn(0x7fde74066e60 msgr2=0x7fde740cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 shutdown_connections 2024-08-17T02:49:49.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.292+0000 7fde7a200640 1 -- 172.21.15.2:0/3878608738 wait complete. 2024-08-17T02:49:49.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:49:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.459+0000 7f8a34e00640 1 Processor -- start 2024-08-17T02:49:49.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.459+0000 7f8a34e00640 1 -- start start 2024-08-17T02:49:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a34e00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8a300aff00 0x7f8a30159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a34e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a300ae7f0 0x7f8a300cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a34e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a300b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a34e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a301597b0 con 0x7f8a300ae7f0 2024-08-17T02:49:49.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a34e00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a300ccd10 con 0x7f8a300aff00 2024-08-17T02:49:49.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a34e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300ccff0 con 0x7f8a300b18a0 2024-08-17T02:49:49.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a26a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a300ae7f0 0x7f8a300cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a26a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a300ae7f0 0x7f8a300cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48120/0 (socket says 172.21.15.2:48120) 2024-08-17T02:49:49.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.460+0000 7f8a26a00640 1 -- 172.21.15.2:0/2425882724 learned_addr learned my addr 172.21.15.2:0/2425882724 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a26a00640 1 -- 172.21.15.2:0/2425882724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 msgr2=0x7f8a300b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a2fe00640 1 --2- 172.21.15.2:0/2425882724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a300b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a2f400640 1 --2- 172.21.15.2:0/2425882724 >> v2:172.21.15.26:3300/0 conn(0x7f8a300aff00 0x7f8a30159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a26a00640 1 --2- 172.21.15.2:0/2425882724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a300b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a26a00640 1 -- 172.21.15.2:0/2425882724 >> v2:172.21.15.26:3300/0 conn(0x7f8a300aff00 msgr2=0x7f8a30159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a26a00640 1 --2- 172.21.15.2:0/2425882724 >> v2:172.21.15.26:3300/0 conn(0x7f8a300aff00 0x7f8a30159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a26a00640 1 -- 172.21.15.2:0/2425882724 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30159440 con 0x7f8a300ae7f0 2024-08-17T02:49:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a2fe00640 1 --2- 172.21.15.2:0/2425882724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a300b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.461+0000 7f8a2f400640 1 --2- 172.21.15.2:0/2425882724 >> v2:172.21.15.26:3300/0 conn(0x7f8a300aff00 0x7f8a30159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:49:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.462+0000 7f8a26a00640 1 --2- 172.21.15.2:0/2425882724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300ae7f0 0x7f8a300cc480 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a300cd2d0 tx=0x7f8a180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8012c492a02e19f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.462+0000 7f8a2ea00640 1 -- 172.21.15.2:0/2425882724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1802add0 con 0x7f8a300ae7f0 2024-08-17T02:49:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.462+0000 7f8a2ea00640 1 -- 172.21.15.2:0/2425882724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a18032440 con 0x7f8a300ae7f0 2024-08-17T02:49:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.462+0000 7f8a2ea00640 1 -- 172.21.15.2:0/2425882724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18032820 con 0x7f8a300ae7f0 2024-08-17T02:49:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.462+0000 7f8a34e00640 1 -- 172.21.15.2:0/2425882724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300ae7f0 msgr2=0x7f8a300cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.462+0000 7f8a34e00640 1 --2- 172.21.15.2:0/2425882724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300ae7f0 0x7f8a300cc480 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a300cd2d0 tx=0x7f8a180091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.463+0000 7f8a34e00640 1 -- 172.21.15.2:0/2425882724 shutdown_connections 2024-08-17T02:49:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.463+0000 7f8a34e00640 1 --2- 172.21.15.2:0/2425882724 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a300b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.463+0000 7f8a34e00640 1 --2- 172.21.15.2:0/2425882724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300ae7f0 0x7f8a300cc480 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.463+0000 7f8a34e00640 1 --2- 172.21.15.2:0/2425882724 >> v2:172.21.15.26:3300/0 conn(0x7f8a300aff00 0x7f8a30159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.463+0000 7f8a34e00640 1 -- 172.21.15.2:0/2425882724 >> 172.21.15.2:0/2425882724 conn(0x7f8a3006e590 msgr2=0x7f8a3006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.463+0000 7f8a34e00640 1 -- 172.21.15.2:0/2425882724 shutdown_connections 2024-08-17T02:49:49.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.463+0000 7f8a34e00640 1 -- 172.21.15.2:0/2425882724 wait complete. 2024-08-17T02:49:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.464+0000 7f8a34e00640 1 Processor -- start 2024-08-17T02:49:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.464+0000 7f8a34e00640 1 -- start start 2024-08-17T02:49:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.465+0000 7f8a34e00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a300ae7f0 0x7f8a300c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.465+0000 7f8a34e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300aff00 0x7f8a30155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.465+0000 7f8a34e00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a30169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.465+0000 7f8a34e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300c3690 con 0x7f8a300aff00 2024-08-17T02:49:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.465+0000 7f8a34e00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300cade0 con 0x7f8a300ae7f0 2024-08-17T02:49:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.465+0000 7f8a34e00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300cb060 con 0x7f8a300b18a0 2024-08-17T02:49:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.465+0000 7f8a26a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300aff00 0x7f8a30155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a26a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300aff00 0x7f8a30155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48132/0 (socket says 172.21.15.2:48132) 2024-08-17T02:49:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a26a00640 1 -- 172.21.15.2:0/1592902304 learned_addr learned my addr 172.21.15.2:0/1592902304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a2f400640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a300ae7f0 0x7f8a300c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a2fe00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a30169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a26a00640 1 -- 172.21.15.2:0/1592902304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 msgr2=0x7f8a30169100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a26a00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a30169100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a26a00640 1 -- 172.21.15.2:0/1592902304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a300ae7f0 msgr2=0x7f8a300c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a26a00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a300ae7f0 0x7f8a300c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a26a00640 1 -- 172.21.15.2:0/1592902304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18009450 con 0x7f8a300aff00 2024-08-17T02:49:49.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a26a00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300aff00 0x7f8a30155390 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009210 tx=0x7f8a18032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.466+0000 7f8a27400640 1 -- 172.21.15.2:0/1592902304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18031de0 con 0x7f8a300aff00 2024-08-17T02:49:49.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.467+0000 7f8a27400640 1 -- 172.21.15.2:0/1592902304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1803d420 con 0x7f8a300aff00 2024-08-17T02:49:49.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.467+0000 7f8a27400640 1 -- 172.21.15.2:0/1592902304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1803d7e0 con 0x7f8a300aff00 2024-08-17T02:49:49.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.467+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a300cb340 con 0x7f8a300aff00 2024-08-17T02:49:49.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.467+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a300c5a40 con 0x7f8a300aff00 2024-08-17T02:49:49.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.468+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a300c3b20 con 0x7f8a300aff00 2024-08-17T02:49:49.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.469+0000 7f8a27400640 1 -- 172.21.15.2:0/1592902304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8a18039040 con 0x7f8a300aff00 2024-08-17T02:49:49.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.469+0000 7f8a27400640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8a0c065150 0x7f8a0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.470+0000 7f8a27400640 1 -- 172.21.15.2:0/1592902304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8a180a24d0 con 0x7f8a300aff00 2024-08-17T02:49:49.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.470+0000 7f8a2f400640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8a0c065150 0x7f8a0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.470+0000 7f8a2f400640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8a0c065150 0x7f8a0c067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8a20006fd0 tx=0x7f8a20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.474+0000 7f8a27400640 1 -- 172.21.15.2:0/1592902304 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8a180708e0 con 0x7f8a300aff00 2024-08-17T02:49:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.662+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a30070720 con 0x7f8a0c065150 2024-08-17T02:49:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.662+0000 7f8a27400640 1 -- 172.21.15.2:0/1592902304 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a30070720 con 0x7f8a0c065150 2024-08-17T02:49:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:49:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8a0c065150 msgr2=0x7f8a0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8a0c065150 0x7f8a0c067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8a20006fd0 tx=0x7f8a20008040 comp rx=0 tx=0).stop 2024-08-17T02:49:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300aff00 msgr2=0x7f8a30155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300aff00 0x7f8a30155390 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009210 tx=0x7f8a18032000 comp rx=0 tx=0).stop 2024-08-17T02:49:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 shutdown_connections 2024-08-17T02:49:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f8a0c065150 0x7f8a0c067600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f8a300b18a0 0x7f8a30169100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a300aff00 0x7f8a30155390 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 --2- 172.21.15.2:0/1592902304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a300ae7f0 0x7f8a300c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.664+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 >> 172.21.15.2:0/1592902304 conn(0x7f8a3006e590 msgr2=0x7f8a301586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:49.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.665+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 shutdown_connections 2024-08-17T02:49:49.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.665+0000 7f8a34e00640 1 -- 172.21.15.2:0/1592902304 wait complete. 2024-08-17T02:49:49.681 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:49:49.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:49.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.836+0000 7ff917000640 1 Processor -- start 2024-08-17T02:49:49.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.836+0000 7ff917000640 1 -- start start 2024-08-17T02:49:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.837+0000 7ff917000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff910069cd0 0x7ff910163ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.837+0000 7ff917000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9100b0a50 con 0x7ff9100af410 2024-08-17T02:49:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.837+0000 7ff917000640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9100698d0 con 0x7ff910159090 2024-08-17T02:49:49.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.837+0000 7ff917000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff910068e50 con 0x7ff910069cd0 2024-08-17T02:49:49.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.837+0000 7ff915000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff910069cd0 0x7ff910163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.837+0000 7ff915000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff910069cd0 0x7ff910163ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48148/0 (socket says 172.21.15.2:48148) 2024-08-17T02:49:49.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.837+0000 7ff915000640 1 -- 172.21.15.2:0/3361058352 learned_addr learned my addr 172.21.15.2:0/3361058352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:49.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.837+0000 7ff90f400640 1 --1- 172.21.15.2:0/3361058352 >> v1:172.21.15.2:6789/0 conn(0x7ff9100af410 0x7ff910160570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56740/0 (socket says 172.21.15.2:56740) 2024-08-17T02:49:49.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.838+0000 7ff915000640 1 -- 172.21.15.2:0/3361058352 >> v1:172.21.15.26:6789/0 conn(0x7ff910159090 legacy=0x7ff9100aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:49.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.838+0000 7ff915000640 1 -- 172.21.15.2:0/3361058352 >> v1:172.21.15.2:6789/0 conn(0x7ff9100af410 legacy=0x7ff910160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.838+0000 7ff915000640 1 -- 172.21.15.2:0/3361058352 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910069030 con 0x7ff910069cd0 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.839+0000 7ff915000640 1 --2- 172.21.15.2:0/3361058352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff910069cd0 0x7ff910163ca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff908009f20 tx=0x7ff908009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92099da6a27626f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.839+0000 7ff90ea00640 1 -- 172.21.15.2:0/3361058352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908032460 con 0x7ff910069cd0 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.839+0000 7ff90ea00640 1 -- 172.21.15.2:0/3361058352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9080325c0 con 0x7ff910069cd0 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.839+0000 7ff90ea00640 1 -- 172.21.15.2:0/3361058352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080329a0 con 0x7ff910069cd0 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.840+0000 7ff917000640 1 -- 172.21.15.2:0/3361058352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff910069cd0 msgr2=0x7ff910163ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.840+0000 7ff917000640 1 --2- 172.21.15.2:0/3361058352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff910069cd0 0x7ff910163ca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff908009f20 tx=0x7ff908009840 comp rx=0 tx=0).stop 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.840+0000 7ff917000640 1 -- 172.21.15.2:0/3361058352 shutdown_connections 2024-08-17T02:49:49.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.840+0000 7ff917000640 1 --2- 172.21.15.2:0/3361058352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff910069cd0 0x7ff910163ca0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.840+0000 7ff917000640 1 -- 172.21.15.2:0/3361058352 >> 172.21.15.2:0/3361058352 conn(0x7ff9100ce5e0 msgr2=0x7ff910095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.840+0000 7ff917000640 1 -- 172.21.15.2:0/3361058352 shutdown_connections 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.840+0000 7ff917000640 1 -- 172.21.15.2:0/3361058352 wait complete. 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.841+0000 7ff917000640 1 Processor -- start 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.841+0000 7ff917000640 1 -- start start 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff917000640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff910069cd0 0x7ff91014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff917000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9100af410 0x7ff9100978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff917000640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff910159090 0x7ff910097de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff917000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91006d890 con 0x7ff9100af410 2024-08-17T02:49:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff917000640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91009b540 con 0x7ff910159090 2024-08-17T02:49:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff917000640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91013fbb0 con 0x7ff910069cd0 2024-08-17T02:49:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff90f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9100af410 0x7ff9100978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff90f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9100af410 0x7ff9100978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48164/0 (socket says 172.21.15.2:48164) 2024-08-17T02:49:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.842+0000 7ff90f400640 1 -- 172.21.15.2:0/1481828467 learned_addr learned my addr 172.21.15.2:0/1481828467 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff90fe00640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff910069cd0 0x7ff91014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff915000640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff910159090 0x7ff910097de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff90f400640 1 -- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff910069cd0 msgr2=0x7ff91014ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff90f400640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7ff910069cd0 0x7ff91014ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff90f400640 1 -- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff910159090 msgr2=0x7ff910097de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff90f400640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff910159090 0x7ff910097de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff90f400640 1 -- 172.21.15.2:0/1481828467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908009ae0 con 0x7ff9100af410 2024-08-17T02:49:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff90f400640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9100af410 0x7ff9100978a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c590 tx=0x7ff8fc007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.843+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc007300 con 0x7ff9100af410 2024-08-17T02:49:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.844+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc0074a0 con 0x7ff9100af410 2024-08-17T02:49:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.844+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0047a0 con 0x7ff9100af410 2024-08-17T02:49:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.844+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91013fe90 con 0x7ff9100af410 2024-08-17T02:49:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.844+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff910140450 con 0x7ff9100af410 2024-08-17T02:49:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.844+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9100af9f0 con 0x7ff9100af410 2024-08-17T02:49:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.845+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff8fc004bd0 con 0x7ff9100af410 2024-08-17T02:49:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.846+0000 7ff907400640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f0065150 0x7ff8f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.846+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff8fc081190 con 0x7ff9100af410 2024-08-17T02:49:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.846+0000 7ff90fe00640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f0065150 0x7ff8f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.847+0000 7ff907400640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7ff8f006b040 0x7ff8f006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.847+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 --> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8f006db00 con 0x7ff8f006b040 2024-08-17T02:49:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.847+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8fc083690 con 0x7ff9100af410 2024-08-17T02:49:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.847+0000 7ff915000640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7ff8f006b040 0x7ff8f006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.847+0000 7ff90fe00640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f0065150 0x7ff8f0067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff900009a60 tx=0x7ff900006f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.848+0000 7ff915000640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7ff8f006b040 0x7ff8f006d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:49.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.848+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 <== osd.6 v2:172.21.15.26:6808/37446 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff8f006db00 con 0x7ff8f006b040 2024-08-17T02:49:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.862+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 --> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff9100ccd30 con 0x7ff8f006b040 2024-08-17T02:49:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.862+0000 7ff907400640 1 -- 172.21.15.2:0/1481828467 <== osd.6 v2:172.21.15.26:6808/37446 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff9100ccd30 con 0x7ff8f006b040 2024-08-17T02:49:49.910 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:49:49.910 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:49.910 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:49:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7ff8f006b040 msgr2=0x7ff8f006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.26:6808/37446,v1:172.21.15.26:6809/37446] conn(0x7ff8f006b040 0x7ff8f006d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f0065150 msgr2=0x7ff8f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7ff8f0065150 0x7ff8f0067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff900009a60 tx=0x7ff900006f50 comp rx=0 tx=0).stop 2024-08-17T02:49:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9100af410 msgr2=0x7ff9100978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 --2- 172.21.15.2:0/1481828467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9100af410 0x7ff9100978a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c590 tx=0x7ff8fc007ee0 comp rx=0 tx=0).stop 2024-08-17T02:49:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff915000640 1 -- 172.21.15.2:0/1481828467 reap_dead start 2024-08-17T02:49:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 shutdown_connections 2024-08-17T02:49:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 >> 172.21.15.2:0/1481828467 conn(0x7ff9100ce5e0 msgr2=0x7ff9100ad420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 shutdown_connections 2024-08-17T02:49:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:49.863+0000 7ff917000640 1 -- 172.21.15.2:0/1481828467 wait complete. 2024-08-17T02:49:49.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:49:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.065+0000 7fc942600640 1 Processor -- start 2024-08-17T02:49:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.065+0000 7fc942600640 1 -- start start 2024-08-17T02:49:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.066+0000 7fc942600640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc93c0afca0 0x7fc93c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.066+0000 7fc942600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc93c0acf10 0x7fc93c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.066+0000 7fc942600640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c15a4e0 con 0x7fc93c1589a0 2024-08-17T02:49:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.066+0000 7fc942600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c0b0980 con 0x7fc93c0acf10 2024-08-17T02:49:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.066+0000 7fc942600640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c0c92b0 con 0x7fc93c0afca0 2024-08-17T02:49:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.067+0000 7fc933e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc93c0acf10 0x7fc93c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.067+0000 7fc933e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc93c0acf10 0x7fc93c159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48176/0 (socket says 172.21.15.2:48176) 2024-08-17T02:49:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.067+0000 7fc933e00640 1 -- 172.21.15.2:0/3601810457 learned_addr learned my addr 172.21.15.2:0/3601810457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:50.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.067+0000 7fc93b400640 1 --2- 172.21.15.2:0/3601810457 >> v2:172.21.15.26:3300/0 conn(0x7fc93c0afca0 0x7fc93c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.067+0000 7fc933e00640 1 -- 172.21.15.2:0/3601810457 >> v2:172.21.15.26:3300/0 conn(0x7fc93c0afca0 msgr2=0x7fc93c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.067+0000 7fc933e00640 1 --2- 172.21.15.2:0/3601810457 >> v2:172.21.15.26:3300/0 conn(0x7fc93c0afca0 0x7fc93c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.067+0000 7fc933e00640 1 -- 172.21.15.2:0/3601810457 >> v1:172.21.15.26:6789/0 conn(0x7fc93c1589a0 legacy=0x7fc93c158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.067+0000 7fc933e00640 1 -- 172.21.15.2:0/3601810457 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0ad480 con 0x7fc93c0acf10 2024-08-17T02:49:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.068+0000 7fc933e00640 1 --2- 172.21.15.2:0/3601810457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0acf10 0x7fc93c159fa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc93c067e40 tx=0x7fc9240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b599941c182e1c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc93aa00640 1 -- 172.21.15.2:0/3601810457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92402ae80 con 0x7fc93c0acf10 2024-08-17T02:49:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc93aa00640 1 -- 172.21.15.2:0/3601810457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924032440 con 0x7fc93c0acf10 2024-08-17T02:49:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc93aa00640 1 -- 172.21.15.2:0/3601810457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924032800 con 0x7fc93c0acf10 2024-08-17T02:49:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc942600640 1 -- 172.21.15.2:0/3601810457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0acf10 msgr2=0x7fc93c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc942600640 1 --2- 172.21.15.2:0/3601810457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0acf10 0x7fc93c159fa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc93c067e40 tx=0x7fc9240091d0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc942600640 1 -- 172.21.15.2:0/3601810457 shutdown_connections 2024-08-17T02:49:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc942600640 1 --2- 172.21.15.2:0/3601810457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0acf10 0x7fc93c159fa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc942600640 1 --2- 172.21.15.2:0/3601810457 >> v2:172.21.15.26:3300/0 conn(0x7fc93c0afca0 0x7fc93c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc942600640 1 -- 172.21.15.2:0/3601810457 >> 172.21.15.2:0/3601810457 conn(0x7fc93c066e60 msgr2=0x7fc93c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc942600640 1 -- 172.21.15.2:0/3601810457 shutdown_connections 2024-08-17T02:49:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.069+0000 7fc942600640 1 -- 172.21.15.2:0/3601810457 wait complete. 2024-08-17T02:49:50.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.071+0000 7fc942600640 1 Processor -- start 2024-08-17T02:49:50.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.071+0000 7fc942600640 1 -- start start 2024-08-17T02:49:50.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc942600640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c0acf10 0x7fc93c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc942600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0afca0 0x7fc93c144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc942600640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c1589a0 0x7fc93c0c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc942600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c169e30 con 0x7fc93c0afca0 2024-08-17T02:49:50.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc942600640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0c0c90 con 0x7fc93c1589a0 2024-08-17T02:49:50.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc942600640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0c0f70 con 0x7fc93c0acf10 2024-08-17T02:49:50.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc933e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0afca0 0x7fc93c144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc933e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0afca0 0x7fc93c144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48188/0 (socket says 172.21.15.2:48188) 2024-08-17T02:49:50.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc933e00640 1 -- 172.21.15.2:0/1245774391 learned_addr learned my addr 172.21.15.2:0/1245774391 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:50.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc93b400640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c0acf10 0x7fc93c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.072+0000 7fc93be00640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c1589a0 0x7fc93c0c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc933e00640 1 -- 172.21.15.2:0/1245774391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c0acf10 msgr2=0x7fc93c1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc933e00640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c0acf10 0x7fc93c1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc933e00640 1 -- 172.21.15.2:0/1245774391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c1589a0 msgr2=0x7fc93c0c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc933e00640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c1589a0 0x7fc93c0c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc933e00640 1 -- 172.21.15.2:0/1245774391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc924009450 con 0x7fc93c0afca0 2024-08-17T02:49:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc933e00640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0afca0 0x7fc93c144290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc924009210 tx=0x7fc924032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc932a00640 1 -- 172.21.15.2:0/1245774391 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924031c80 con 0x7fc93c0afca0 2024-08-17T02:49:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc932a00640 1 -- 172.21.15.2:0/1245774391 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924031e00 con 0x7fc93c0afca0 2024-08-17T02:49:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c0c1250 con 0x7fc93c0afca0 2024-08-17T02:49:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc932a00640 1 -- 172.21.15.2:0/1245774391 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92403d670 con 0x7fc93c0afca0 2024-08-17T02:49:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.073+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c169ab0 con 0x7fc93c0afca0 2024-08-17T02:49:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.074+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c0c1750 con 0x7fc93c0afca0 2024-08-17T02:49:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.075+0000 7fc932a00640 1 -- 172.21.15.2:0/1245774391 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc924039040 con 0x7fc93c0afca0 2024-08-17T02:49:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.077+0000 7fc932a00640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc918065150 0x7fc918067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.077+0000 7fc932a00640 1 -- 172.21.15.2:0/1245774391 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc9240a2390 con 0x7fc93c0afca0 2024-08-17T02:49:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.077+0000 7fc93b400640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc918065150 0x7fc918067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.077+0000 7fc93b400640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc918065150 0x7fc918067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009d20 tx=0x7fc92c0090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.081+0000 7fc932a00640 1 -- 172.21.15.2:0/1245774391 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc9240707c0 con 0x7fc93c0afca0 2024-08-17T02:49:50.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.262+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc93c063fb0 con 0x7fc918065150 2024-08-17T02:49:50.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.262+0000 7fc932a00640 1 -- 172.21.15.2:0/1245774391 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc93c063fb0 con 0x7fc918065150 2024-08-17T02:49:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:49:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc918065150 msgr2=0x7fc918067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc918065150 0x7fc918067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009d20 tx=0x7fc92c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0afca0 msgr2=0x7fc93c144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0afca0 0x7fc93c144290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc924009210 tx=0x7fc924032000 comp rx=0 tx=0).stop 2024-08-17T02:49:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 shutdown_connections 2024-08-17T02:49:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc93c1589a0 0x7fc93c0c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc93c0afca0 0x7fc93c144290 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fc918065150 0x7fc918067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 --2- 172.21.15.2:0/1245774391 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fc93c0acf10 0x7fc93c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.264+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 >> 172.21.15.2:0/1245774391 conn(0x7fc93c066e60 msgr2=0x7fc93c0cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:50.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.265+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 shutdown_connections 2024-08-17T02:49:50.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.265+0000 7fc942600640 1 -- 172.21.15.2:0/1245774391 wait complete. 2024-08-17T02:49:50.280 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:49:50.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:49:50.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.435+0000 7fce81200640 1 Processor -- start 2024-08-17T02:49:50.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.435+0000 7fce81200640 1 -- start start 2024-08-17T02:49:50.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce81200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fce7c0ad020 0x7fce7c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce81200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce7c0afa00 0x7fce7c0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce81200640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c159ad0 con 0x7fce7c0ac000 2024-08-17T02:49:50.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce81200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c0b0340 con 0x7fce7c0afa00 2024-08-17T02:49:50.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce81200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c0ad590 con 0x7fce7c0ad020 2024-08-17T02:49:50.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce7a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce7c0afa00 0x7fce7c0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce7a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce7c0afa00 0x7fce7c0afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48204/0 (socket says 172.21.15.2:48204) 2024-08-17T02:49:50.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce7a800640 1 -- 172.21.15.2:0/1232765856 learned_addr learned my addr 172.21.15.2:0/1232765856 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:50.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.436+0000 7fce73e00640 1 --2- 172.21.15.2:0/1232765856 >> v2:172.21.15.26:3300/0 conn(0x7fce7c0ad020 0x7fce7c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.437+0000 7fce7a800640 1 -- 172.21.15.2:0/1232765856 >> v2:172.21.15.26:3300/0 conn(0x7fce7c0ad020 msgr2=0x7fce7c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:50.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.437+0000 7fce7a800640 1 --2- 172.21.15.2:0/1232765856 >> v2:172.21.15.26:3300/0 conn(0x7fce7c0ad020 0x7fce7c159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.437+0000 7fce7a800640 1 -- 172.21.15.2:0/1232765856 >> v1:172.21.15.26:6789/0 conn(0x7fce7c0ac000 legacy=0x7fce7c156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.437+0000 7fce7a800640 1 -- 172.21.15.2:0/1232765856 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c0ad870 con 0x7fce7c0afa00 2024-08-17T02:49:50.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.438+0000 7fce7a800640 1 --2- 172.21.15.2:0/1232765856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 0x7fce7c0afe00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fce7c06b9b0 tx=0x7fce74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ef24b2b8eb4b8a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.438+0000 7fce79400640 1 -- 172.21.15.2:0/1232765856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74032470 con 0x7fce7c0afa00 2024-08-17T02:49:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.438+0000 7fce79400640 1 -- 172.21.15.2:0/1232765856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740325d0 con 0x7fce7c0afa00 2024-08-17T02:49:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.438+0000 7fce79400640 1 -- 172.21.15.2:0/1232765856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740329b0 con 0x7fce7c0afa00 2024-08-17T02:49:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.438+0000 7fce81200640 1 -- 172.21.15.2:0/1232765856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 msgr2=0x7fce7c0afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.438+0000 7fce81200640 1 --2- 172.21.15.2:0/1232765856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 0x7fce7c0afe00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fce7c06b9b0 tx=0x7fce74009840 comp rx=0 tx=0).stop 2024-08-17T02:49:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.439+0000 7fce81200640 1 -- 172.21.15.2:0/1232765856 shutdown_connections 2024-08-17T02:49:50.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.439+0000 7fce81200640 1 --2- 172.21.15.2:0/1232765856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 0x7fce7c0afe00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.439+0000 7fce81200640 1 --2- 172.21.15.2:0/1232765856 >> v2:172.21.15.26:3300/0 conn(0x7fce7c0ad020 0x7fce7c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.439+0000 7fce81200640 1 -- 172.21.15.2:0/1232765856 >> 172.21.15.2:0/1232765856 conn(0x7fce7c066e60 msgr2=0x7fce7c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.439+0000 7fce81200640 1 -- 172.21.15.2:0/1232765856 shutdown_connections 2024-08-17T02:49:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.439+0000 7fce81200640 1 -- 172.21.15.2:0/1232765856 wait complete. 2024-08-17T02:49:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.440+0000 7fce81200640 1 Processor -- start 2024-08-17T02:49:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.440+0000 7fce81200640 1 -- start start 2024-08-17T02:49:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce81200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7c0ac000 0x7fce7c158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce81200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce7c0ad020 0x7fce7c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce81200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 0x7fce7c16c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce81200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c169e60 con 0x7fce7c0afa00 2024-08-17T02:49:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce81200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c156f30 con 0x7fce7c0ac000 2024-08-17T02:49:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce81200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c157210 con 0x7fce7c0ad020 2024-08-17T02:49:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce7a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 0x7fce7c16c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce7a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 0x7fce7c16c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48214/0 (socket says 172.21.15.2:48214) 2024-08-17T02:49:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce7a800640 1 -- 172.21.15.2:0/28922399 learned_addr learned my addr 172.21.15.2:0/28922399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce73e00640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce7c0ad020 0x7fce7c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.441+0000 7fce79e00640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7c0ac000 0x7fce7c158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.442+0000 7fce7a800640 1 -- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce7c0ad020 msgr2=0x7fce7c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.442+0000 7fce7a800640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fce7c0ad020 0x7fce7c0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.442+0000 7fce7a800640 1 -- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7c0ac000 msgr2=0x7fce7c158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.442+0000 7fce7a800640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce7c0ac000 0x7fce7c158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.442+0000 7fce7a800640 1 -- 172.21.15.2:0/28922399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74009ae0 con 0x7fce7c0afa00 2024-08-17T02:49:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.442+0000 7fce7a800640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 0x7fce7c16c540 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fce74009f50 tx=0x7fce74039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.442+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400e140 con 0x7fce7c0afa00 2024-08-17T02:49:50.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.443+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74007ac0 con 0x7fce7c0afa00 2024-08-17T02:49:50.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.443+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c1574f0 con 0x7fce7c0afa00 2024-08-17T02:49:50.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.443+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74007e60 con 0x7fce7c0afa00 2024-08-17T02:49:50.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.443+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c0c8340 con 0x7fce7c0afa00 2024-08-17T02:49:50.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.443+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce7c0c8530 con 0x7fce7c0afa00 2024-08-17T02:49:50.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.444+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fce7403c400 con 0x7fce7c0afa00 2024-08-17T02:49:50.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.445+0000 7fce71600640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fce58065150 0x7fce58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.445+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fce740a39c0 con 0x7fce7c0afa00 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.445+0000 7fce79e00640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fce58065150 0x7fce58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.445+0000 7fce71600640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fce5806b040 0x7fce5806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.445+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 --> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce5806db00 con 0x7fce5806b040 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.445+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce740a8220 con 0x7fce7c0afa00 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.446+0000 7fce73e00640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fce5806b040 0x7fce5806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.446+0000 7fce79e00640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fce58065150 0x7fce58067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0abbc0 tx=0x7fce6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.447+0000 7fce73e00640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fce5806b040 0x7fce5806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.447+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 <== osd.7 v2:172.21.15.26:6824/37470 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fce5806db00 con 0x7fce5806b040 2024-08-17T02:49:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.460+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 --> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fce7c063fb0 con 0x7fce5806b040 2024-08-17T02:49:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce71600640 1 -- 172.21.15.2:0/28922399 <== osd.7 v2:172.21.15.26:6824/37470 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fce7c063fb0 con 0x7fce5806b040 2024-08-17T02:49:50.462 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-08-17T02:49:50.462 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:49:50.462 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-08-17T02:49:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fce5806b040 msgr2=0x7fce5806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce81200640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.26:6824/37470,v1:172.21.15.26:6825/37470] conn(0x7fce5806b040 0x7fce5806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fce58065150 msgr2=0x7fce58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce81200640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fce58065150 0x7fce58067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0abbc0 tx=0x7fce6c009040 comp rx=0 tx=0).stop 2024-08-17T02:49:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 msgr2=0x7fce7c16c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce81200640 1 --2- 172.21.15.2:0/28922399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce7c0afa00 0x7fce7c16c540 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fce74009f50 tx=0x7fce74039000 comp rx=0 tx=0).stop 2024-08-17T02:49:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce7a800640 1 -- 172.21.15.2:0/28922399 reap_dead start 2024-08-17T02:49:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 shutdown_connections 2024-08-17T02:49:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.461+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 >> 172.21.15.2:0/28922399 conn(0x7fce7c066e60 msgr2=0x7fce7c0c8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.462+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 shutdown_connections 2024-08-17T02:49:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.462+0000 7fce81200640 1 -- 172.21.15.2:0/28922399 wait complete. 2024-08-17T02:49:50.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:49:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.628+0000 7f694be00640 1 Processor -- start 2024-08-17T02:49:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.628+0000 7f694be00640 1 -- start start 2024-08-17T02:49:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.629+0000 7f694be00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ca050 0x7f6944156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.629+0000 7f694be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f69440add30 0x7f694415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.629+0000 7f694be00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694415b5e0 con 0x7f69440ad960 2024-08-17T02:49:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.629+0000 7f694be00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69440cb160 con 0x7f69440add30 2024-08-17T02:49:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.629+0000 7f694be00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69440b0d10 con 0x7f69440ca050 2024-08-17T02:49:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.629+0000 7f6949e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f69440add30 0x7f694415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.629+0000 7f6949e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f69440add30 0x7f694415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48226/0 (socket says 172.21.15.2:48226) 2024-08-17T02:49:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.630+0000 7f6949e00640 1 -- 172.21.15.2:0/2697543869 learned_addr learned my addr 172.21.15.2:0/2697543869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.630+0000 7f6948a00640 1 --2- 172.21.15.2:0/2697543869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ca050 0x7f6944156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.630+0000 7f6949e00640 1 -- 172.21.15.2:0/2697543869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ca050 msgr2=0x7f6944156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.630+0000 7f6949e00640 1 --2- 172.21.15.2:0/2697543869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ca050 0x7f6944156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.630+0000 7f6949e00640 1 -- 172.21.15.2:0/2697543869 >> v1:172.21.15.26:6789/0 conn(0x7f69440ad960 legacy=0x7f6944156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:50.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.630+0000 7f6949e00640 1 -- 172.21.15.2:0/2697543869 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69440ca550 con 0x7f69440add30 2024-08-17T02:49:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.631+0000 7f6949e00640 1 --2- 172.21.15.2:0/2697543869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440add30 0x7f694415b0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f693c009f20 tx=0x7f693c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a73b7109c4bad3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.631+0000 7f6943e00640 1 -- 172.21.15.2:0/2697543869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c032450 con 0x7f69440add30 2024-08-17T02:49:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.631+0000 7f6943e00640 1 -- 172.21.15.2:0/2697543869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c0325b0 con 0x7f69440add30 2024-08-17T02:49:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.631+0000 7f6943e00640 1 -- 172.21.15.2:0/2697543869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c032990 con 0x7f69440add30 2024-08-17T02:49:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.632+0000 7f694be00640 1 -- 172.21.15.2:0/2697543869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440add30 msgr2=0x7f694415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.632+0000 7f694be00640 1 --2- 172.21.15.2:0/2697543869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440add30 0x7f694415b0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f693c009f20 tx=0x7f693c009840 comp rx=0 tx=0).stop 2024-08-17T02:49:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.632+0000 7f694be00640 1 -- 172.21.15.2:0/2697543869 shutdown_connections 2024-08-17T02:49:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.632+0000 7f694be00640 1 --2- 172.21.15.2:0/2697543869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440add30 0x7f694415b0a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.632+0000 7f694be00640 1 --2- 172.21.15.2:0/2697543869 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ca050 0x7f6944156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.632+0000 7f694be00640 1 -- 172.21.15.2:0/2697543869 >> 172.21.15.2:0/2697543869 conn(0x7f6944066e60 msgr2=0x7f6944067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.632+0000 7f694be00640 1 -- 172.21.15.2:0/2697543869 shutdown_connections 2024-08-17T02:49:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.632+0000 7f694be00640 1 -- 172.21.15.2:0/2697543869 wait complete. 2024-08-17T02:49:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.633+0000 7f694be00640 1 Processor -- start 2024-08-17T02:49:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.633+0000 7f694be00640 1 -- start start 2024-08-17T02:49:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.634+0000 7f694be00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ad960 0x7f6944157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.634+0000 7f694be00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69440add30 0x7f694416cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.634+0000 7f694be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440ca050 0x7f69441580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.634+0000 7f694be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694406a0e0 con 0x7f69440ca050 2024-08-17T02:49:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.634+0000 7f694be00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694406a2f0 con 0x7f69440add30 2024-08-17T02:49:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.634+0000 7f694be00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694406a5d0 con 0x7f69440ad960 2024-08-17T02:49:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440ca050 0x7f69441580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440ca050 0x7f69441580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48234/0 (socket says 172.21.15.2:48234) 2024-08-17T02:49:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 -- 172.21.15.2:0/2060130384 learned_addr learned my addr 172.21.15.2:0/2060130384 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6948a00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69440add30 0x7f694416cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949400640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ad960 0x7f6944157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 -- 172.21.15.2:0/2060130384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ad960 msgr2=0x7f6944157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ad960 0x7f6944157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 -- 172.21.15.2:0/2060130384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69440add30 msgr2=0x7f694416cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69440add30 0x7f694416cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 -- 172.21.15.2:0/2060130384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c009ae0 con 0x7f69440ca050 2024-08-17T02:49:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.635+0000 7f6949e00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440ca050 0x7f69441580b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f693c009f20 tx=0x7f693c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.636+0000 7f6940c00640 1 -- 172.21.15.2:0/2060130384 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c032450 con 0x7f69440ca050 2024-08-17T02:49:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.636+0000 7f6940c00640 1 -- 172.21.15.2:0/2060130384 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c008e50 con 0x7f69440ca050 2024-08-17T02:49:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.636+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694406a8b0 con 0x7f69440ca050 2024-08-17T02:49:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.636+0000 7f6940c00640 1 -- 172.21.15.2:0/2060130384 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c03c640 con 0x7f69440ca050 2024-08-17T02:49:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.636+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694414d6a0 con 0x7f69440ca050 2024-08-17T02:49:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.637+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6944063fb0 con 0x7f69440ca050 2024-08-17T02:49:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.638+0000 7f6940c00640 1 -- 172.21.15.2:0/2060130384 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f693c039050 con 0x7f69440ca050 2024-08-17T02:49:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.639+0000 7f6940c00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6924065150 0x7f6924067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.639+0000 7f6940c00640 1 -- 172.21.15.2:0/2060130384 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f693c02e050 con 0x7f69440ca050 2024-08-17T02:49:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.639+0000 7f6949400640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6924065150 0x7f6924067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.640+0000 7f6949400640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6924065150 0x7f6924067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6938007fd0 tx=0x7f6938007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.643+0000 7f6940c00640 1 -- 172.21.15.2:0/2060130384 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f693c0715e0 con 0x7f69440ca050 2024-08-17T02:49:50.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.826+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6944153790 con 0x7f6924065150 2024-08-17T02:49:50.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.827+0000 7f6940c00640 1 -- 172.21.15.2:0/2060130384 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6944153790 con 0x7f6924065150 2024-08-17T02:49:50.828 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:49:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.828+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6924065150 msgr2=0x7f6924067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.828+0000 7f694be00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6924065150 0x7f6924067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6938007fd0 tx=0x7f6938007e30 comp rx=0 tx=0).stop 2024-08-17T02:49:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.828+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440ca050 msgr2=0x7f69441580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.828+0000 7f694be00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440ca050 0x7f69441580b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f693c009f20 tx=0x7f693c037000 comp rx=0 tx=0).stop 2024-08-17T02:49:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.829+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 shutdown_connections 2024-08-17T02:49:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.829+0000 7f694be00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69440ca050 0x7f69441580b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.829+0000 7f694be00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69440add30 0x7f694416cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.829+0000 7f694be00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f6924065150 0x7f6924067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.829+0000 7f694be00640 1 --2- 172.21.15.2:0/2060130384 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f69440ad960 0x7f6944157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.829+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 >> 172.21.15.2:0/2060130384 conn(0x7f6944066e60 msgr2=0x7f69441561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.829+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 shutdown_connections 2024-08-17T02:49:50.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.829+0000 7f694be00640 1 -- 172.21.15.2:0/2060130384 wait complete. 2024-08-17T02:49:50.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:49:50.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.995+0000 7fe0ad400640 1 Processor -- start 2024-08-17T02:49:50.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.995+0000 7fe0ad400640 1 -- start start 2024-08-17T02:49:50.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0ad400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0a80ad790 0x7fe0a80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0ad400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a81559e0 0x7fe0a80ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:50.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0ad400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80ca6b0 con 0x7fe0a80c9d20 2024-08-17T02:49:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0ad400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80cb180 con 0x7fe0a80ad790 2024-08-17T02:49:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0ad400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80af530 con 0x7fe0a81559e0 2024-08-17T02:49:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0a7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0a80ad790 0x7fe0a80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0a7e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe0a80ad790 0x7fe0a80adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48250/0 (socket says 172.21.15.2:48250) 2024-08-17T02:49:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0a7e00640 1 -- 172.21.15.2:0/1070524586 learned_addr learned my addr 172.21.15.2:0/1070524586 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe09f400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe0a80c9d20 0x7fe0a81552d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56746/0 (socket says 172.21.15.2:56746) 2024-08-17T02:49:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.996+0000 7fe0aca00640 1 --2- 172.21.15.2:0/1070524586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a81559e0 0x7fe0a80ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:50.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.997+0000 7fe0a7e00640 1 -- 172.21.15.2:0/1070524586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a81559e0 msgr2=0x7fe0a80ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:49:51.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.997+0000 7fe0a7e00640 1 --2- 172.21.15.2:0/1070524586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a81559e0 0x7fe0a80ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.997+0000 7fe0a7e00640 1 -- 172.21.15.2:0/1070524586 >> v1:172.21.15.2:6789/0 conn(0x7fe0a80c9d20 legacy=0x7fe0a81552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:51.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.997+0000 7fe0a7e00640 1 -- 172.21.15.2:0/1070524586 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80ca8e0 con 0x7fe0a80ad790 2024-08-17T02:49:51.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.998+0000 7fe0a7e00640 1 --2- 172.21.15.2:0/1070524586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a80adb60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe09800bbc0 tx=0x7fe09800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199955d8dd4137a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:51.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.998+0000 7fe0a7400640 1 -- 172.21.15.2:0/1070524586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098032620 con 0x7fe0a80ad790 2024-08-17T02:49:51.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.998+0000 7fe0a7400640 1 -- 172.21.15.2:0/1070524586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09802e040 con 0x7fe0a80ad790 2024-08-17T02:49:51.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.998+0000 7fe0a7400640 1 -- 172.21.15.2:0/1070524586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980329f0 con 0x7fe0a80ad790 2024-08-17T02:49:51.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.999+0000 7fe0ad400640 1 -- 172.21.15.2:0/1070524586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 msgr2=0x7fe0a80adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:51.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.999+0000 7fe0ad400640 1 --2- 172.21.15.2:0/1070524586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a80adb60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe09800bbc0 tx=0x7fe09800b460 comp rx=0 tx=0).stop 2024-08-17T02:49:51.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.999+0000 7fe0ad400640 1 -- 172.21.15.2:0/1070524586 shutdown_connections 2024-08-17T02:49:51.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.999+0000 7fe0ad400640 1 --2- 172.21.15.2:0/1070524586 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a81559e0 0x7fe0a80ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.999+0000 7fe0ad400640 1 --2- 172.21.15.2:0/1070524586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a80adb60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.999+0000 7fe0ad400640 1 -- 172.21.15.2:0/1070524586 >> 172.21.15.2:0/1070524586 conn(0x7fe0a8062af0 msgr2=0x7fe0a8062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:51.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.999+0000 7fe0ad400640 1 -- 172.21.15.2:0/1070524586 shutdown_connections 2024-08-17T02:49:51.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:50.999+0000 7fe0ad400640 1 -- 172.21.15.2:0/1070524586 wait complete. 2024-08-17T02:49:51.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.000+0000 7fe0ad400640 1 Processor -- start 2024-08-17T02:49:51.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.000+0000 7fe0ad400640 1 -- start start 2024-08-17T02:49:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.001+0000 7fe0ad400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a8134fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.001+0000 7fe0ad400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a80c9d20 0x7fe0a8159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.001+0000 7fe0ad400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0a81559e0 0x7fe0a8159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.001+0000 7fe0ad400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8156f40 con 0x7fe0a80ad790 2024-08-17T02:49:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.001+0000 7fe0ad400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8149050 con 0x7fe0a81559e0 2024-08-17T02:49:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.001+0000 7fe0ad400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81568f0 con 0x7fe0a80c9d20 2024-08-17T02:49:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.001+0000 7fe0a7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a8134fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.001+0000 7fe0a7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a8134fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48258/0 (socket says 172.21.15.2:48258) 2024-08-17T02:49:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe0a7e00640 1 -- 172.21.15.2:0/308722354 learned_addr learned my addr 172.21.15.2:0/308722354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:49:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe09f400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a80c9d20 0x7fe0a8159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe0aca00640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0a81559e0 0x7fe0a8159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe0a7e00640 1 -- 172.21.15.2:0/308722354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a80c9d20 msgr2=0x7fe0a8159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:51.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe0a7e00640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a80c9d20 0x7fe0a8159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe0a7e00640 1 -- 172.21.15.2:0/308722354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0a81559e0 msgr2=0x7fe0a8159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:51.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe0a7e00640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0a81559e0 0x7fe0a8159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe0a7e00640 1 -- 172.21.15.2:0/308722354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09800b700 con 0x7fe0a80ad790 2024-08-17T02:49:51.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe0a7e00640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a8134fa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe09800b4a0 tx=0x7fe09803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:51.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe09fe00640 1 -- 172.21.15.2:0/308722354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098041070 con 0x7fe0a80ad790 2024-08-17T02:49:51.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe09fe00640 1 -- 172.21.15.2:0/308722354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09803c8e0 con 0x7fe0a80ad790 2024-08-17T02:49:51.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.002+0000 7fe09fe00640 1 -- 172.21.15.2:0/308722354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098032ea0 con 0x7fe0a80ad790 2024-08-17T02:49:51.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.003+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a8156bd0 con 0x7fe0a80ad790 2024-08-17T02:49:51.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.003+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a8135680 con 0x7fe0a80ad790 2024-08-17T02:49:51.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.004+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a8156750 con 0x7fe0a80ad790 2024-08-17T02:49:51.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.004+0000 7fe09fe00640 1 -- 172.21.15.2:0/308722354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe098045070 con 0x7fe0a80ad790 2024-08-17T02:49:51.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.006+0000 7fe09fe00640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe084065150 0x7fe084067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:49:51.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.006+0000 7fe09fe00640 1 -- 172.21.15.2:0/308722354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe0980a4d40 con 0x7fe0a80ad790 2024-08-17T02:49:51.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.006+0000 7fe09f400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe084065150 0x7fe084067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:49:51.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.006+0000 7fe09f400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe084065150 0x7fe084067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80b1730 tx=0x7fe090007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:49:51.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.010+0000 7fe09fe00640 1 -- 172.21.15.2:0/308722354 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe0a8156750 con 0x7fe0a80ad790 2024-08-17T02:49:51.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.189+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0a8157080 con 0x7fe084065150 2024-08-17T02:49:51.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.191+0000 7fe09fe00640 1 -- 172.21.15.2:0/308722354 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50675 (secure 0 0 0) 0x7fe090005d00 con 0x7fe084065150 2024-08-17T02:49:51.193 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:49:51.193 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:49:51.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.193+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe084065150 msgr2=0x7fe084067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:51.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.193+0000 7fe0ad400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe084065150 0x7fe084067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80b1730 tx=0x7fe090007ce0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.193+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 msgr2=0x7fe0a8134fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:49:51.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.193+0000 7fe0ad400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a8134fa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe09800b4a0 tx=0x7fe09803a000 comp rx=0 tx=0).stop 2024-08-17T02:49:51.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.194+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 shutdown_connections 2024-08-17T02:49:51.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.194+0000 7fe0ad400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0a81559e0 0x7fe0a8159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.194+0000 7fe0ad400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe084065150 0x7fe084067600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.194+0000 7fe0ad400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe0a80c9d20 0x7fe0a8159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.194+0000 7fe0ad400640 1 --2- 172.21.15.2:0/308722354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0a80ad790 0x7fe0a8134fa0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:49:51.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.194+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 >> 172.21.15.2:0/308722354 conn(0x7fe0a8062af0 msgr2=0x7fe0a806d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:49:51.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.194+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 shutdown_connections 2024-08-17T02:49:51.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:49:51.194+0000 7fe0ad400640 1 -- 172.21.15.2:0/308722354 wait complete. 2024-08-17T02:49:51.211 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-08-17T02:49:51.067605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2417404,"kb_used_data":5256,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752557316,"statfs":{"total":773094113280,"available":770618691584,"internally_reserved":0,"allocated":5382144,"data_stored":2922912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.700957"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:49:41.276782+0000","last_change":"2024-08-17T02:46:08.821219+0000","last_active":"2024-08-17T02:49:41.276782+0000","last_peered":"2024-08-17T02:49:41.276782+0000","last_clean":"2024-08-17T02:49:41.276782+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:49:41.276782+0000","last_undegraded":"2024-08-17T02:49:41.276782+0000","last_fullsized":"2024-08-17T02:49:41.276782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:46:07.711736+0000","last_clean_scrub_stamp":"2024-08-17T02:46:07.711736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1118208,"data_stored":808140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.57799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.03,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.434},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.751,"15min":0.747},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.006,"5min":1.286,"15min":1.286},"last":0.58499999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.71299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":1.972,"15min":1.972},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.63},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.68799999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.351,"15min":1.351},"last":0.70599999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":1.02,"15min":1.02},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.63700000000000001,"15min":0.66500000000000004},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.82599999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98999999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76700000000000002,"15min":0.80700000000000005},"min":{"1min":0.433,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.61899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.50600000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.58099999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.55200000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.748,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73199999999999998,"15min":0.71699999999999997},"min":{"1min":0.626,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.752,"15min":0.747},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97999999999999998,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88100000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68300000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63200000000000001,"15min":0.66100000000000003},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.749,"5min":1.05,"15min":1.05},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.105,"15min":1.105},"last":0.44400000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68000000000000005,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70399999999999996,"15min":0.72099999999999997},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84099999999999997,"5min":1.101,"15min":1.101},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:49:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95999999999999996,"5min":1.151,"15min":1.151},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93000000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71099999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.54600000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.628,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0549999999999999,"5min":1.359,"15min":1.359},"last":0.79900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69599999999999995,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":1.032,"15min":1.032},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.72699999999999998,"15min":0.71099999999999997},"min":{"1min":0.57899999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.02,"5min":1.075,"15min":1.075},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81299999999999994,"5min":1.119,"15min":1.119},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89000000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.286,"15min":1.286},"last":0.749}]},{"osd":7,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.57599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89600000000000002,"5min":1.165,"15min":1.165},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.61699999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94499999999999995,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88100000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69299999999999995,"15min":0.65200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95099999999999996,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.624}]},{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.751},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.52500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":6.859,"15min":6.859},"last":0.69099999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":0.85799999999999998},"min":{"1min":0.67300000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.86499999999999999,"15min":0.86299999999999999},"min":{"1min":0.61599999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95299999999999996,"5min":5.2969999999999997,"15min":5.2969999999999997},"last":0.82399999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84099999999999997,"15min":0.87},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96399999999999997,"5min":3.7149999999999999,"15min":3.7149999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91300000000000003,"5min":8.2899999999999991,"15min":8.2899999999999991},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":6.0640000000000001,"15min":6.0640000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.85399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.495},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.874,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.78500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91900000000000004,"5min":2.484,"15min":2.484},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.876,"15min":0.82299999999999995},"min":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":12.157999999999999,"15min":12.157999999999999},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.622,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.316},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.58299999999999996,"15min":0.624},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70699999999999996,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.64700000000000002,"15min":0.73099999999999998},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.59499999999999997,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.65300000000000002},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.75600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85699999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85099999999999998,"15min":0.90500000000000003},"min":{"1min":0.57799999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0649999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.52300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93100000000000005,"15min":0.998},"min":{"1min":0.65700000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":4.0940000000000003,"15min":4.0940000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.89300000000000002,"15min":0.94599999999999995},"min":{"1min":0.60399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.03,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.88100000000000001,"15min":0.92600000000000005},"min":{"1min":0.63500000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94099999999999995,"5min":1.992,"15min":1.992},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88600000000000001,"15min":0.92700000000000005},"min":{"1min":0.624,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.206,"5min":2.056,"15min":2.056},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.95599999999999996},"min":{"1min":0.64500000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.153,"5min":2.113,"15min":2.113},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.92800000000000005,"15min":0.98599999999999999},"min":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.121,"5min":2.98,"15min":2.98},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.58799999999999997,"15min":0.66000000000000003},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":6.0810000000000004,"15min":6.0810000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.38}]},{"osd":1,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.63700000000000001,"15min":0.69699999999999995},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76400000000000001,"15min":0.82999999999999996},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.91000000000000003,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93300000000000005,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98399999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0580000000000001,"5min":1.845,"15min":1.845},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.93999999999999995,"15min":1.018},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.97399999999999998,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97599999999999998,"5min":6.3899999999999997,"15min":6.3899999999999997},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.93400000000000005,"15min":1},"min":{"1min":0.61199999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98499999999999999,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.81599999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98799999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.96299999999999997,"15min":1.0389999999999999},"min":{"1min":0.57899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.008,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":0.78000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.47399999999999998,"15min":0.496},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.32800000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.56999999999999995,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64700000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.751,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73499999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.66800000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.55000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0820000000000001,"5min":3.673,"15min":3.673},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.034,"5min":2.492,"15min":2.492},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.98499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.626},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.878},"min":{"1min":0.57999999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95699999999999996,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.65600000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.627,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.111,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.014,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.59299999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1118208,"data_stored":808140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.318,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58799999999999997,"5min":1.403,"15min":1.403},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.376,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72999999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.433}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64900000000000002,"5min":1.466,"15min":1.466},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.58999999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78400000000000003,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.59299999999999997},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78100000000000003,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.026,"5min":3.294,"15min":3.294},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.64200000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.61399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.63400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0269999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.623},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.79600000000000004},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97499999999999998,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.629}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.78800000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.038,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.69999999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95199999999999996,"5min":2.871,"15min":2.871},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.83299999999999996},"min":{"1min":0.66600000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.63500000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":3.347,"15min":3.347},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:49:51.216 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:46:07.711736+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=46, tm_sec=7, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=49, tm_sec=45, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:49:51.216 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:50:09.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:09.766 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:11.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:50:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.371+0000 7fe9f7400640 1 Processor -- start 2024-08-17T02:50:11.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.371+0000 7fe9f7400640 1 -- start start 2024-08-17T02:50:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.372+0000 7fe9f7400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9f00ad960 0x7fe9f015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.372+0000 7fe9f7400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f015b5e0 con 0x7fe9f00add30 2024-08-17T02:50:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.372+0000 7fe9f7400640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f00cb160 con 0x7fe9f00ca050 2024-08-17T02:50:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.372+0000 7fe9f7400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f00b0d10 con 0x7fe9f00ad960 2024-08-17T02:50:11.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.372+0000 7fe9f4a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe9f00ad960 0x7fe9f015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.372+0000 7fe9f5400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe9f00add30 0x7fe9f00aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35882/0 (socket says 172.21.15.2:35882) 2024-08-17T02:50:11.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.372+0000 7fe9f5400640 1 -- 172.21.15.2:0/4152303482 learned_addr learned my addr 172.21.15.2:0/4152303482 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:50:11.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.373+0000 7fe9f4a00640 1 -- 172.21.15.2:0/4152303482 >> v1:172.21.15.26:6789/0 conn(0x7fe9f00ca050 legacy=0x7fe9f0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.373+0000 7fe9f4a00640 1 -- 172.21.15.2:0/4152303482 >> v1:172.21.15.2:6789/0 conn(0x7fe9f00add30 legacy=0x7fe9f00aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.373+0000 7fe9f4a00640 1 -- 172.21.15.2:0/4152303482 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f00ca550 con 0x7fe9f00ad960 2024-08-17T02:50:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.373+0000 7fe9ef400640 1 -- 172.21.15.2:0/4152303482 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958253406 0 0) 0x7fe9e8001490 con 0x7fe9f00add30 2024-08-17T02:50:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.374+0000 7fe9f4a00640 1 --2- 172.21.15.2:0/4152303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ad960 0x7fe9f015b0a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009850 tx=0x7fe9e40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3357f382d95407 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.374+0000 7fe9ef400640 1 -- 172.21.15.2:0/4152303482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4032440 con 0x7fe9f00ad960 2024-08-17T02:50:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.374+0000 7fe9ef400640 1 -- 172.21.15.2:0/4152303482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e40325a0 con 0x7fe9f00ad960 2024-08-17T02:50:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.374+0000 7fe9ef400640 1 -- 172.21.15.2:0/4152303482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4032940 con 0x7fe9f00ad960 2024-08-17T02:50:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.375+0000 7fe9f7400640 1 -- 172.21.15.2:0/4152303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ad960 msgr2=0x7fe9f015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.375+0000 7fe9f7400640 1 --2- 172.21.15.2:0/4152303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ad960 0x7fe9f015b0a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009850 tx=0x7fe9e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.375+0000 7fe9f7400640 1 -- 172.21.15.2:0/4152303482 shutdown_connections 2024-08-17T02:50:11.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.375+0000 7fe9f7400640 1 --2- 172.21.15.2:0/4152303482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ad960 0x7fe9f015b0a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.375+0000 7fe9f7400640 1 -- 172.21.15.2:0/4152303482 >> 172.21.15.2:0/4152303482 conn(0x7fe9f0066e60 msgr2=0x7fe9f0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.375+0000 7fe9f7400640 1 -- 172.21.15.2:0/4152303482 shutdown_connections 2024-08-17T02:50:11.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.375+0000 7fe9f7400640 1 -- 172.21.15.2:0/4152303482 wait complete. 2024-08-17T02:50:11.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.377+0000 7fe9f7400640 1 Processor -- start 2024-08-17T02:50:11.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.377+0000 7fe9f7400640 1 -- start start 2024-08-17T02:50:11.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f7400640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f00ad960 0x7fe9f01482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f7400640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f00add30 0x7fe9f006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ca050 0x7fe9f006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f7400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f016d0d0 con 0x7fe9f00ca050 2024-08-17T02:50:11.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f7400640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f016c4c0 con 0x7fe9f00ad960 2024-08-17T02:50:11.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f7400640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f016c7a0 con 0x7fe9f00add30 2024-08-17T02:50:11.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f5400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ca050 0x7fe9f006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f5400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ca050 0x7fe9f006dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45176/0 (socket says 172.21.15.2:45176) 2024-08-17T02:50:11.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f5400640 1 -- 172.21.15.2:0/646187472 learned_addr learned my addr 172.21.15.2:0/646187472 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:50:11.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.378+0000 7fe9f4a00640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f00ad960 0x7fe9f01482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9efe00640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f00add30 0x7fe9f006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9f5400640 1 -- 172.21.15.2:0/646187472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f00add30 msgr2=0x7fe9f006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9f5400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f00add30 0x7fe9f006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9f5400640 1 -- 172.21.15.2:0/646187472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f00ad960 msgr2=0x7fe9f01482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9f5400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f00ad960 0x7fe9f01482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9f5400640 1 -- 172.21.15.2:0/646187472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4009390 con 0x7fe9f00ca050 2024-08-17T02:50:11.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9f5400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ca050 0x7fe9f006dd10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800cc90 tx=0x7fe9e8001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9e3e00640 1 -- 172.21.15.2:0/646187472 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8004b20 con 0x7fe9f00ca050 2024-08-17T02:50:11.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9e3e00640 1 -- 172.21.15.2:0/646187472 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8004c80 con 0x7fe9f00ca050 2024-08-17T02:50:11.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.379+0000 7fe9e3e00640 1 -- 172.21.15.2:0/646187472 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800aaa0 con 0x7fe9f00ca050 2024-08-17T02:50:11.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.380+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f016ca80 con 0x7fe9f00ca050 2024-08-17T02:50:11.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.380+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f016c170 con 0x7fe9f00ca050 2024-08-17T02:50:11.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.381+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f00a88e0 con 0x7fe9f00ca050 2024-08-17T02:50:11.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.381+0000 7fe9e3e00640 1 -- 172.21.15.2:0/646187472 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe9e80070f0 con 0x7fe9f00ca050 2024-08-17T02:50:11.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.383+0000 7fe9e3e00640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe9d0065150 0x7fe9d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.383+0000 7fe9e3e00640 1 -- 172.21.15.2:0/646187472 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe9e8081bc0 con 0x7fe9f00ca050 2024-08-17T02:50:11.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.383+0000 7fe9f4a00640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe9d0065150 0x7fe9d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.384+0000 7fe9f4a00640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe9d0065150 0x7fe9d0067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4034000 tx=0x7fe9e4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.387+0000 7fe9e3e00640 1 -- 172.21.15.2:0/646187472 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe9e804ffb0 con 0x7fe9f00ca050 2024-08-17T02:50:11.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.593+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 --> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9f015b5e0 con 0x7fe9d0065150 2024-08-17T02:50:11.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.595+0000 7fe9e3e00640 1 -- 172.21.15.2:0/646187472 <== mgr.4104 v2:172.21.15.2:6832/36682 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50806 (secure 0 0 0) 0x7fe9f015b5e0 con 0x7fe9d0065150 2024-08-17T02:50:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:50:11.596 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-08-17T02:50:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe9d0065150 msgr2=0x7fe9d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe9d0065150 0x7fe9d0067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4034000 tx=0x7fe9e4032000 comp rx=0 tx=0).stop 2024-08-17T02:50:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ca050 msgr2=0x7fe9f006dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ca050 0x7fe9f006dd10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800cc90 tx=0x7fe9e8001a50 comp rx=0 tx=0).stop 2024-08-17T02:50:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 shutdown_connections 2024-08-17T02:50:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9f00ca050 0x7fe9f006dd10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7fe9d0065150 0x7fe9d0067600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7fe9f00add30 0x7fe9f006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 --2- 172.21.15.2:0/646187472 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9f00ad960 0x7fe9f01482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 >> 172.21.15.2:0/646187472 conn(0x7fe9f0066e60 msgr2=0x7fe9f01527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 shutdown_connections 2024-08-17T02:50:11.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.597+0000 7fe9f7400640 1 -- 172.21.15.2:0/646187472 wait complete. 2024-08-17T02:50:11.613 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-08-17T02:50:11.072016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2417388,"kb_used_data":5256,"kb_used_omap":13,"kb_used_meta":2412018,"kb_avail":752557332,"statfs":{"total":773094113280,"available":770618707968,"internally_reserved":0,"allocated":5382144,"data_stored":2922912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2469907136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002734"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":198,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:49:54.021998+0000","last_change":"2024-08-17T02:49:54.021951+0000","last_active":"2024-08-17T02:49:54.021998+0000","last_peered":"2024-08-17T02:49:54.021998+0000","last_clean":"2024-08-17T02:49:54.021998+0000","last_became_active":"2024-08-17T02:46:08.819966+0000","last_became_peered":"2024-08-17T02:46:08.819966+0000","last_unstale":"2024-08-17T02:49:54.021998+0000","last_undegraded":"2024-08-17T02:49:54.021998+0000","last_fullsized":"2024-08-17T02:49:54.021998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2024-08-17T02:49:54.021854+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2024-08-17T02:49:54.021854+0000","last_clean_scrub_stamp":"2024-08-17T02:49:54.021854+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:32.886012+0000","scrub_duration":0.0058303929999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1118208,"data_stored":808140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.57799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.03,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.625},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.751,"15min":0.747},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.006,"5min":1.286,"15min":1.286},"last":0.69599999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.71299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":1.972,"15min":1.972},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97999999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.50900000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97099999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.054,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.68799999999999994,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.351,"15min":1.351},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":1.02,"15min":1.02},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.63700000000000001,"15min":0.66500000000000004},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.82599999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.69199999999999995,"15min":0.73699999999999999},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.51900000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.441}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98999999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76700000000000002,"15min":0.80700000000000005},"min":{"1min":0.433,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.50900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:50:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.83199999999999996,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.77900000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:50:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66400000000000003,"15min":0.64400000000000002},"min":{"1min":0.50900000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.91900000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.66400000000000003},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.86199999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.72999999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:50:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.748,"15min":0.74299999999999999},"min":{"1min":0.55300000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94899999999999995,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:50:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.747,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.80300000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:50:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":1.05,"15min":1.05},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81200000000000006,"5min":1.105,"15min":1.105},"last":0.63100000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:50:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65900000000000003,"15min":0.69799999999999995},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80900000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68100000000000005,"15min":0.71299999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82099999999999995,"5min":1.101,"15min":1.101},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:50:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.71999999999999997,"15min":0.754},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73799999999999999,"15min":0.78200000000000003},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.85699999999999998,"5min":1.151,"15min":1.151},"last":0.57299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93000000000000005,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.67900000000000005,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0069999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67100000000000004},"min":{"1min":0.54600000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74299999999999999,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.628,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0549999999999999,"5min":1.359,"15min":1.359},"last":0.66700000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69599999999999995,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":1.032,"15min":1.032},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.72699999999999998,"15min":0.71099999999999997},"min":{"1min":0.57899999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.02,"5min":1.075,"15min":1.075},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.67100000000000004,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81299999999999994,"5min":1.119,"15min":1.119},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.52000000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89000000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.442},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.286,"15min":1.286},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:14 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.57599999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89600000000000002,"5min":1.165,"15min":1.165},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.76600000000000001},"min":{"1min":0.61699999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94499999999999995,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88100000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69299999999999995,"15min":0.65200000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95099999999999996,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":0.93400000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.57399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.52500000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.95899999999999996,"5min":6.859,"15min":6.859},"last":0.63}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.89800000000000002,"15min":0.85799999999999998},"min":{"1min":0.67300000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.86499999999999999,"15min":0.86299999999999999},"min":{"1min":0.61599999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95299999999999996,"5min":5.2969999999999997,"15min":5.2969999999999997},"last":0.85099999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.84099999999999997,"15min":0.87},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96399999999999997,"5min":3.7149999999999999,"15min":3.7149999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.85499999999999998,"15min":0.81899999999999995},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91300000000000003,"5min":8.2899999999999991,"15min":8.2899999999999991},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":6.0640000000000001,"15min":6.0640000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.46200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83199999999999996,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.55700000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90300000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.874,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.72999999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91900000000000004,"5min":2.484,"15min":2.484},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.876,"15min":0.82299999999999995},"min":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":12.157999999999999,"15min":12.157999999999999},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.622,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.58299999999999996,"15min":0.624},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70699999999999996,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.64700000000000002,"15min":0.73099999999999998},"min":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.59499999999999997,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.61499999999999999,"15min":0.65300000000000002},"min":{"1min":0.40500000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82599999999999996,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.70399999999999996,"15min":0.75600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76600000000000001,"5min":2.9380000000000002,"15min":2.9380000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72899999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85699999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.61699999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.85099999999999998,"15min":0.90500000000000003},"min":{"1min":0.57799999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0649999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.88100000000000001,"15min":0.93500000000000005},"min":{"1min":0.52300000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.93100000000000005,"15min":0.998},"min":{"1min":0.65700000000000003,"5min":0.62,"15min":0.62},"max":{"1min":1.2370000000000001,"5min":4.0940000000000003,"15min":4.0940000000000003},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.89300000000000002,"15min":0.94599999999999995},"min":{"1min":0.60399999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.03,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.88100000000000001,"15min":0.92600000000000005},"min":{"1min":0.63500000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94099999999999995,"5min":1.992,"15min":1.992},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88600000000000001,"15min":0.92700000000000005},"min":{"1min":0.624,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.206,"5min":2.056,"15min":2.056},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90600000000000003,"15min":0.95599999999999996},"min":{"1min":0.64500000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.153,"5min":2.113,"15min":2.113},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.92800000000000005,"15min":0.98599999999999999},"min":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.121,"5min":2.98,"15min":2.98},"last":0.749}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302032,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069808,"statfs":{"total":96636764160,"available":96327483392,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.58799999999999997,"15min":0.66000000000000003},"min":{"1min":0.34100000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70599999999999996,"5min":6.0810000000000004,"15min":6.0810000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.53300000000000003},"min":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.48099999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.63700000000000001,"15min":0.69699999999999995},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70799999999999996,"5min":5.9740000000000002,"15min":5.9740000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54000000000000004,"15min":0.54600000000000004},"min":{"1min":0.41299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73599999999999999,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.66600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72499999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76400000000000001,"15min":0.82999999999999996},"min":{"1min":0.51300000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82299999999999995,"5min":6.1120000000000001,"15min":6.1120000000000001},"last":0.59799999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.91000000000000003,"15min":0.97899999999999998},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93300000000000005,"5min":6.0499999999999998,"15min":6.0499999999999998},"last":0.873},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.98399999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.58299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0580000000000001,"5min":1.845,"15min":1.845},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.93999999999999995,"15min":1.018},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.97399999999999998,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.93899999999999995,"15min":1.0149999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97599999999999998,"5min":6.3899999999999997,"15min":6.3899999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.93400000000000005,"15min":1},"min":{"1min":0.61199999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.98499999999999999,"5min":6.0190000000000001,"15min":6.0190000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:49:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.82099999999999995,"15min":0.83399999999999996},"min":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98799999999999999,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.96299999999999997,"15min":1.0389999999999999},"min":{"1min":0.57899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.008,"5min":6.3579999999999997,"15min":6.3579999999999997},"last":0.81899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":524288,"data_stored":217772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.47399999999999998,"15min":0.496},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67400000000000004,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67700000000000005,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.56999999999999995,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.64700000000000002,"5min":3.6240000000000001,"15min":3.6240000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.751,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.73499999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.66800000000000004,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.55000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0820000000000001,"5min":3.673,"15min":3.673},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.034,"5min":2.492,"15min":2.492},"last":0.70099999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.98499999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.84399999999999997,"15min":0.878},"min":{"1min":0.57999999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95699999999999996,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.627,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.111,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.88500000000000001,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.014,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.749}]},{"osd":7,"last update":"Sat Aug 17 02:49:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82699999999999996,"15min":0.83099999999999996},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.96199999999999997,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0569999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.68999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1118208,"data_stored":808140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.318,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58799999999999997,"5min":1.403,"15min":1.403},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.376,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72999999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.64900000000000002,"5min":1.466,"15min":1.466},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.45400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.73399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78400000000000003,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.59299999999999997},"min":{"1min":0.49099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.78100000000000003,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.86799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.78500000000000003},"min":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.026,"5min":3.294,"15min":3.294},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.64200000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":0.95999999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.63400000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0269999999999999,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.79600000000000004},"min":{"1min":0.60299999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97499999999999998,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.78800000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.038,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.69999999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95199999999999996,"5min":2.871,"15min":2.871},"last":0.83999999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:49:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84499999999999997,"15min":0.83299999999999996},"min":{"1min":0.66600000000000004,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.02,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83799999999999997,"15min":0.81599999999999995},"min":{"1min":0.63500000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":3.347,"15min":3.347},"last":1.052}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:50:11.616 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:50:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.765+0000 7f5b6d200640 1 Processor -- start 2024-08-17T02:50:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.765+0000 7f5b6d200640 1 -- start start 2024-08-17T02:50:11.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.766+0000 7f5b6d200640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5b68158b90 0x7f5b680b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b6d200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 0x7f5b680aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b6d200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680af380 con 0x7f5b680aef60 2024-08-17T02:50:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b6d200640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680afd20 con 0x7f5b68158b90 2024-08-17T02:50:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b6d200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680affe0 con 0x7f5b680b2370 2024-08-17T02:50:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b66800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5b680aef60 0x7f5b68068630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35884/0 (socket says 172.21.15.2:35884) 2024-08-17T02:50:11.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b66800640 1 -- 172.21.15.2:0/3402829417 learned_addr learned my addr 172.21.15.2:0/3402829417 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:50:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b5fe00640 1 --2- 172.21.15.2:0/3402829417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 0x7f5b680aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b65e00640 1 --2- 172.21.15.2:0/3402829417 >> v2:172.21.15.26:3300/0 conn(0x7f5b68158b90 0x7f5b680b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b65400640 1 -- 172.21.15.2:0/3402829417 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232921408 0 0) 0x7f5b680af380 con 0x7f5b680aef60 2024-08-17T02:50:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.767+0000 7f5b65400640 1 -- 172.21.15.2:0/3402829417 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b4c0034e0 con 0x7f5b680aef60 2024-08-17T02:50:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.768+0000 7f5b65e00640 1 -- 172.21.15.2:0/3402829417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 msgr2=0x7f5b680aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.768+0000 7f5b65e00640 1 --2- 172.21.15.2:0/3402829417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 0x7f5b680aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.768+0000 7f5b65400640 1 -- 172.21.15.2:0/3402829417 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268880358 0 0) 0x7f5b4c0034e0 con 0x7f5b680aef60 2024-08-17T02:50:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.768+0000 7f5b65e00640 1 -- 172.21.15.2:0/3402829417 >> v1:172.21.15.2:6789/0 conn(0x7f5b680aef60 legacy=0x7f5b68068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.768+0000 7f5b65e00640 1 -- 172.21.15.2:0/3402829417 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680b02c0 con 0x7f5b68158b90 2024-08-17T02:50:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.769+0000 7f5b65e00640 1 --2- 172.21.15.2:0/3402829417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 0x7f5b680b1e30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009850 tx=0x7f5b580090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a447c5a8b6e711e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.769+0000 7f5b65400640 1 -- 172.21.15.2:0/3402829417 <== mon.1 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600017f0 con 0x7f5b68158b90 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.769+0000 7f5b65400640 1 -- 172.21.15.2:0/3402829417 <== mon.1 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5802aa50 con 0x7f5b68158b90 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.769+0000 7f5b65400640 1 -- 172.21.15.2:0/3402829417 <== mon.1 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5802adf0 con 0x7f5b68158b90 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.770+0000 7f5b6d200640 1 -- 172.21.15.2:0/3402829417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 msgr2=0x7f5b680b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.770+0000 7f5b6d200640 1 --2- 172.21.15.2:0/3402829417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 0x7f5b680b1e30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009850 tx=0x7f5b580090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.770+0000 7f5b6d200640 1 -- 172.21.15.2:0/3402829417 shutdown_connections 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.770+0000 7f5b6d200640 1 --2- 172.21.15.2:0/3402829417 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 0x7f5b680aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.770+0000 7f5b6d200640 1 --2- 172.21.15.2:0/3402829417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 0x7f5b680b1e30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.770+0000 7f5b6d200640 1 -- 172.21.15.2:0/3402829417 >> 172.21.15.2:0/3402829417 conn(0x7f5b6806e590 msgr2=0x7f5b6806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.770+0000 7f5b6d200640 1 -- 172.21.15.2:0/3402829417 shutdown_connections 2024-08-17T02:50:11.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.770+0000 7f5b6d200640 1 -- 172.21.15.2:0/3402829417 wait complete. 2024-08-17T02:50:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.771+0000 7f5b6d200640 1 Processor -- start 2024-08-17T02:50:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.772+0000 7f5b6d200640 1 -- start start 2024-08-17T02:50:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.772+0000 7f5b6d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b680aef60 0x7f5b68169170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.772+0000 7f5b6d200640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 0x7f5b68157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b6d200640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 0x7f5b680c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b6d200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6815f150 con 0x7f5b680aef60 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b6d200640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6815e2a0 con 0x7f5b68158b90 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b6d200640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6815e540 con 0x7f5b680b2370 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b65e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b680aef60 0x7f5b68169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b65e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b680aef60 0x7f5b68169170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45182/0 (socket says 172.21.15.2:45182) 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b65e00640 1 -- 172.21.15.2:0/2114414094 learned_addr learned my addr 172.21.15.2:0/2114414094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b66800640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 0x7f5b680c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b5fe00640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 0x7f5b68157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b65e00640 1 -- 172.21.15.2:0/2114414094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 msgr2=0x7f5b68157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b65e00640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 0x7f5b68157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b65e00640 1 -- 172.21.15.2:0/2114414094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 msgr2=0x7f5b680c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b65e00640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 0x7f5b680c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.773+0000 7f5b65e00640 1 -- 172.21.15.2:0/2114414094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58009390 con 0x7f5b680aef60 2024-08-17T02:50:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.774+0000 7f5b65e00640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b680aef60 0x7f5b68169170 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009850 tx=0x7f5b58032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.774+0000 7f5b5d600640 1 -- 172.21.15.2:0/2114414094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58032e60 con 0x7f5b680aef60 2024-08-17T02:50:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.774+0000 7f5b5d600640 1 -- 172.21.15.2:0/2114414094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5803d420 con 0x7f5b680aef60 2024-08-17T02:50:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.774+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6815e820 con 0x7f5b680aef60 2024-08-17T02:50:11.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.774+0000 7f5b5d600640 1 -- 172.21.15.2:0/2114414094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5803d7e0 con 0x7f5b680aef60 2024-08-17T02:50:11.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.774+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6815ede0 con 0x7f5b680aef60 2024-08-17T02:50:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.775+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b68063fb0 con 0x7f5b680aef60 2024-08-17T02:50:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.777+0000 7f5b5d600640 1 -- 172.21.15.2:0/2114414094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5b58039040 con 0x7f5b680aef60 2024-08-17T02:50:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.778+0000 7f5b5d600640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5b44065180 0x7f5b44067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.778+0000 7f5b5d600640 1 -- 172.21.15.2:0/2114414094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5b580a1ac0 con 0x7f5b680aef60 2024-08-17T02:50:11.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.778+0000 7f5b5fe00640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5b44065180 0x7f5b44067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:11.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.779+0000 7f5b5fe00640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5b44065180 0x7f5b44067630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b680c9fd0 tx=0x7f5b50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:11.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.782+0000 7f5b5d600640 1 -- 172.21.15.2:0/2114414094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5b5806fd80 con 0x7f5b680aef60 2024-08-17T02:50:11.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.966+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f5b68158740 con 0x7f5b680aef60 2024-08-17T02:50:11.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.972+0000 7f5b5d600640 1 -- 172.21.15.2:0/2114414094 <== mon.0 v2:172.21.15.2:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5b5806fd80 con 0x7f5b680aef60 2024-08-17T02:50:11.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.972+0000 7f5b5d600640 1 -- 172.21.15.2:0/2114414094 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5b5803fed0 con 0x7f5b680aef60 2024-08-17T02:50:11.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5b44065180 msgr2=0x7f5b44067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5b44065180 0x7f5b44067630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b680c9fd0 tx=0x7f5b50008040 comp rx=0 tx=0).stop 2024-08-17T02:50:11.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b680aef60 msgr2=0x7f5b68169170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b680aef60 0x7f5b68169170 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009850 tx=0x7f5b58032000 comp rx=0 tx=0).stop 2024-08-17T02:50:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 shutdown_connections 2024-08-17T02:50:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b68158b90 0x7f5b680c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f5b44065180 0x7f5b44067630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f5b680b2370 0x7f5b68157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 --2- 172.21.15.2:0/2114414094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b680aef60 0x7f5b68169170 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:11.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 >> 172.21.15.2:0/2114414094 conn(0x7f5b6806e590 msgr2=0x7f5b680cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:11.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 shutdown_connections 2024-08-17T02:50:11.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:11.976+0000 7f5b6d200640 1 -- 172.21.15.2:0/2114414094 wait complete. 2024-08-17T02:50:11.997 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:50:11.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:50:12.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.149+0000 7f930da00640 1 Processor -- start 2024-08-17T02:50:12.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.149+0000 7f930da00640 1 -- start start 2024-08-17T02:50:12.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.150+0000 7f930da00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9308158c60 0x7f930815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.150+0000 7f930da00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9308159030 0x7f93080ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.150+0000 7f930da00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930815b6b0 con 0x7f9308159420 2024-08-17T02:50:12.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.150+0000 7f930da00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93080b0540 con 0x7f9308159030 2024-08-17T02:50:12.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.150+0000 7f930da00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930815aac0 con 0x7f9308158c60 2024-08-17T02:50:12.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.150+0000 7f930d000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9308159420 0x7f93080b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35886/0 (socket says 172.21.15.2:35886) 2024-08-17T02:50:12.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.150+0000 7f930d000640 1 -- 172.21.15.2:0/2503021057 learned_addr learned my addr 172.21.15.2:0/2503021057 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-08-17T02:50:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307e00640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9308158c60 0x7f930815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f92ffe00640 1 --2- 172.21.15.2:0/2503021057 >> v2:172.21.15.26:3300/0 conn(0x7f9308159030 0x7f93080ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976360927 0 0) 0x7f930815b6b0 con 0x7f9308159420 2024-08-17T02:50:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ec0034e0 con 0x7f9308159420 2024-08-17T02:50:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3188523780 0 0) 0x7f92ec0034e0 con 0x7f9308159420 2024-08-17T02:50:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9308158c60 msgr2=0x7f930815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9308158c60 0x7f930815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 >> v2:172.21.15.26:3300/0 conn(0x7f9308159030 msgr2=0x7f93080ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 --2- 172.21.15.2:0/2503021057 >> v2:172.21.15.26:3300/0 conn(0x7f9308159030 0x7f93080ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930815ad80 con 0x7f9308159420 2024-08-17T02:50:12.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3969347051 0 0) 0x7f93000017f0 con 0x7f9308159420 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 >> v1:172.21.15.2:6789/0 conn(0x7f9308159420 legacy=0x7f93080b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92ec003a40 0x7f92ec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec004780 0x7f92ec004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9308158c60 0x7f92ec005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080b0540 con 0x7f92ec003a40 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930815aac0 con 0x7f92ec004780 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.151+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec00ba00 con 0x7f9308158c60 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.152+0000 7f9307e00640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92ec003a40 0x7f92ec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.152+0000 7f930d000640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9308158c60 0x7f92ec005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.152+0000 7f92ffe00640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec004780 0x7f92ec004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.152+0000 7f9307e00640 1 -- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9308158c60 msgr2=0x7f92ec005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:12.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.152+0000 7f9307e00640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f9308158c60 0x7f92ec005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.152+0000 7f9307e00640 1 -- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec004780 msgr2=0x7f92ec004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:50:12.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.152+0000 7f9307e00640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f92ec004780 0x7f92ec004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.152+0000 7f9307e00640 1 -- 172.21.15.2:0/2503021057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0034e0 con 0x7f92ec003a40 2024-08-17T02:50:12.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.153+0000 7f9307e00640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92ec003a40 0x7f92ec003e50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009b70 tx=0x7f92f80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fbda9c65adde7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.153+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8031400 con 0x7f92ec003a40 2024-08-17T02:50:12.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.153+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f92f802d050 con 0x7f92ec003a40 2024-08-17T02:50:12.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.153+0000 7f9307400640 1 -- 172.21.15.2:0/2503021057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80317b0 con 0x7f92ec003a40 2024-08-17T02:50:12.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.154+0000 7f930da00640 1 -- 172.21.15.2:0/2503021057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92ec003a40 msgr2=0x7f92ec003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.154+0000 7f930da00640 1 --2- 172.21.15.2:0/2503021057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92ec003a40 0x7f92ec003e50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009b70 tx=0x7f92f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.154+0000 7f930d000640 1 -- 172.21.15.2:0/2503021057 reap_dead start 2024-08-17T02:50:12.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.154+0000 7f930da00640 1 -- 172.21.15.2:0/2503021057 shutdown_connections 2024-08-17T02:50:12.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.154+0000 7f930da00640 1 -- 172.21.15.2:0/2503021057 >> 172.21.15.2:0/2503021057 conn(0x7f930806e590 msgr2=0x7f930806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.154+0000 7f930da00640 1 -- 172.21.15.2:0/2503021057 shutdown_connections 2024-08-17T02:50:12.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.154+0000 7f930da00640 1 -- 172.21.15.2:0/2503021057 wait complete. 2024-08-17T02:50:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.155+0000 7f930da00640 1 Processor -- start 2024-08-17T02:50:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.156+0000 7f930da00640 1 -- start start 2024-08-17T02:50:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.156+0000 7f930da00640 1 --2- >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ec003a40 0x7f93080ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.156+0000 7f930da00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930816bfe0 0x7f930816c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.156+0000 7f930da00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93080c4570 0x7f93080c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.156+0000 7f930da00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080cf0f0 con 0x7f93080c4570 2024-08-17T02:50:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.156+0000 7f930da00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930816c990 con 0x7f930816bfe0 2024-08-17T02:50:12.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.156+0000 7f930da00640 1 -- --> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93080c37b0 con 0x7f92ec003a40 2024-08-17T02:50:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f930d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93080c4570 0x7f93080c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f930d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93080c4570 0x7f93080c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45194/0 (socket says 172.21.15.2:45194) 2024-08-17T02:50:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f930d000640 1 -- 172.21.15.2:0/3417309635 learned_addr learned my addr 172.21.15.2:0/3417309635 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-08-17T02:50:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f92ffe00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930816bfe0 0x7f930816c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f9307e00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ec003a40 0x7f93080ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f930d000640 1 -- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ec003a40 msgr2=0x7f93080ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f930d000640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ec003a40 0x7f93080ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f930d000640 1 -- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930816bfe0 msgr2=0x7f930816c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f930d000640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930816bfe0 0x7f930816c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f930d000640 1 -- 172.21.15.2:0/3417309635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080c3a90 con 0x7f93080c4570 2024-08-17T02:50:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.157+0000 7f92ffe00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930816bfe0 0x7f930816c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:50:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.158+0000 7f930d000640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93080c4570 0x7f93080c49e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f930815a9f0 tx=0x7f9300002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.158+0000 7f92ff400640 1 -- 172.21.15.2:0/3417309635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000136d0 con 0x7f93080c4570 2024-08-17T02:50:12.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.158+0000 7f92ff400640 1 -- 172.21.15.2:0/3417309635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9300013850 con 0x7f93080c4570 2024-08-17T02:50:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.158+0000 7f92ff400640 1 -- 172.21.15.2:0/3417309635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300013c30 con 0x7f93080c4570 2024-08-17T02:50:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.158+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93080c3d70 con 0x7f93080c4570 2024-08-17T02:50:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.158+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93080c4f20 con 0x7f93080c4570 2024-08-17T02:50:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.159+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93080c4270 con 0x7f93080c4570 2024-08-17T02:50:12.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.160+0000 7f92ff400640 1 -- 172.21.15.2:0/3417309635 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f930001e460 con 0x7f93080c4570 2024-08-17T02:50:12.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.161+0000 7f92ff400640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f92e4065150 0x7f92e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:50:12.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.161+0000 7f92ff400640 1 -- 172.21.15.2:0/3417309635 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9300082380 con 0x7f93080c4570 2024-08-17T02:50:12.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.161+0000 7f9307e00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f92e4065150 0x7f92e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:50:12.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.162+0000 7f9307e00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f92e4065150 0x7f92e4067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92f8034000 tx=0x7f92f80090f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:50:12.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.165+0000 7f92ff400640 1 -- 172.21.15.2:0/3417309635 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f93000506c0 con 0x7f93080c4570 2024-08-17T02:50:12.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.408+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93080c3500 con 0x7f93080c4570 2024-08-17T02:50:12.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.409+0000 7f92ff400640 1 -- 172.21.15.2:0/3417309635 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f9300053ce0 con 0x7f93080c4570 2024-08-17T02:50:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-08-17T02:50:12.410 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1174897718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1174897718},{"type":"v1","addr":"172.21.15.26:6833","nonce":1174897718}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3143389454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3143389454},{"type":"v1","addr":"172.21.15.26:6835","nonce":3143389454}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5289,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2028182828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":2028182828},{"type":"v1","addr":"172.21.15.2:6837","nonce":2028182828}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5376,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6836/3565339451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3565339451},{"type":"v1","addr":"172.21.15.2:6836","nonce":3565339451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2024-08-17T02:50:12.411 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-08-17T02:50:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f92e4065150 msgr2=0x7f92e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f92e4065150 0x7f92e4067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92f8034000 tx=0x7f92f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93080c4570 msgr2=0x7f93080c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:50:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93080c4570 0x7f93080c49e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f930815a9f0 tx=0x7f9300002210 comp rx=0 tx=0).stop 2024-08-17T02:50:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 shutdown_connections 2024-08-17T02:50:12.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93080c4570 0x7f93080c49e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f930816bfe0 0x7f930816c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.2:6832/36682,v1:172.21.15.2:6833/36682] conn(0x7f92e4065150 0x7f92e4067600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 --2- 172.21.15.2:0/3417309635 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x7f92ec003a40 0x7f93080ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:50:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 >> 172.21.15.2:0/3417309635 conn(0x7f930806e590 msgr2=0x7f93080c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:50:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 shutdown_connections 2024-08-17T02:50:12.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-08-17T02:50:12.412+0000 7f930da00640 1 -- 172.21.15.2:0/3417309635 wait complete. 2024-08-17T02:50:12.427 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:50:12.428 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:50:12.428 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:50:12.428 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.442 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:50:12.442 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:50:12.442 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.497 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:50:12.497 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:50:12.497 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.513 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:50:12.513 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:50:12.514 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.569 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:50:12.569 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:50:12.570 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:50:12.570 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.616 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:50:12.616 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:50:12.616 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.674 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:50:12.675 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:50:12.675 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.725 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:50:12.725 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:50:12.725 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.779 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:50:12.779 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:50:12.780 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.828 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:50:12.828 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:50:12.828 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.881 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:50:12.881 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:50:12.881 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.933 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:50:12.933 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:50:12.933 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:12.981 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:50:12.981 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:50:12.981 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:50:12.981 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:13.042 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:50:13.042 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:50:13.043 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:13.099 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:50:13.100 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:50:13.100 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:50:13.100 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:13.120 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:50:13.120 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:50:13.120 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:13.137 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:50:13.138 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:50:13.138 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:50:13.197 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:50:13.198 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:50:13.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:50:13.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:50:13.278 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:50:13.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:50:13.576 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:50:13.689 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:50:13.689 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:50:13.788 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:50:13.788 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:50:13.890 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:50:13.890 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:50:14.095 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:50:14.096 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:50:14.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:50:14.213 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:50:14.313 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:50:14.313 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:50:14.421 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:50:14.422 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/data/mon.a.tgz 2024-08-17T02:50:14.422 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-08-17T02:50:14.459 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.Uh0AOabAm2 2024-08-17T02:50:14.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Uh0AOabAm2 2024-08-17T02:50:14.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.Uh0AOabAm2 2024-08-17T02:50:14.726 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.Uh0AOabAm2 is 311KB 2024-08-17T02:50:14.815 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.Uh0AOabAm2 2024-08-17T02:50:14.850 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/data/mon.b.tgz 2024-08-17T02:50:14.850 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-08-17T02:50:14.886 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.miECgIThBf 2024-08-17T02:50:14.886 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.miECgIThBf 2024-08-17T02:50:15.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.miECgIThBf 2024-08-17T02:50:15.174 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.miECgIThBf is 410KB 2024-08-17T02:50:15.266 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.miECgIThBf 2024-08-17T02:50:15.301 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/data/mon.c.tgz 2024-08-17T02:50:15.301 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-08-17T02:50:15.375 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.YDlmiiE3cW 2024-08-17T02:50:15.375 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YDlmiiE3cW 2024-08-17T02:50:15.557 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.YDlmiiE3cW 2024-08-17T02:50:15.652 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.YDlmiiE3cW is 410KB 2024-08-17T02:50:15.740 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.YDlmiiE3cW 2024-08-17T02:50:15.775 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:50:15.775 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:50:15.779 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:50:15.871 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:50:15.871 DEBUG:teuthology.orchestra.run.smithi002:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:50:15.875 DEBUG:teuthology.orchestra.run.smithi026:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:50:15.936 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:50:15.937 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:50:15.947 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:50:15.949 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/remote/smithi002/crash 2024-08-17T02:50:15.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:50:16.005 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/remote/smithi026/crash 2024-08-17T02:50:16.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:50:16.060 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:50:16.060 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:16.064 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:16.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:16.215 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:50:16.270 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:50:16.271 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:50:16.275 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:50:16.324 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48163.log 2024-08-17T02:50:16.325 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2024-08-17T02:50:16.326 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46693.log 2024-08-17T02:50:16.327 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48163.log.gz 2024-08-17T02:50:16.327 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2024-08-17T02:50:16.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2024-08-17T02:50:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37260.log 2024-08-17T02:50:16.329 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48644.log 2024-08-17T02:50:16.329 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46693.log.gz 2024-08-17T02:50:16.329 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2024-08-17T02:50:16.329 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2024-08-17T02:50:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41564.log 2024-08-17T02:50:16.331 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48644.log.gz 2024-08-17T02:50:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49721.log 2024-08-17T02:50:16.332 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz 2024-08-17T02:50:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:50:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37260.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:50:16.333 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37260.log.gz 2024-08-17T02:50:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42326.log 2024-08-17T02:50:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:50:16.333 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:50:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.1.42326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42326.log.gz 2024-08-17T02:50:16.334 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:50:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.7.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:50:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:50:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:50:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41579.log 2024-08-17T02:50:16.337 INFO:teuthology.orchestra.run.smithi026.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:50:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:50:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43412.log 87.6% 2024-08-17T02:50:16.339 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41564.log.gz 2024-08-17T02:50:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48457.log 2024-08-17T02:50:16.339 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49721.log.gz 2024-08-17T02:50:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45325.log 2024-08-17T02:50:16.340 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43412.log.gz 2024-08-17T02:50:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45753.log 2024-08-17T02:50:16.340 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48457.log.gz 2024-08-17T02:50:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45325.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45325.log.gz 2024-08-17T02:50:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48205.log 2024-08-17T02:50:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2024-08-17T02:50:16.340 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45753.log.gz 2024-08-17T02:50:16.341 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48686.log 2024-08-17T02:50:16.341 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48205.log.gz 2024-08-17T02:50:16.341 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41732.log 2024-08-17T02:50:16.341 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2024-08-17T02:50:16.341 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2024-08-17T02:50:16.341 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48686.log.gz 2024-08-17T02:50:16.341 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44599.log 2024-08-17T02:50:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.1.41579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41579.log.gz 2024-08-17T02:50:16.345 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:50:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2024-08-17T02:50:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:50:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37346.log 2024-08-17T02:50:16.346 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2024-08-17T02:50:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2024-08-17T02:50:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37346.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:50:16.346 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2024-08-17T02:50:16.346 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37346.log.gz 2024-08-17T02:50:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-08-17T02:50:16.347 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2024-08-17T02:50:16.352 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37304.log: 86.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37176.log 2024-08-17T02:50:16.352 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2024-08-17T02:50:16.353 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37216.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41900.log 2024-08-17T02:50:16.353 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-08-17T02:50:16.353 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37176.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:50:16.353 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37176.log.gz 2024-08-17T02:50:16.353 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.3.41900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41900.log.gz 2024-08-17T02:50:16.353 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:50:16.353 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-mds.d.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-08-17T02:50:16.354 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.37135.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-08-17T02:50:16.356 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41732.log.gz 2024-08-17T02:50:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41008.log 2024-08-17T02:50:16.357 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2024-08-17T02:50:16.357 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2024-08-17T02:50:16.357 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44599.log.gz 2024-08-17T02:50:16.357 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44557.log 2024-08-17T02:50:16.357 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41008.log.gz 2024-08-17T02:50:16.357 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45199.log 2024-08-17T02:50:16.357 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2024-08-17T02:50:16.357 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48121.log 2024-08-17T02:50:16.358 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44557.log.gz 2024-08-17T02:50:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47177.log 2024-08-17T02:50:16.358 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45199.log.gz 2024-08-17T02:50:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46827.log 2024-08-17T02:50:16.358 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48121.log.gz 2024-08-17T02:50:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47177.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:50:16.358 INFO:teuthology.orchestra.run.smithi002.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-08-17T02:50:16.358 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45073.log 2024-08-17T02:50:16.359 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46827.log.gz 2024-08-17T02:50:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:50:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45073.log: 84.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:50:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41956.log 2024-08-17T02:50:16.359 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45073.log.gz 2024-08-17T02:50:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2024-08-17T02:50:16.359 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2024-08-17T02:50:16.359 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41956.log.gz 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42284.log 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49209.log 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42284.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42284.log.gz 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46871.log 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48247.log 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49209.log.gz 2024-08-17T02:50:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48559.log 2024-08-17T02:50:16.361 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46871.log.gz 2024-08-17T02:50:16.361 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43034.log 2024-08-17T02:50:16.361 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48247.log.gz 2024-08-17T02:50:16.361 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43592.log 2024-08-17T02:50:16.361 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48559.log.gz 2024-08-17T02:50:16.364 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49311.log 2024-08-17T02:50:16.364 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43034.log.gz 2024-08-17T02:50:16.364 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36680.log 2024-08-17T02:50:16.364 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43592.log.gz 2024-08-17T02:50:16.364 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49311.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49311.log.gz 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41132.log 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46924.log 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.36680.log.gz 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41132.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41132.log.gz 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49931.log 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46924.log.gz 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41080.log 2024-08-17T02:50:16.365 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-08-17T02:50:16.366 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49931.log.gz 2024-08-17T02:50:16.366 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:50:16.367 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2024-08-17T02:50:16.367 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41080.log.gz 2024-08-17T02:50:16.368 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50183.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2024-08-17T02:50:16.368 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45669.log 2024-08-17T02:50:16.368 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49763.log 2024-08-17T02:50:16.368 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2024-08-17T02:50:16.368 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41690.log 2024-08-17T02:50:16.368 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45669.log.gz 2024-08-17T02:50:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50225.log 2024-08-17T02:50:16.369 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49763.log.gz 2024-08-17T02:50:16.369 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2024-08-17T02:50:16.369 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41690.log.gz 2024-08-17T02:50:16.370 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46167.log 2024-08-17T02:50:16.370 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50225.log.gz 2024-08-17T02:50:16.371 INFO:teuthology.orchestra.run.smithi026.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:50:16.372 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46785.log 2024-08-17T02:50:16.372 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2024-08-17T02:50:16.372 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42950.log 2024-08-17T02:50:16.372 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46167.log.gz 2024-08-17T02:50:16.373 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49889.log 2024-08-17T02:50:16.373 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46785.log.gz 2024-08-17T02:50:16.374 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46966.log 2024-08-17T02:50:16.374 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42950.log.gz 2024-08-17T02:50:16.375 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49889.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49889.log.gz 2024-08-17T02:50:16.375 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 2024-08-17T02:50:16.375 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46587.log 2024-08-17T02:50:16.375 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46966.log.gz 2024-08-17T02:50:16.376 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2024-08-17T02:50:16.376 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2024-08-17T02:50:16.377 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44285.log 2024-08-17T02:50:16.378 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46587.log.gz 2024-08-17T02:50:16.378 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44329.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2024-08-17T02:50:16.378 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43244.log 2024-08-17T02:50:16.379 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.2.44285.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:50:16.379 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44285.log.gz 2024-08-17T02:50:16.380 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41606.log 2024-08-17T02:50:16.380 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43244.log.gz 2024-08-17T02:50:16.381 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2024-08-17T02:50:16.382 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41606.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41606.log.gz 2024-08-17T02:50:16.382 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42536.log 2024-08-17T02:50:16.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43160.log 2024-08-17T02:50:16.383 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2024-08-17T02:50:16.383 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42536.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30613.log 2024-08-17T02:50:16.384 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42536.log.gz 2024-08-17T02:50:16.385 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41312.log 2024-08-17T02:50:16.385 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43160.log.gz 2024-08-17T02:50:16.385 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.tmp-client.admin.30613.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30613.log.gz 2024-08-17T02:50:16.386 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47601.log 2024-08-17T02:50:16.386 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42274.log 2024-08-17T02:50:16.387 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41312.log.gz 2024-08-17T02:50:16.388 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48415.log 2024-08-17T02:50:16.388 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47601.log.gz 2024-08-17T02:50:16.389 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41943.log 2024-08-17T02:50:16.389 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42274.log.gz 2024-08-17T02:50:16.389 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2024-08-17T02:50:16.390 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48415.log.gz 2024-08-17T02:50:16.390 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41943.log.gz 2024-08-17T02:50:16.391 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48499.log 2024-08-17T02:50:16.391 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47135.log: gzip -5 --verbose 87.7% -- /var/log/ceph/ceph-client.admin.41955.log -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2024-08-17T02:50:16.392 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:50:16.393 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-08-17T02:50:16.393 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48499.log.gz 2024-08-17T02:50:16.393 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43286.log 2024-08-17T02:50:16.394 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41955.log.gz 2024-08-17T02:50:16.394 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42626.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz --verbose 2024-08-17T02:50:16.394 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.42287.log 2024-08-17T02:50:16.395 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-08-17T02:50:16.396 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43286.log.gz 2024-08-17T02:50:16.396 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42287.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-08-17T02:50:16.396 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48896.log 2024-08-17T02:50:16.397 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50015.log 2024-08-17T02:50:16.398 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-08-17T02:50:16.398 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48896.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48896.log.gz 2024-08-17T02:50:16.398 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:50:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41268.log 2024-08-17T02:50:16.399 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50015.log.gz 2024-08-17T02:50:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41438.log 2024-08-17T02:50:16.401 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41268.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41268.log.gz 2024-08-17T02:50:16.402 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44683.log 2024-08-17T02:50:16.403 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49511.log 2024-08-17T02:50:16.403 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41438.log.gz 2024-08-17T02:50:16.404 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41396.log 2024-08-17T02:50:16.404 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44683.log.gz 2024-08-17T02:50:16.405 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49511.log: gzip 87.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49511.log.gz -- 2024-08-17T02:50:16.405 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.46743.log 2024-08-17T02:50:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47995.log 2024-08-17T02:50:16.406 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41396.log.gz 2024-08-17T02:50:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48980.log 2024-08-17T02:50:16.407 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46743.log.gz 2024-08-17T02:50:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47995.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47995.log.gz 2024-08-17T02:50:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50309.log 2024-08-17T02:50:16.409 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48980.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:50:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50309.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48980.log.gz 2024-08-17T02:50:16.411 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50309.log.gz 2024-08-17T02:50:16.411 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:50:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42992.log 2024-08-17T02:50:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49595.log 2024-08-17T02:50:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46209.log 2024-08-17T02:50:16.415 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42992.log.gz 2024-08-17T02:50:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49595.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:50:16.416 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40942.log 2024-08-17T02:50:16.416 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49595.log.gz 2024-08-17T02:50:16.417 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2024-08-17T02:50:16.417 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46209.log.gz 2024-08-17T02:50:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40942.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:50:16.418 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40942.log.gz 2024-08-17T02:50:16.419 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37065.log 2024-08-17T02:50:16.419 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2024-08-17T02:50:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46005.log 2024-08-17T02:50:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47783.log 2024-08-17T02:50:16.422 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37065.log.gz 2024-08-17T02:50:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46005.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46005.log.gz 2024-08-17T02:50:16.423 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48079.log 2024-08-17T02:50:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44810.log 2024-08-17T02:50:16.425 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47783.log.gz 2024-08-17T02:50:16.426 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45283.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48079.log.gz 2024-08-17T02:50:16.426 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:50:16.426 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44810.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44810.log.gz 2024-08-17T02:50:16.427 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50505.log 2024-08-17T02:50:16.428 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50413.log 2024-08-17T02:50:16.428 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45283.log.gz 2024-08-17T02:50:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46503.log 2024-08-17T02:50:16.430 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50505.log.gz 2024-08-17T02:50:16.431 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2024-08-17T02:50:16.431 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50413.log.gz 2024-08-17T02:50:16.432 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46503.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46503.log.gz 2024-08-17T02:50:16.432 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50099.log 2024-08-17T02:50:16.433 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46293.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2024-08-17T02:50:16.434 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48854.log 2024-08-17T02:50:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:50:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50099.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2024-08-17T02:50:16.436 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48938.log 2024-08-17T02:50:16.436 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48854.log.gz 2024-08-17T02:50:16.438 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2024-08-17T02:50:16.439 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48938.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48938.log.gz 2024-08-17T02:50:16.439 INFO:teuthology.orchestra.run.smithi026.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:50:16.440 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49469.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz 2024-08-17T02:50:16.440 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48602.log 2024-08-17T02:50:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47517.log 2024-08-17T02:50:16.443 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48602.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48602.log.gz 2024-08-17T02:50:16.444 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47517.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47517.log.gz 2024-08-17T02:50:16.445 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45031.log 2024-08-17T02:50:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43076.log 2024-08-17T02:50:16.448 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45031.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45031.log.gz 2024-08-17T02:50:16.449 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43076.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43076.log.gz 2024-08-17T02:50:16.450 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41952.log 2024-08-17T02:50:16.454 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41952.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41952.log.gz 2024-08-17T02:50:16.454 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47430.log 2024-08-17T02:50:16.454 INFO:teuthology.orchestra.run.smithi026.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:50:16.455 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.47430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47430.log.gz 2024-08-17T02:50:16.455 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48331.log 2024-08-17T02:50:16.457 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49847.log 2024-08-17T02:50:16.458 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48331.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48331.log.gz 2024-08-17T02:50:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49847.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49847.log.gz 2024-08-17T02:50:16.460 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49805.log 2024-08-17T02:50:16.462 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47243.log 2024-08-17T02:50:16.463 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49805.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49805.log.gz 2024-08-17T02:50:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47243.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47243.log.gz 2024-08-17T02:50:16.465 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2024-08-17T02:50:16.466 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46419.log 2024-08-17T02:50:16.467 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45459.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2024-08-17T02:50:16.469 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46419.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46419.log.gz 2024-08-17T02:50:16.469 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2024-08-17T02:50:16.471 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41945.log 2024-08-17T02:50:16.472 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47475.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2024-08-17T02:50:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41945.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41945.log.gz 2024-08-17T02:50:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-08-17T02:50:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45157.log 2024-08-17T02:50:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42291.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-08-17T02:50:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45157.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45157.log.gz 2024-08-17T02:50:16.480 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2024-08-17T02:50:16.481 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:50:16.481 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.41774.log 2024-08-17T02:50:16.482 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42627.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2024-08-17T02:50:16.482 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.46461.log 2024-08-17T02:50:16.483 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49553.log 2024-08-17T02:50:16.484 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-08-17T02:50:16.485 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46461.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46461.log.gz 2024-08-17T02:50:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49553.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49553.log.gz 2024-08-17T02:50:16.486 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43985.log 2024-08-17T02:50:16.488 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45241.log 2024-08-17T02:50:16.489 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41522.log 2024-08-17T02:50:16.489 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43985.log.gz 2024-08-17T02:50:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45241.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45241.log.gz 2024-08-17T02:50:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46251.log 2024-08-17T02:50:16.491 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41522.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41522.log.gz 2024-08-17T02:50:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42824.log 2024-08-17T02:50:16.493 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47559.log 2024-08-17T02:50:16.494 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46251.log.gz 2024-08-17T02:50:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49973.log 2024-08-17T02:50:16.495 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42824.log.gz 2024-08-17T02:50:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47559.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47559.log.gz 2024-08-17T02:50:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49637.log 2024-08-17T02:50:16.497 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49973.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2024-08-17T02:50:16.498 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49973.log.gz 2024-08-17T02:50:16.499 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47697.log 2024-08-17T02:50:16.499 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49637.log.gz 2024-08-17T02:50:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47093.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2024-08-17T02:50:16.500 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47009.log 2024-08-17T02:50:16.501 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41951.log 2024-08-17T02:50:16.502 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gz 2024-08-17T02:50:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47009.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47009.log.gz 2024-08-17T02:50:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 2024-08-17T02:50:16.504 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41951.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41951.log.gz 2024-08-17T02:50:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45837.log 2024-08-17T02:50:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41224.log 2024-08-17T02:50:16.507 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2024-08-17T02:50:16.507 INFO:teuthology.orchestra.run.smithi002.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:50:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45837.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45837.log.gz 2024-08-17T02:50:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49269.log 2024-08-17T02:50:16.509 INFO:teuthology.orchestra.run.smithi026.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42625.log 2024-08-17T02:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41224.log.gz 2024-08-17T02:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50461.log 2024-08-17T02:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49269.log.gz 2024-08-17T02:50:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41941.log 2024-08-17T02:50:16.511 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42625.log.gz 2024-08-17T02:50:16.513 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44641.log 2024-08-17T02:50:16.513 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50461.log.gz 2024-08-17T02:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42620.log 2024-08-17T02:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41941.log.gz 2024-08-17T02:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42292.log 2024-08-17T02:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44641.log.gz 2024-08-17T02:50:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41648.log 2024-08-17T02:50:16.516 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42620.log.gz 2024-08-17T02:50:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42285.log 2024-08-17T02:50:16.518 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42292.log.gz 2024-08-17T02:50:16.519 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50267.log 2024-08-17T02:50:16.519 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41648.log.gz 2024-08-17T02:50:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43118.log 2024-08-17T02:50:16.520 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42285.log.gz 2024-08-17T02:50:16.521 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47825.log 2024-08-17T02:50:16.521 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50267.log.gz 2024-08-17T02:50:16.522 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48037.log 2024-08-17T02:50:16.523 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43118.log.gz 2024-08-17T02:50:16.523 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44855.log 2024-08-17T02:50:16.524 INFO:teuthology.orchestra.run.smithi002.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47825.log.gz 2024-08-17T02:50:16.525 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42623.log 2024-08-17T02:50:16.525 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48037.log.gz 2024-08-17T02:50:16.526 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48289.log 2024-08-17T02:50:16.526 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44855.log.gz 2024-08-17T02:50:16.527 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47739.log 2024-08-17T02:50:16.528 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42623.log.gz 2024-08-17T02:50:16.529 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46125.log 2024-08-17T02:50:16.529 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48289.log.gz 2024-08-17T02:50:16.530 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44371.log 2024-08-17T02:50:16.530 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2024-08-17T02:50:16.531 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46545.log 2024-08-17T02:50:16.531 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46125.log.gz 2024-08-17T02:50:16.532 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48373.log 2024-08-17T02:50:16.533 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44371.log.gz 2024-08-17T02:50:16.533 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45879.log 2024-08-17T02:50:16.534 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46545.log.gz 2024-08-17T02:50:16.535 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50057.log 2024-08-17T02:50:16.535 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48373.log.gz 2024-08-17T02:50:16.536 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43202.log 2024-08-17T02:50:16.536 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45879.log.gz 2024-08-17T02:50:16.537 INFO:teuthology.orchestra.run.smithi026.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:50:16.537 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-08-17T02:50:16.538 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50057.log.gz 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43454.log 2024-08-17T02:50:16.539 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43202.log.gz 2024-08-17T02:50:16.540 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41480.log 2024-08-17T02:50:16.540 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-08-17T02:50:16.541 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-08-17T02:50:16.542 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43454.log.gz 2024-08-17T02:50:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48812.log 2024-08-17T02:50:16.543 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41480.log.gz 2024-08-17T02:50:16.543 INFO:teuthology.orchestra.run.smithi026.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:50:16.544 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2024-08-17T02:50:16.544 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-08-17T02:50:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45963.log 2024-08-17T02:50:16.545 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48812.log.gz 2024-08-17T02:50:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49022.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:50:16.547 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2024-08-17T02:50:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44989.log 2024-08-17T02:50:16.548 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45963.log.gz 2024-08-17T02:50:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42289.log 2024-08-17T02:50:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44767.log 2024-08-17T02:50:16.550 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44989.log.gz 2024-08-17T02:50:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42289.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42289.log.gz 2024-08-17T02:50:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43922.log 2024-08-17T02:50:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44767.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47643.log 2024-08-17T02:50:16.553 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44767.log.gz 2024-08-17T02:50:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.43922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43922.log.gz 2024-08-17T02:50:16.554 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40861.log 2024-08-17T02:50:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45921.log 2024-08-17T02:50:16.555 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47643.log.gz 2024-08-17T02:50:16.556 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2024-08-17T02:50:16.557 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40861.log.gz 2024-08-17T02:50:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45921.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45921.log.gz 2024-08-17T02:50:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46377.log 2024-08-17T02:50:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45115.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2024-08-17T02:50:16.559 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46631.log 2024-08-17T02:50:16.561 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49124.log 2024-08-17T02:50:16.562 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46377.log.gz 2024-08-17T02:50:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46631.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46631.log.gz 2024-08-17T02:50:16.562 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49679.log 2024-08-17T02:50:16.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36948.log 2024-08-17T02:50:16.564 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49124.log.gz 2024-08-17T02:50:16.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2024-08-17T02:50:16.565 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49679.log.gz 2024-08-17T02:50:16.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36948.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36948.log.gz 2024-08-17T02:50:16.567 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45711.log 2024-08-17T02:50:16.568 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41354.log 2024-08-17T02:50:16.568 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2024-08-17T02:50:16.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45711.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45711.log.gz 2024-08-17T02:50:16.570 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44515.log 2024-08-17T02:50:16.570 INFO:teuthology.orchestra.run.smithi026.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:50:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41354.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41354.log.gz 2024-08-17T02:50:16.571 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50351.log 2024-08-17T02:50:16.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40765.log 2024-08-17T02:50:16.573 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44515.log.gz 2024-08-17T02:50:16.574 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-08-17T02:50:16.574 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m0.266s 2024-08-17T02:50:16.574 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m0.975s 2024-08-17T02:50:16.575 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m0.167s 2024-08-17T02:50:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2024-08-17T02:50:16.576 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50351.log.gz 2024-08-17T02:50:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41174.log 2024-08-17T02:50:16.576 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40765.log.gz 2024-08-17T02:50:16.577 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49167.log 2024-08-17T02:50:16.577 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2024-08-17T02:50:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41174.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41174.log.gz 2024-08-17T02:50:16.578 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 2024-08-17T02:50:16.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44946.log 2024-08-17T02:50:16.579 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49167.log.gz 2024-08-17T02:50:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41954.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-08-17T02:50:16.581 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.44946.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log 2024-08-17T02:50:16.582 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44946.log.gz 2024-08-17T02:50:16.582 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45795.log 2024-08-17T02:50:16.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48728.log 2024-08-17T02:50:16.584 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45585.log.gz 2024-08-17T02:50:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45795.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45795.log.gz 2024-08-17T02:50:16.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48728.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48728.log.gz 2024-08-17T02:50:16.594 INFO:teuthology.orchestra.run.smithi002.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:50:16.613 INFO:teuthology.orchestra.run.smithi002.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:50:16.622 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:50:16.635 INFO:teuthology.orchestra.run.smithi002.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:50:16.697 INFO:teuthology.orchestra.run.smithi002.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:50:16.701 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-08-17T02:50:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m0.397s 2024-08-17T02:50:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m1.180s 2024-08-17T02:50:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.637s 2024-08-17T02:50:16.701 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:50:16.702 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/remote/smithi002/log 2024-08-17T02:50:16.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:50:17.057 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/remote/smithi026/log 2024-08-17T02:50:17.058 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:50:17.244 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:50:17.266 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:50:17.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:50:17.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:50:17.372 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:50:17.381 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:50:17.382 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:50:17.386 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:50:17.415 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:50:17.420 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:50:17.422 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:50:17.422 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-08-17T02:50:17.422 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 -8407ns[+1787ns] +/- 45ms 2024-08-17T02:50:17.422 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -36us[ -25us] +/- 80ms 2024-08-17T02:50:17.423 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +91us[ +102us] +/- 65ms 2024-08-17T02:50:17.423 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:50:17.426 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:50:17.427 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-08-17T02:50:17.427 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 -13us[ -14us] +/- 45ms 2024-08-17T02:50:17.427 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 -29us[ -30us] +/- 80ms 2024-08-17T02:50:17.427 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +94us[ +94us] +/- 65ms 2024-08-17T02:50:17.427 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:50:17.428 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:50:17.475 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:50:17.475 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:50:17.548 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:50:17.667 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:50:17.781 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:50:17.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:17.842 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:50:17.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:17.903 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:50:17.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:50:18.055 INFO:teuthology.task.internal:Duration was 764.085709 seconds 2024-08-17T02:50:18.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:50:18.193 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:50:18.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:50:18.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:50:18.281 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:50:18.285 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:50:18.788 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:50:18.789 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-08-17T02:50:18.789 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:50:18.839 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-08-17T02:50:18.839 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:50:18.890 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:50:18.890 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:50:18.894 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:50:18.953 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:50:18.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:50:18.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:50:19.101 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:50:19.111 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:50:19.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:50:19.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:50:19.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:50:19.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:19.239 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:19.307 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-08-17T02:50:19.310 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-08-17T02:50:19.340 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:19.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:19.374 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:50:19.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:50:19.407 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:50:19.427 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:50:19.428 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/remote/smithi002 2024-08-17T02:50:19.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:50:19.492 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858292/remote/smithi026 2024-08-17T02:50:19.492 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:50:19.555 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:50:19.556 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:50:19.560 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:50:19.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:50:19.607 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:50:19.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:50:19.670 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:50:19.670 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:50:19.675 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:50:19.705 INFO:teuthology.orchestra.run.smithi002.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:50 /home/ubuntu/cephtest 2024-08-17T02:50:19.709 INFO:teuthology.orchestra.run.smithi026.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:50 /home/ubuntu/cephtest 2024-08-17T02:50:19.712 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:50:19.774 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:50:19.880 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 764.0857093334198 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=01d40cdd0a104d5cb04748027afe074e status: fail success: false 2024-08-17T02:50:19.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:50:19.960 INFO:teuthology.run:FAIL